Using Equilibrium Policy Gradients for Spatiotemporal Planning in Forest Ecosystem Management Public Deposited

http://ir.library.oregonstate.edu/concern/defaults/6w924c960

This is an author's peer-reviewed final manuscript, as accepted by the publisher. The published article is copyrighted by IEEE-Institute of Electrical and Electronics Engineers and can be found at:  http://www.computer.org/portal/web/tc/about (c) 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.

Descriptions

Attribute NameValues
Creator
Abstract or Summary
  • Spatiotemporal planning involves making choices at multiple locations in space over some planning horizon to maximize utility and satisfy various constraints. In Forest Ecosystem Management, the problem is to choose actions for thousands of locations each year including harvesting, treating trees for fire or pests, or doing nothing. The utility models could place value on sale of lumber, ecosystem sustainability or employment levels and incorporate legal and logistical constraints on actions such as avoiding large contiguous areas of clearcutting. Simulators developed by forestry researchers provide detailed dynamics but are generally inaccesible black boxes.We model spatiotemporal planning as a factored Markov decision process and present a policy gradient planning algorithm to optimize a stochastic spatial policy using simulated dynamics. It is common in environmental and resource planning to have actions at different locations be spatially interelated; this makes representation and planning challenging. We define a global spatial policy in terms of interacting local policies defining distributions over actions at each location conditioned on actions at nearby locations. Markov Chain Monte Carlo simulation is used to sample landscape policies and estimate their gradients. Evaluation is carried out on a forestry planning problem with 1880 locations using a variety of value models and constraints.
Resource Type
DOI
Date Available
Date Issued
Citation
  • Mark Crowley, "Using Equilibrium Policy Gradients for Spatiotemporal Planning in Forest Ecosystem Management," IEEE Transactions on Computers, vol. 63, no. 1, pp. 142-154, Jan. 2014, doi:10.1109/TC.2013.113
Series
Keyword
Rights Statement
Publisher
Peer Reviewed
Language
Replaces
Additional Information
  • description.provenance : Approved for entry into archive by Deanne Bruner(deanne.bruner@oregonstate.edu) on 2014-01-29T00:02:33Z (GMT) No. of bitstreams: 1 CrowleyMarkElectricalEngineeringComputerScienceUsingEquilibriumPolicy.pdf: 4062844 bytes, checksum: 1fd143e80ccf73572bfe86e0b94118ad (MD5)
  • description.provenance : Made available in DSpace on 2014-01-29T00:02:33Z (GMT). No. of bitstreams: 1 CrowleyMarkElectricalEngineeringComputerScienceUsingEquilibriumPolicy.pdf: 4062844 bytes, checksum: 1fd143e80ccf73572bfe86e0b94118ad (MD5) Previous issue date: 2014-01
  • description.provenance : Submitted by Deanne Bruner (deanne.bruner@oregonstate.edu) on 2014-01-28T23:54:33Z No. of bitstreams: 1 CrowleyMarkElectricalEngineeringComputerScienceUsingEquilibriumPolicy.pdf: 4062844 bytes, checksum: 1fd143e80ccf73572bfe86e0b94118ad (MD5)

Relationships

In Administrative Set:
Last modified: 07/18/2017

Downloadable Content

Download PDF
Citations:

EndNote | Zotero | Mendeley

Items