Article
 

Using Equilibrium Policy Gradients for Spatiotemporal Planning in Forest Ecosystem Management

公开 Deposited

可下载的内容

下载PDF文件
https://ir.library.oregonstate.edu/concern/articles/6w924c960

Descriptions

Attribute NameValues
Creator
Abstract
  • Spatiotemporal planning involves making choices at multiple locations in space over some planning horizon to maximize utility and satisfy various constraints. In Forest Ecosystem Management, the problem is to choose actions for thousands of locations each year including harvesting, treating trees for fire or pests, or doing nothing. The utility models could place value on sale of lumber, ecosystem sustainability or employment levels and incorporate legal and logistical constraints on actions such as avoiding large contiguous areas of clearcutting. Simulators developed by forestry researchers provide detailed dynamics but are generally inaccesible black boxes.We model spatiotemporal planning as a factored Markov decision process and present a policy gradient planning algorithm to optimize a stochastic spatial policy using simulated dynamics. It is common in environmental and resource planning to have actions at different locations be spatially interelated; this makes representation and planning challenging. We define a global spatial policy in terms of interacting local policies defining distributions over actions at each location conditioned on actions at nearby locations. Markov Chain Monte Carlo simulation is used to sample landscape policies and estimate their gradients. Evaluation is carried out on a forestry planning problem with 1880 locations using a variety of value models and constraints.
  • This is an author's peer-reviewed final manuscript, as accepted by the publisher. The published article is copyrighted by IEEE-Institute of Electrical and Electronics Engineers and can be found at: http://www.computer.org/portal/web/tc/about (c) 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
  • Keywords: Machine Learning, Markov Decision Processes, Reinforcement Learning, Optimization, Computational Sustainability, Forestry Planning, Ecosystem Management, Policy Gradient Planning
Resource Type
DOI
Date Available
Date Issued
Citation
  • Mark Crowley, "Using Equilibrium Policy Gradients for Spatiotemporal Planning in Forest Ecosystem Management," IEEE Transactions on Computers, vol. 63, no. 1, pp. 142-154, Jan. 2014, doi:10.1109/TC.2013.113
Journal Title
Journal Volume
  • 63
Journal Issue/Number
  • 1
权利声明
Publisher
Peer Reviewed
Language
Replaces

关联

Parents:

This work has no parents.

单件

缩略图 标题 上传日期 公开度 行动
file details CrowleyMarkElectricalEngineeringComputerScienceUsingEquilibriumPolicy.pdf 2017-07-18 公开 下载