PAC Optimal MDP Planning with Application to Invasive Species Management Public Deposited

http://ir.library.oregonstate.edu/concern/articles/1c18dh59v

This is the publisher’s final pdf. The published article is copyrighted by the author(s) and published by Journal of Machine Learning Research, Microtome Publishing. The published article can be found at:  http://www.jmlr.org/

Descriptions

Attribute NameValues
Creator
Abstract or Summary
  • In a simulator-defined MDP, the Markovian dynamics and rewards are provided in the form of a simulator from which samples can be drawn. This paper studies MDP planning algorithms that attempt to minimize the number of simulator calls before terminating and outputting a policy that is approximately optimal with high probability. The paper introduces two heuristics for efficient exploration and an improved confidence interval that enables earlier termination with probabilistic guarantees. We prove that the heuristics and the confidence interval are sound and produce with high probability an approximately optimal policy in polynomial time. Experiments on two benchmark problems and two instances of an invasive species management problem show that the improved confidence intervals and the new search heuristics yield reductions of between 8% and 47% in the number of simulator calls required to reach near-optimal policies.
Resource Type
Date Available
Date Issued
Citation
  • Taleghan, M. A., Dietterich, T. G., Crowley, M., Hall, K., & Albers, H. J. (2015). PAC Optimal MDP Planning with Application to Invasive Species Management. Journal of Machine Learning Research, 16, 3877-3903.
Series
Keyword
Rights Statement
Funding Statement (additional comments about funding)
Publisher
Peer Reviewed
Language
Replaces
Additional Information
  • description.provenance : Approved for entry into archive by Patricia Black(patricia.black@oregonstate.edu) on 2016-03-08T18:25:12Z (GMT) No. of bitstreams: 1 TaleghanPACOptimalMDPPlanning.pdf: 2290708 bytes, checksum: 61320a192df525cd61547de87536e59b (MD5)
  • description.provenance : Made available in DSpace on 2016-03-08T18:25:12Z (GMT). No. of bitstreams: 1 TaleghanPACOptimalMDPPlanning.pdf: 2290708 bytes, checksum: 61320a192df525cd61547de87536e59b (MD5) Previous issue date: 2015-12
  • description.provenance : Submitted by Patricia Black (patricia.black@oregonstate.edu) on 2016-03-08T18:24:45Z No. of bitstreams: 1 TaleghanPACOptimalMDPPlanning.pdf: 2290708 bytes, checksum: 61320a192df525cd61547de87536e59b (MD5)

Relationships

In Administrative Set:
Last modified: 07/26/2017

Downloadable Content

Download PDF
Citations:

EndNote | Zotero | Mendeley

Items