Search Constraints

Start Over
Filtering by: Creator Sheley, R. L. Remove constraint Creator: Sheley, R. L. Committee Member Tadepalli, Prasad Remove constraint Committee Member: Tadepalli, Prasad Subject Markov processes Remove constraint Subject: Markov processes

Search Results

  • Simulator-Defined MDP Planning with Applications in Natural Resource Management

    Creator:
    Alkaee Taleghan, Majid
    Abstract:
    This work is inspired by problems in natural resource management centered on the challenge of invasive species. Computing optimal management policies for maintaining ecosystem sustainable is challenging. Many ecosystem management problems can be formulated as MDP (Markov Decision Process) planning problems. In a simulator-defined MDP, the Markovian dynamics and rewards...
    Resource Type:
    Dissertation
    Full Text:
    . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 4.6 Plots of V UCB(λ ν lower) R , VR − V UCB(λνlower) R , and V UCB(λνlower) C on the vertical

  • Monte Carlo Tree Search with Fixed and Adaptive Abstractions

    Creator:
    Hostetler, Jesse A.
    Abstract:
    Monte Carlo tree search (MCTS) is a class of online planning algorithms for Markov decision processes (MDPs) and related models that has found success in challenging applications. In the online planning approach, the agent makes a decision in the current state by performing a limited forward search over possible futures...
    Resource Type:
    Dissertation
    Full Text:
    - tical performance at the p = 0.05 level. This plot was produced by the R package scmamp [Calvo and

  • Data Collection in Sensor Networks via the Novel Fast Markov Decision Process Framework

    Creator:
    Duong, Thai
    Abstract:
    We investigate the data collection problem in sensor networks. The network consists of a number of stationary sensors deployed at different sites for sensing and storing data locally. A mobile element moves from sites to sites to collect data from the sensors periodically. There are different costs associated with the...
    Resource Type:
    Masters Thesis
    Full Text:
    function R. The transition probability matrix P specifies the dynamics of the system. Each entry P(i, j

  • Adiabatic Markov Decision Process : convergence of value iteration algorithm

    Creator:
    Duong, Thai
    Abstract:
    Markov Decision Process (MDP) is a well-known framework for devising the optimal decision making strategies under uncertainty. Typically, the decision maker assumes a stationary environment which is characterized by a time-invariant transition probability matrix. However, in many real-world scenarios, this assumption is not justified, thus the optimal strategy might not...
    Resource Type:
    Masters Thesis
    Full Text:
    example . . 47 4.3 The reward r(s,a) for discrete-time queuing system . . . . . . . . . . . 49

  • Incorporating and Learning Behavior Constraints for Sequential Decision Making

    Creator:
    Pinto, Jervis
    Abstract:
    Writing a program that performs well in a complex environment is a challenging task. In such problems, a method of deterministic programming combined with reinforcement learning (RL) can be helpful. However, current systems either force developers to encode knowledge in very specific forms (e.g., state-action features), or assume advanced RL...
    Resource Type:
    Dissertation
    Full Text:
    current program location `′ is at choice (A′, a′). The last choice is (A, a) with reward r seen in