Search Constraints

Start Over
Filtering by: Creator Rossignol, P. A. Remove constraint Creator: Rossignol, P. A. Committee Member Tadepalli, Prasad Remove constraint Committee Member: Tadepalli, Prasad Creator Duong, Thai Remove constraint Creator: Duong, Thai

Search Results

  • Adiabatic Markov Decision Process : convergence of value iteration algorithm

    Creator:
    Duong, Thai
    Abstract:
    Markov Decision Process (MDP) is a well-known framework for devising the optimal decision making strategies under uncertainty. Typically, the decision maker assumes a stationary environment which is characterized by a time-invariant transition probability matrix. However, in many real-world scenarios, this assumption is not justified, thus the optimal strategy might not...
    Resource Type:
    Masters Thesis
    Full Text:
    are characterized by a time-invariant transition probability matrix P. 3 1.2 Non-stationary

  • Data Collection in Sensor Networks via the Novel Fast Markov Decision Process Framework

    Creator:
    Duong, Thai
    Abstract:
    We investigate the data collection problem in sensor networks. The network consists of a number of stationary sensors deployed at different sites for sensing and storing data locally. A mobile element moves from sites to sites to collect data from the sensors periodically. There are different costs associated with the...
    Resource Type:
    Masters Thesis
    Full Text:
    of the system, a set of control actions A, a transition probability matrix P|S|×|S|, and a reward