Search Constraints

Start Over
Filtering by: Creator Cullen, J. J. Remove constraint Creator: Cullen, J. J. Committee Member Tadepalli, Prasad Remove constraint Committee Member: Tadepalli, Prasad Creator Duong, Thai Remove constraint Creator: Duong, Thai

Search Results

  • Adiabatic Markov Decision Process : convergence of value iteration algorithm

    Creator:
    Duong, Thai
    Abstract:
    Markov Decision Process (MDP) is a well-known framework for devising the optimal decision making strategies under uncertainty. Typically, the decision maker assumes a stationary environment which is characterized by a time-invariant transition probability matrix. However, in many real-world scenarios, this assumption is not justified, thus the optimal strategy might not...
    Resource Type:
    Masters Thesis
    Full Text:
    ) ≤ δdsp(v) where: δd = 1 − mins,u∈S×S ∑ j∈S min{Pd( j|s),Pd( j|u)} Pd is the transition matrix

  • Data Collection in Sensor Networks via the Novel Fast Markov Decision Process Framework

    Creator:
    Duong, Thai
    Abstract:
    We investigate the data collection problem in sensor networks. The network consists of a number of stationary sensors deployed at different sites for sensing and storing data locally. A mobile element moves from sites to sites to collect data from the sensors periodically. There are different costs associated with the...
    Resource Type:
    Masters Thesis
    Full Text:
    function R. The transition probability matrix P specifies the dynamics of the system. Each entry P(i, j