Acting intelligently to efficiently solve sequential decision problems requires the ability to extract hierarchical structure from the underlying domain dynamics, exploit it for optimal or near-optimal decision-making, and transfer it to related problems instead of solving every problem in isolation. This dissertation makes three contributions toward this goal.
The first...
This paper describes a method for finding areas of interest on a two-dimensional grid map used in the real-time strategy engine Stratagus. The method involves discovering chokepoints where through all simulation agents must pass. Using a set of tunable parameters, a full set of chokepoints are located. The redundant and...
This thesis addresses the problem of learning dynamic Bayesian network (DBN) models to support reinforcement learning. It focuses on learning regression tree models of the conditional probability distributions of the DBNs. Existing algorithms presume that the stochasticity in the domain can be modeled as a deterministic function with additive noise....
The production of cement and concrete results in the production of large amounts of CO₂ emissions which can have significant negative environmental impacts. Using supplementary cementing materials (SCMs) as a cement replacement is an effective solution to reduce these negative environmental impacts, as most SCMs are waste by-products from other...
The goal of the first part of this project was to investigate the influence of aggregate source and entrained air on the transport properties of concrete. Currently, there are several ASTM standards available that provide systematic procedures to evaluate mass transport properties of concrete. ASTM C642-13 (ASTM 2013), often referred...
Numerous dietary factors have been shown to influence the fatty acid profiles (FAP)
in breast milk from lactating women. However, few studies have evaluated the effect of trace
minerals on milk FAP. Consequently, the purpose of this study was to determine the effect
of selenium status on the FAP in...
There is renewed interest in North America for the use of calcium aluminate cement (CAC) in infrastructure repair. The interest is driven by the specialty properties that make CAC the ideal candidate for particular applications. These include rapid strength gain, even at temperatures approaching 0°C, the ability to customize fresh...
Chloride ion migration was studied under accelerated cathodic protection conditions using 6" x 6" x 6" mortar blocks of varying initial chloride content and water to cement ratios. An iron mesh embedded parallel to one face in the blocks acted as the cathode and zinc was thermally sprayed on the...
The Joint Program Executive Office for Chemical, Biological, Radiological, and Nuclear Defense (JPEO-CBRND) began development of a broad-spectrum antiviral countermeasure against deliberate use of high-consequence viral hemorrhagic fevers (VHFs) in 2016. The effort featured comprehensive preclinical research, including laboratory testing and rapid advancement of lead molecules into nonhuman primate (NHP)...
Two studies were conducted to determine the in vitro metabolic and hormonal effects on glucose 6-phosphate dehydrogenase activity (G6PD) in bovine mammary explants. Study I was conducted to determine the effects of palmitoyl CoA (5 and 25 uM), acetate (1 and 10 mM), spermidine (0.4 mM) and putrescine (0.4 mM)...