Complex games such as RTS games are naturally formalized
as Markov games. Given a Markov game, it is often possible
to hand-code or learn a set of policies that capture the
diversity of possible strategies. It is also often possible to
hand-code or learn an abstract simulator of the game...