Multi-robot teams offer promising solutions for many long term deployments in remote and dangerous domains, such as extraterrestrial or underseas exploration. However, long term deployments present many problems preventing robot teams from operating effectively. Learning over long time scales is makes it difficult to assign credit to robots' actions, as...