Article

 

Coordinating actions in congestion games: Impact of top-down and bottom-up utilities Público Deposited

Contenido Descargable

Descargar PDF
https://ir.library.oregonstate.edu/concern/articles/p5547w92d

Descriptions

Attribute NameValues
Creator
Abstract
  • Congestion games offer a perfect environment in which to study the impact of local decisions on global utilities in multiagent systems. What is particularly interesting in such problems is that no individual action is intrinsically “good” or “bad” but that combinations of actions lead to desirable or undesirable outcomes. As a consequence, agents need to learn how to coordinate their actions with those of other agents, rather than learn a particular set of “good” actions. A congestion game can be studied from two different perspectives: (i) from the top down, where a global utility (e.g., a system-centric view of congestion) specifies the task to be achieved; or (ii) from the bottom up, where each agent has its own intrinsic utility it wants to maximize. In many cases, these two approaches are at odds with one another, where agents aiming to maximize their intrinsic utilities lead to poor values of a system level utility. In this paper we extend results on difference utilities, a form of shaped utility that enables multiagent learning in congested, noisy conditions, to study the global behavior that arises from the agents’ choices in two types of congestion games. Our key result is that agents that aim to maximize a modified version of their own intrinsic utilities not only perform well in terms of the global utility, but also, on average perform better with respect to their own original utilities. In addition, we show that difference utilities are robust to agents “defecting” and using their own intrinsic utilities, and that performance degrades gracefully with the number of defectors.
  • Keywords: Coordination, Multiagent, Congestion games, Reinforcement learning
Resource Type
DOI
Fecha Disponible
Fecha de Emisión
Citation
  • Tumer, K., & Proper, S. (2013). Coordinating actions in congestion games: Impact of top-down and bottom-up utilities. Autonomous Agents and Multi-Agent Systems, 27(3), 419-443. doi:10.1007/s10458-012-9211-z
Journal Title
Journal Volume
  • 27
Journal Issue/Number
  • 3
Declaración de derechos
Funding Statement (additional comments about funding)
  • This work was partially supported by NSF grant 0931591.
Publisher
Peer Reviewed
Language
Replaces

Relaciones

Parents:

This work has no parents.

Elementos