Article
 

Learning indirect actions in complex domains: action suggestions for air traffic control

公开 Deposited

可下载的内容

下载PDF文件
https://ir.library.oregonstate.edu/concern/articles/1c18dg34s

Descriptions

Attribute NameValues
Creator
Abstract
  • Providing intelligent algorithms to manage the ever-increasing flow of air traffic is critical to the efficiency and economic viability of air transportation systems. Yet, current automated solutions leave existing human controllers “out of the loop" rendering the potential solutions both technically dangerous (e.g., inability to react to suddenly developing conditions) and politically charged (e.g., role of air traffic controllers in a fully automated system). Instead, this paper outlines a distributed agent based solution where agents provide suggestions to human controllers. Though conceptually pleasing, this approach introduces two critical research issues. First, the agent actions are now filtered through interactions with other agents, human controllers and the environment before leading to a system state. This indirect action-to-effect process creates a complex learning problem. Second, even in the best case, not all air traffic controllers will be willing or able to follow the agents' suggestions. This partial participation effect will require the system to be robust to the number of controllers that follow the agent suggestions. In this paper, we present an agent reward structure that allows agents to learn good actions in this indirect environment, and explore the ability of those suggestion agents to achieve good system level performance. We present a series of experiments based on real historical air traffic data combined with simulation of air traffic flow around the New York city area. Results show that the agents can improve system wide performance by up to 20% over that of human controllers alone, and that these results degrade gracefully when the number of human controllers that follow the agents' suggestions declines.
  • Electronic version of an article published as [Advances in Complex Systems, Volume: 12, Issues: 4-5, 2009, 493-512] [10.1142/S0219525909002283] © [copyright World Scientific Publishing Company] [http://www.worldscinet.com/acs/acs.shtml]
  • Keywords: Air traffic control, multiagent learning, learning indirect actions, suggestion agents
Resource Type
DOI
Date Available
Date Issued
Citation
  • Agogino, A., & Tumer, K. (2009). LEARNING INDIRECT ACTIONS IN COMPLEX DOMAINS:: ACTION SUGGESTIONS FOR AIR TRAFFIC CONTROL. Advances in Complex Systems, 12(4/5), 493-512. Retrieved from Academic Search Premier database.
Journal Title
Journal Volume
  • 12
权利声明
Publisher
Language
Replaces
ISSN
  • 02195259

关联

Parents:

This work has no parents.

单件

缩略图 标题 上传日期 公开度 行动
file details tumer_airtraf_article.pdf 2017-07-08 公开 下载