Considering agent and task openness in ad hoc team formation

Bin Chen, Xi Chen, Anish Timsina, Leen Kiat Soh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations

Abstract

When deciding which ad hoc team to join, agents are often required to consider rewards from accomplishing tasks as well as potential benefits from learning when working with others, when solving tasks. We argue that, in order to decide when to learn or when to solve task or both, agents have to consider the existing agents' capabilities and tasks available in the environment, and thus agents have to consider agent and task openness-the rate of new, previously unknown agents (and tasks) that are introduced into the environment. We further assume that agents evolve their capabilities intrinsically through learning by observation or learning by doing when working in a team. Thus, an agent will need to consider which task to do or which team to join would provide the best situation for such learning to occur. In this paper, we develop an auction-based multiagent simulation framework, a mechanism to simulate openness in our environment, and conduct comprehensive experiments. Our results, based on more than 20,000 simulation runs, show that considering environmental openness is beneficial and necessary, and task selection strategies leveraging openness can improve agent learning and performance. We also report on observations of emergent behaviors related to openness.

Original languageEnglish (US)
Title of host publicationAAMAS 2015 - Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems
EditorsRafael H. Bordini, Pinar Yolum, Edith Elkind, Gerhard Weiss
PublisherInternational Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
Pages1861-1862
Number of pages2
ISBN (Electronic)9781450337717
StatePublished - Jan 1 2015
Event14th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2015 - Istanbul, Turkey
Duration: May 4 2015May 8 2015

Publication series

NameProceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS
Volume3
ISSN (Print)1548-8403
ISSN (Electronic)1558-2914

Other

Other14th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2015
CountryTurkey
CityIstanbul
Period5/4/155/8/15

    Fingerprint

Keywords

  • Ad hoc team formation
  • Agent openness
  • Learning by doing
  • Learning by observation
  • Task openness

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software
  • Control and Systems Engineering

Cite this

Chen, B., Chen, X., Timsina, A., & Soh, L. K. (2015). Considering agent and task openness in ad hoc team formation. In R. H. Bordini, P. Yolum, E. Elkind, & G. Weiss (Eds.), AAMAS 2015 - Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems (pp. 1861-1862). (Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS; Vol. 3). International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).