Analysis of coordinated behavior structures with multi-agent deep reinforcement learning

Yuki Miyashita, Toshiharu Sugawara

研究成果: Article査読

抄録

Cooperation and coordination are major issues in studies on multi-agent systems because the entire performance of such systems is greatly affected by these activities. The issues are challenging however, because appropriate coordinated behaviors depend on not only environmental characteristics but also other agents’ strategies. On the other hand, advances in multi-agent deep reinforcement learning (MADRL) have recently attracted attention, because MADRL can considerably improve the entire performance of multi-agent systems in certain domains. The characteristics of learned coordination structures and agent’s resulting behaviors, however, have not been clarified sufficiently. Therefore, we focus here on MADRL in which agents have their own deep Q-networks (DQNs), and we analyze their coordinated behaviors and structures for the pickup and floor laying problem, which is an abstraction of our target application. In particular, we analyze the behaviors around scarce resources and long narrow passages in which conflicts such as collisions are likely to occur. We then indicated that different types of inputs to the networks exhibit similar performance but generate various coordination structures with associated behaviors, such as division of labor and a shared social norm, with no direct communication.

本文言語English
ページ(範囲)1069-1085
ページ数17
ジャーナルApplied Intelligence
51
2
DOI
出版ステータスPublished - 2021 2

ASJC Scopus subject areas

  • Artificial Intelligence

フィンガープリント 「Analysis of coordinated behavior structures with multi-agent deep reinforcement learning」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル