PIFE: Permutation Invariant Feature Extractor for Danmaku Games

Takuto Itoi, Edgar Simo-Serra

研究成果: Conference contribution

抄録

Dealing with unstructured complex patterns provides a challenge to existing reinforcement patterns. In this research, we propose a new model to overcome the difficulty in challenging danmaku games. Touhou Project is one of the bestknown games in the bullet hell genre also known as danmaku, where a player has to dodge complex patterns of bullets on the screen. Furthermore, the agent needs to react to the environment in real-time, which made existing methods having difficulties processing the high-volume data of objects; bullets, enemies, etc. We introduce an environment for the Touhou Project game'Phantasmagoria of Flower View.' which manipulates the memory of the running game and enables to control the character. However, the game state information consists of unstructured and unordered data not amenable for training existing reinforcement learning models, as they are not invariant to order changes in the input. To overcome this issue, we propose a new pooling-based reinforcement learning approach that is able to handle permutation invariant inputs by extracting abstract values and merging them in an order-independent way. Experimental results corroborate the effectiveness of our approach which shows significantly increased scores compared to existing baseline approaches.

本文言語English
ホスト出版物のタイトル2022 IEEE Conference on Games, CoG 2022
出版社IEEE Computer Society
ページ624-627
ページ数4
ISBN(電子版)9781665459891
DOI
出版ステータスPublished - 2022
イベント2022 IEEE Conference on Games, CoG 2022 - Beijing, China
継続期間: 2022 8月 212022 8月 24

出版物シリーズ

名前IEEE Conference on Computatonal Intelligence and Games, CIG
2022-August
ISSN(印刷版)2325-4270
ISSN(電子版)2325-4289

Conference

Conference2022 IEEE Conference on Games, CoG 2022
国/地域China
CityBeijing
Period22/8/2122/8/24

ASJC Scopus subject areas

  • 人工知能
  • コンピュータ グラフィックスおよびコンピュータ支援設計
  • コンピュータ ビジョンおよびパターン認識
  • 人間とコンピュータの相互作用
  • ソフトウェア

フィンガープリント

「PIFE: Permutation Invariant Feature Extractor for Danmaku Games」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル