Robot musical accompaniment: Integrating audio and visual cues for real-time synchronization with a human flutist

Angelica Lim*, Takeshi Mizumoto, Louis Kenzo Cahier, Takuma Otsuka, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

*この研究の対応する著者

研究成果: Conference contribution

25 被引用数 (Scopus)

抄録

Musicians often have the following problem: they have a music score that requires 2 or more players, but they have no one with whom to practice. So far, score-playing music robots exist, but they lack adaptive abilities to synchronize with fellow players' tempo variations. In other words, if the human speeds up their play, the robot should also increase its speed. However, computer accompaniment systems allow exactly this kind of adaptive ability. We present a first step towards giving these accompaniment abilities to a music robot. We introduce a new paradigm of beat tracking using 2 types of sensory input - visual and audio - using our own visual cue recognition system and state-of-the-art acoustic onset detection techniques. Preliminary experiments suggest that by coupling these two modalities, a robot accompanist can start and stop a performance in synchrony with a flutist, and detect tempo changes within half a second.

本文言語English
ホスト出版物のタイトルIEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings
ページ1964-1969
ページ数6
DOI
出版ステータスPublished - 2010 12月 1
外部発表はい
イベント23rd IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Taipei, Taiwan, Province of China
継続期間: 2010 10月 182010 10月 22

出版物シリーズ

名前IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings

Conference

Conference23rd IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010
国/地域Taiwan, Province of China
CityTaipei
Period10/10/1810/10/22

ASJC Scopus subject areas

  • 人工知能
  • 人間とコンピュータの相互作用
  • 制御およびシステム工学

フィンガープリント

「Robot musical accompaniment: Integrating audio and visual cues for real-time synchronization with a human flutist」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル