Toward enabling a natural interaction between human musicians and musical performance robots: Implementation of a real-time gestural interface

Klaus Petersen*, Jorge Solis, Atsuo Takanishi

*この研究の対応する著者

研究成果: Conference contribution

15 被引用数 (Scopus)

抄録

Our research aims to develop an anthropomorphic flutist robot as a benchmark for the better understanding of interaction between musicians and musical performance robots from a musical point of view. As a long-term goal of our research, we would like to enable such robots to play actively together with a human band, and create novel ways of musical expression. For this purpose, we focus on enhancing the perceptual capabilities of the flutist robot to process musical information coming from the aural and visual perceptual channels. In this paper, we introduce, as a first approach, a hands-free gesture-based control interface designed to modify musical parameters in real-time. In particular, we describe a set of virtual controllers, that a composer can manipulate through gestures of with a musical instrument. The gestures are Identified by 2-D motion sensitive areas which graphically represent common control interfaces used in music production. The resulting information from the vision processing is then transformed into MIDI messages, which are subsequently played by the flute robot. In order to verify the effectiveness of the proposed gestural interface, we performed experiments to musically interact with musical partners. ¿From the experimental results we concluded that our method satisfies the technical and idiosyncratic requirements for being a suitable tool for musical performance.

本文言語English
ホスト出版物のタイトルProceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN
ページ340-345
ページ数6
DOI
出版ステータスPublished - 2008 10 6
イベント17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN - Munich, Germany
継続期間: 2008 8 12008 8 3

出版物シリーズ

名前Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN

Conference

Conference17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN
国/地域Germany
CityMunich
Period08/8/108/8/3

ASJC Scopus subject areas

  • 人工知能
  • コンピュータ ビジョンおよびパターン認識
  • 人間とコンピュータの相互作用

フィンガープリント

「Toward enabling a natural interaction between human musicians and musical performance robots: Implementation of a real-time gestural interface」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル