Development of a real-time instrument tracking system for enabling the musical interaction with the Waseda flutist robot

Klaus Petersen, Jorge Solis, Atsuo Takanishi

研究成果: Conference contribution

9 引用 (Scopus)

抜粋

The aim of this paper is to create an interface for human-robot interaction. Specifically, musical performance parameters (i.e. vibrato expression) of the Waseda Flutist Robot No.4 Refined IV (WF-4RIV) are to be manipulated. Our research is focused on enabling the WF-4RIV to interact with human players (musicians) in a natural way. In this paper, as a first approach, a vision processing algorithm, that is able to track the 3D-orientation and position of a musical instrument, was developed. In particular, the robot acquires image data through two cameras attached to its head. Using color histogram matching and a particle filter, the position of the musician's hands on the instrument are tracked. Analysis of this data determines orientation and location of the instrument. These parameters are mapped to manipulate the musical expression of the WF-4RIV, more specifically sound vibrato and volume values.We present preliminary experiments to determine if the robot may dynamically change musical parameters while interacting with a human player (i.e. vibrato etc.). From the experimental results, we may confirm the feasibility of the interaction during a performance, although further research must be carried out to consider the physical constraints of the flutist robot.

元の言語English
ホスト出版物のタイトル2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
ページ313-318
ページ数6
DOI
出版物ステータスPublished - 2008 12 1
イベント2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS - Nice, France
継続期間: 2008 9 222008 9 26

出版物シリーズ

名前2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS

Conference

Conference2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
France
Nice
期間08/9/2208/9/26

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

フィンガープリント Development of a real-time instrument tracking system for enabling the musical interaction with the Waseda flutist robot' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Petersen, K., Solis, J., & Takanishi, A. (2008). Development of a real-time instrument tracking system for enabling the musical interaction with the Waseda flutist robot. : 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS (pp. 313-318). [4650831] (2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS). https://doi.org/10.1109/IROS.2008.4650831