Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction

Sarah Cosentino, Yoshihisa Sugita, Massimiliano Zecca, Salvatore Sessa, Zhuohua Lin, Klaus Petersen, Hiroyuki Ishii, Atsuo Takanishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.

Original languageEnglish
Title of host publication2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest
Pages30-35
Number of pages6
DOIs
Publication statusPublished - 2012 Dec 1
Event2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Guangzhou, China
Duration: 2012 Dec 112012 Dec 14

Publication series

Name2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest

Conference

Conference2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012
CountryChina
CityGuangzhou
Period12/12/1112/12/14

Keywords

  • Human-robot interaction
  • bioinstrumentation
  • hand gesture recognition
  • inertial measurement
  • sensing

ASJC Scopus subject areas

  • Artificial Intelligence
  • Biotechnology

Fingerprint Dive into the research topics of 'Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction'. Together they form a unique fingerprint.

  • Cite this

    Cosentino, S., Sugita, Y., Zecca, M., Sessa, S., Lin, Z., Petersen, K., Ishii, H., & Takanishi, A. (2012). Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. In 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest (pp. 30-35). [6490939] (2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest). https://doi.org/10.1109/ROBIO.2012.6490939