Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction

Sarah Cosentino, Yoshihisa Sugita, Massimiliano Zecca, Salvatore Sessa, Zhuohua Lin, Klaus Petersen, Hiroyuki Ishii, Atsuo Takanishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.

Original languageEnglish
Title of host publication2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest
Pages30-35
Number of pages6
DOIs
Publication statusPublished - 2012
Event2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Guangzhou
Duration: 2012 Dec 112012 Dec 14

Other

Other2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012
CityGuangzhou
Period12/12/1112/12/14

Fingerprint

Gesture recognition
Gestures
Music
Robots
Aptitude
Direction compound

Keywords

  • bioinstrumentation
  • hand gesture recognition
  • Human-robot interaction
  • inertial measurement
  • sensing

ASJC Scopus subject areas

  • Artificial Intelligence
  • Biotechnology

Cite this

Cosentino, S., Sugita, Y., Zecca, M., Sessa, S., Lin, Z., Petersen, K., ... Takanishi, A. (2012). Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. In 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest (pp. 30-35). [6490939] https://doi.org/10.1109/ROBIO.2012.6490939

Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. / Cosentino, Sarah; Sugita, Yoshihisa; Zecca, Massimiliano; Sessa, Salvatore; Lin, Zhuohua; Petersen, Klaus; Ishii, Hiroyuki; Takanishi, Atsuo.

2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest. 2012. p. 30-35 6490939.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cosentino, S, Sugita, Y, Zecca, M, Sessa, S, Lin, Z, Petersen, K, Ishii, H & Takanishi, A 2012, Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. in 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest., 6490939, pp. 30-35, 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012, Guangzhou, 12/12/11. https://doi.org/10.1109/ROBIO.2012.6490939
Cosentino S, Sugita Y, Zecca M, Sessa S, Lin Z, Petersen K et al. Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. In 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest. 2012. p. 30-35. 6490939 https://doi.org/10.1109/ROBIO.2012.6490939
Cosentino, Sarah ; Sugita, Yoshihisa ; Zecca, Massimiliano ; Sessa, Salvatore ; Lin, Zhuohua ; Petersen, Klaus ; Ishii, Hiroyuki ; Takanishi, Atsuo. / Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest. 2012. pp. 30-35
@inproceedings{74a64326d784489fa39ab97832e5ca49,
title = "Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction",
abstract = "In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.",
keywords = "bioinstrumentation, hand gesture recognition, Human-robot interaction, inertial measurement, sensing",
author = "Sarah Cosentino and Yoshihisa Sugita and Massimiliano Zecca and Salvatore Sessa and Zhuohua Lin and Klaus Petersen and Hiroyuki Ishii and Atsuo Takanishi",
year = "2012",
doi = "10.1109/ROBIO.2012.6490939",
language = "English",
isbn = "9781467321273",
pages = "30--35",
booktitle = "2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest",

}

TY - GEN

T1 - Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction

AU - Cosentino, Sarah

AU - Sugita, Yoshihisa

AU - Zecca, Massimiliano

AU - Sessa, Salvatore

AU - Lin, Zhuohua

AU - Petersen, Klaus

AU - Ishii, Hiroyuki

AU - Takanishi, Atsuo

PY - 2012

Y1 - 2012

N2 - In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.

AB - In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.

KW - bioinstrumentation

KW - hand gesture recognition

KW - Human-robot interaction

KW - inertial measurement

KW - sensing

UR - http://www.scopus.com/inward/record.url?scp=84876489456&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876489456&partnerID=8YFLogxK

U2 - 10.1109/ROBIO.2012.6490939

DO - 10.1109/ROBIO.2012.6490939

M3 - Conference contribution

AN - SCOPUS:84876489456

SN - 9781467321273

SP - 30

EP - 35

BT - 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest

ER -