Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction

Sarah Cosentino; Yoshihisa Sugita; Massimiliano Zecca; Salvatore Sessa; Zhuohua Lin; Klaus Petersen; Hiroyuki Ishii; Atsuo Takanishi

doi:10.1109/ROBIO.2012.6490939

Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction

Sarah Cosentino^*, Yoshihisa Sugita, Massimiliano Zecca, Salvatore Sessa, Zhuohua Lin, Klaus Petersen, Hiroyuki Ishii, Atsuo Takanishi

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.

Original language	English
Title of host publication	2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest
Pages	30-35
Number of pages	6
DOIs	https://doi.org/10.1109/ROBIO.2012.6490939
Publication status	Published - 2012 Dec 1
Event	2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Guangzhou, China Duration: 2012 Dec 11 → 2012 Dec 14

Publication series

Name	2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest

Conference

Conference	2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012
Country/Territory	China
City	Guangzhou
Period	12/12/11 → 12/12/14

Keywords

Human-robot interaction
bioinstrumentation
hand gesture recognition
inertial measurement
sensing

ASJC Scopus subject areas

Artificial Intelligence
Biotechnology

Access to Document

10.1109/ROBIO.2012.6490939

Cite this

Cosentino, S., Sugita, Y., Zecca, M., Sessa, S., Lin, Z., Petersen, K., Ishii, H., & Takanishi, A. (2012). Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. In 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest (pp. 30-35). [6490939] (2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest). https://doi.org/10.1109/ROBIO.2012.6490939

Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. / Cosentino, Sarah; Sugita, Yoshihisa; Zecca, Massimiliano et al.

2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest. 2012. p. 30-35 6490939 (2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Cosentino, S, Sugita, Y, Zecca, M, Sessa, S, Lin, Z, Petersen, K, Ishii, H & Takanishi, A 2012, Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. in 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest., 6490939, 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest, pp. 30-35, 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012, Guangzhou, China, 12/12/11. https://doi.org/10.1109/ROBIO.2012.6490939

Cosentino S, Sugita Y, Zecca M, Sessa S, Lin Z, Petersen K et al. Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. In 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest. 2012. p. 30-35. 6490939. (2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest). doi: 10.1109/ROBIO.2012.6490939

Cosentino, Sarah ; Sugita, Yoshihisa ; Zecca, Massimiliano et al. / Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction. 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest. 2012. pp. 30-35 (2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest).

@inproceedings{74a64326d784489fa39ab97832e5ca49,

title = "Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction",

abstract = "In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.",

keywords = "Human-robot interaction, bioinstrumentation, hand gesture recognition, inertial measurement, sensing",

author = "Sarah Cosentino and Yoshihisa Sugita and Massimiliano Zecca and Salvatore Sessa and Zhuohua Lin and Klaus Petersen and Hiroyuki Ishii and Atsuo Takanishi",

year = "2012",

month = dec,

day = "1",

doi = "10.1109/ROBIO.2012.6490939",

language = "English",

isbn = "9781467321273",

series = "2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest",

pages = "30--35",

booktitle = "2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest",

note = "2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 ; Conference date: 11-12-2012 Through 14-12-2012",

}

TY - GEN

T1 - Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction

AU - Cosentino, Sarah

AU - Sugita, Yoshihisa

AU - Zecca, Massimiliano

AU - Sessa, Salvatore

AU - Lin, Zhuohua

AU - Petersen, Klaus

AU - Ishii, Hiroyuki

AU - Takanishi, Atsuo

PY - 2012/12/1

Y1 - 2012/12/1

N2 - In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.

AB - In this paper, we describe a human gesture recognition system developed to enable a robot instrument player to recognize the variations in tempo and in articulation dictated by a conductor's movements and accordingly adapt its performance. The enhanced interaction ability would allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, because of the complete naturalness of the interaction. In addition, the possibility for the robot to change its performance parameters according to the conductor directions, thus being synchronized with all the other human musicians, would lead to an improvement in the overall musical performance.

KW - Human-robot interaction

KW - bioinstrumentation

KW - hand gesture recognition

KW - inertial measurement

KW - sensing

UR - http://www.scopus.com/inward/record.url?scp=84876489456&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876489456&partnerID=8YFLogxK

U2 - 10.1109/ROBIO.2012.6490939

DO - 10.1109/ROBIO.2012.6490939

M3 - Conference contribution

AN - SCOPUS:84876489456

SN - 9781467321273

T3 - 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest

SP - 30

EP - 35

BT - 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest

T2 - 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012

Y2 - 11 December 2012 through 14 December 2012

ER -

Music conductor gesture recognition by using inertial measurement system for human-robot musical interaction

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this