Abstract
This paper presents an inertial measurement unit-based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction. With this system, the robot can understand the real-time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.
| Original language | English |
|---|---|
| Journal | Advanced Robotics |
| DOIs | |
| Publication status | Accepted/In press - 2014 |
Fingerprint
Keywords
- human-robot interaction
- humanoid robot
- inertial measurement unit
- musical robot
ASJC Scopus subject areas
- Software
- Hardware and Architecture
- Computer Science Applications
- Human-Computer Interaction
- Control and Systems Engineering
Cite this
Natural human-robot musical interaction : understanding the music conductor gestures by using the WB-4 inertial measurement system. / Cosentino, Sarah; Petersen, Klaus; Lin, Zhuohua; Bartolomeo, Luca; Sessa, Salvatore; Zecca, Massimiliano; Takanishi, Atsuo.
In: Advanced Robotics, 2014.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Natural human-robot musical interaction
T2 - understanding the music conductor gestures by using the WB-4 inertial measurement system
AU - Cosentino, Sarah
AU - Petersen, Klaus
AU - Lin, Zhuohua
AU - Bartolomeo, Luca
AU - Sessa, Salvatore
AU - Zecca, Massimiliano
AU - Takanishi, Atsuo
PY - 2014
Y1 - 2014
N2 - This paper presents an inertial measurement unit-based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction. With this system, the robot can understand the real-time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.
AB - This paper presents an inertial measurement unit-based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction. With this system, the robot can understand the real-time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.
KW - human-robot interaction
KW - humanoid robot
KW - inertial measurement unit
KW - musical robot
UR - http://www.scopus.com/inward/record.url?scp=84894283675&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84894283675&partnerID=8YFLogxK
U2 - 10.1080/01691864.2014.889577
DO - 10.1080/01691864.2014.889577
M3 - Article
AN - SCOPUS:84894283675
JO - Advanced Robotics
JF - Advanced Robotics
SN - 0169-1864
ER -