Natural human-robot musical interaction: understanding the music conductor gestures by using the WB-4 inertial measurement system

Sarah Cosentino, Klaus Petersen, Zhuohua Lin, Luca Bartolomeo, Salvatore Sessa, Massimiliano Zecca, Atsuo Takanishi

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

This paper presents an inertial measurement unit-based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction. With this system, the robot can understand the real-time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.

Original languageEnglish
JournalAdvanced Robotics
DOIs
Publication statusAccepted/In press - 2014

Fingerprint

Robots
Gesture recognition
Units of measurement

Keywords

  • human-robot interaction
  • humanoid robot
  • inertial measurement unit
  • musical robot

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Science Applications
  • Human-Computer Interaction
  • Control and Systems Engineering

Cite this

Natural human-robot musical interaction : understanding the music conductor gestures by using the WB-4 inertial measurement system. / Cosentino, Sarah; Petersen, Klaus; Lin, Zhuohua; Bartolomeo, Luca; Sessa, Salvatore; Zecca, Massimiliano; Takanishi, Atsuo.

In: Advanced Robotics, 2014.

Research output: Contribution to journalArticle

@article{7ba7bc1c4268439da6299250eadd113d,
title = "Natural human-robot musical interaction: understanding the music conductor gestures by using the WB-4 inertial measurement system",
abstract = "This paper presents an inertial measurement unit-based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction. With this system, the robot can understand the real-time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.",
keywords = "human-robot interaction, humanoid robot, inertial measurement unit, musical robot",
author = "Sarah Cosentino and Klaus Petersen and Zhuohua Lin and Luca Bartolomeo and Salvatore Sessa and Massimiliano Zecca and Atsuo Takanishi",
year = "2014",
doi = "10.1080/01691864.2014.889577",
language = "English",
journal = "Advanced Robotics",
issn = "0169-1864",
publisher = "Taylor and Francis Ltd.",

}

TY - JOUR

T1 - Natural human-robot musical interaction

T2 - understanding the music conductor gestures by using the WB-4 inertial measurement system

AU - Cosentino, Sarah

AU - Petersen, Klaus

AU - Lin, Zhuohua

AU - Bartolomeo, Luca

AU - Sessa, Salvatore

AU - Zecca, Massimiliano

AU - Takanishi, Atsuo

PY - 2014

Y1 - 2014

N2 - This paper presents an inertial measurement unit-based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction. With this system, the robot can understand the real-time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.

AB - This paper presents an inertial measurement unit-based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction. With this system, the robot can understand the real-time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.

KW - human-robot interaction

KW - humanoid robot

KW - inertial measurement unit

KW - musical robot

UR - http://www.scopus.com/inward/record.url?scp=84894283675&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84894283675&partnerID=8YFLogxK

U2 - 10.1080/01691864.2014.889577

DO - 10.1080/01691864.2014.889577

M3 - Article

AN - SCOPUS:84894283675

JO - Advanced Robotics

JF - Advanced Robotics

SN - 0169-1864

ER -