Development of performance system with musical dynamics expression on humanoid saxophonist robot

Jia Yeu Lin, Mao Kawai, Yuya Nishio, Sarah Cosentino, Atsuo Takanishi

Research output: Contribution to journalArticle

Abstract

Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.

Original languageEnglish
Article number8633975
Pages (from-to)1684-1690
Number of pages7
JournalIEEE Robotics and Automation Letters
Volume4
Issue number2
DOIs
Publication statusPublished - 2019 Apr 1

Fingerprint

Humanoid Robot
System Performance
Robot
Robots
Music
Acoustic waves
Dynamic Control
Anthropomorphic robots
Dynamic Systems
Musical instruments
Control systems
Control System
Physical Model
Air
Motion
Sound

Keywords

  • Entertainment robotics
  • human-centered robotics
  • humanoid robots

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Human-Computer Interaction
  • Biomedical Engineering
  • Mechanical Engineering
  • Control and Optimization
  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Cite this

Development of performance system with musical dynamics expression on humanoid saxophonist robot. / Lin, Jia Yeu; Kawai, Mao; Nishio, Yuya; Cosentino, Sarah; Takanishi, Atsuo.

In: IEEE Robotics and Automation Letters, Vol. 4, No. 2, 8633975, 01.04.2019, p. 1684-1690.

Research output: Contribution to journalArticle

@article{4259c9b7bf93406e879f7ffafd5725ab,
title = "Development of performance system with musical dynamics expression on humanoid saxophonist robot",
abstract = "Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.",
keywords = "Entertainment robotics, human-centered robotics, humanoid robots",
author = "Lin, {Jia Yeu} and Mao Kawai and Yuya Nishio and Sarah Cosentino and Atsuo Takanishi",
year = "2019",
month = "4",
day = "1",
doi = "10.1109/LRA.2019.2897372",
language = "English",
volume = "4",
pages = "1684--1690",
journal = "IEEE Robotics and Automation Letters",
issn = "2377-3766",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Development of performance system with musical dynamics expression on humanoid saxophonist robot

AU - Lin, Jia Yeu

AU - Kawai, Mao

AU - Nishio, Yuya

AU - Cosentino, Sarah

AU - Takanishi, Atsuo

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.

AB - Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.

KW - Entertainment robotics

KW - human-centered robotics

KW - humanoid robots

UR - http://www.scopus.com/inward/record.url?scp=85063311423&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063311423&partnerID=8YFLogxK

U2 - 10.1109/LRA.2019.2897372

DO - 10.1109/LRA.2019.2897372

M3 - Article

AN - SCOPUS:85063311423

VL - 4

SP - 1684

EP - 1690

JO - IEEE Robotics and Automation Letters

JF - IEEE Robotics and Automation Letters

SN - 2377-3766

IS - 2

M1 - 8633975

ER -