Development of performance system with musical dynamics expression on humanoid saxophonist robot

Jia Yeu Lin, Mao Kawai, Yuya Nishio, Sarah Cosentino, Atsuo Takanishi

研究成果: Article

抄録

Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.

元の言語English
記事番号8633975
ページ(範囲)1684-1690
ページ数7
ジャーナルIEEE Robotics and Automation Letters
4
発行部数2
DOI
出版物ステータスPublished - 2019 4 1

Fingerprint

Humanoid Robot
System Performance
Robot
Robots
Music
Acoustic waves
Dynamic Control
Anthropomorphic robots
Dynamic Systems
Musical instruments
Control systems
Control System
Physical Model
Air
Motion
Sound

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Human-Computer Interaction
  • Biomedical Engineering
  • Mechanical Engineering
  • Control and Optimization
  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

これを引用

Development of performance system with musical dynamics expression on humanoid saxophonist robot. / Lin, Jia Yeu; Kawai, Mao; Nishio, Yuya; Cosentino, Sarah; Takanishi, Atsuo.

:: IEEE Robotics and Automation Letters, 巻 4, 番号 2, 8633975, 01.04.2019, p. 1684-1690.

研究成果: Article

@article{4259c9b7bf93406e879f7ffafd5725ab,
title = "Development of performance system with musical dynamics expression on humanoid saxophonist robot",
abstract = "Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.",
keywords = "Entertainment robotics, human-centered robotics, humanoid robots",
author = "Lin, {Jia Yeu} and Mao Kawai and Yuya Nishio and Sarah Cosentino and Atsuo Takanishi",
year = "2019",
month = "4",
day = "1",
doi = "10.1109/LRA.2019.2897372",
language = "English",
volume = "4",
pages = "1684--1690",
journal = "IEEE Robotics and Automation Letters",
issn = "2377-3766",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Development of performance system with musical dynamics expression on humanoid saxophonist robot

AU - Lin, Jia Yeu

AU - Kawai, Mao

AU - Nishio, Yuya

AU - Cosentino, Sarah

AU - Takanishi, Atsuo

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.

AB - Talented musicians can deliver a powerful emotional experience to the audience by skillfully modifying several musical parameters, such as dynamics, articulation, and tempo. Musical robots are expected to control those musical parameters in the same way to give the audience an experience comparable to listening to a professional human musician. But practical control of those parameters depends on the type of musical instrument being played. In this study, we describe our newly developed music dynamics control system for the Waseda Anthropomorphic Saxophonist robot. We first built a physical model for the saxophone reed motion and verified the dynamics-related parameters of the overall robot-saxophone system. We found that the magnitude of air flow is related to the sound pressure level, as expected, but also that the lower lip is critical to the sound stability. Accordingly, we then implemented a music dynamics control system for the robot and succeeded in enabling the robot to perform a music piece with different sound pressure levels.

KW - Entertainment robotics

KW - human-centered robotics

KW - humanoid robots

UR - http://www.scopus.com/inward/record.url?scp=85063311423&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063311423&partnerID=8YFLogxK

U2 - 10.1109/LRA.2019.2897372

DO - 10.1109/LRA.2019.2897372

M3 - Article

AN - SCOPUS:85063311423

VL - 4

SP - 1684

EP - 1690

JO - IEEE Robotics and Automation Letters

JF - IEEE Robotics and Automation Letters

SN - 2377-3766

IS - 2

M1 - 8633975

ER -