Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music

Takuma Otsuka, Takeshi Mizumoto, Kazuhiro Nakadai, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages102-112
Number of pages11
Volume6096 LNAI
EditionPART 1
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010 - Cordoba
Duration: 2010 Jun 12010 Jun 4

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume6096 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010
CityCordoba
Period10/6/110/6/4

Fingerprint

Music
Ensemble
Robot
Robots
Human Performance
Beat
Acoustic waves
Fluctuations
Feedforward Control
Feedforward control
Independent component analysis
Independent Component Analysis
Microphones
Experimental Results
Sound
Human

Keywords

  • Beat tracking
  • Music robot
  • Musical human-robot interaction
  • Theremin

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Otsuka, T., Mizumoto, T., Nakadai, K., Takahashi, T., Komatani, K., Ogata, T., & Okuno, H. G. (2010). Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 1 ed., Vol. 6096 LNAI, pp. 102-112). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6096 LNAI, No. PART 1). https://doi.org/10.1007/978-3-642-13022-9_11

Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. / Otsuka, Takuma; Mizumoto, Takeshi; Nakadai, Kazuhiro; Takahashi, Toru; Komatani, Kazunori; Ogata, Tetsuya; Okuno, Hiroshi G.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6096 LNAI PART 1. ed. 2010. p. 102-112 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6096 LNAI, No. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Otsuka, T, Mizumoto, T, Nakadai, K, Takahashi, T, Komatani, K, Ogata, T & Okuno, HG 2010, Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 edn, vol. 6096 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 6096 LNAI, pp. 102-112, 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010, Cordoba, 10/6/1. https://doi.org/10.1007/978-3-642-13022-9_11
Otsuka T, Mizumoto T, Nakadai K, Takahashi T, Komatani K, Ogata T et al. Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 ed. Vol. 6096 LNAI. 2010. p. 102-112. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). https://doi.org/10.1007/978-3-642-13022-9_11
Otsuka, Takuma ; Mizumoto, Takeshi ; Nakadai, Kazuhiro ; Takahashi, Toru ; Komatani, Kazunori ; Ogata, Tetsuya ; Okuno, Hiroshi G. / Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6096 LNAI PART 1. ed. 2010. pp. 102-112 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).
@inproceedings{16eefe82b6624ab8969cbcbf37cd1e15,
title = "Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music",
abstract = "Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.",
keywords = "Beat tracking, Music robot, Musical human-robot interaction, Theremin",
author = "Takuma Otsuka and Takeshi Mizumoto and Kazuhiro Nakadai and Toru Takahashi and Kazunori Komatani and Tetsuya Ogata and Okuno, {Hiroshi G.}",
year = "2010",
doi = "10.1007/978-3-642-13022-9_11",
language = "English",
isbn = "3642130216",
volume = "6096 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 1",
pages = "102--112",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 1",

}

TY - GEN

T1 - Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music

AU - Otsuka, Takuma

AU - Mizumoto, Takeshi

AU - Nakadai, Kazuhiro

AU - Takahashi, Toru

AU - Komatani, Kazunori

AU - Ogata, Tetsuya

AU - Okuno, Hiroshi G.

PY - 2010

Y1 - 2010

N2 - Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.

AB - Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.

KW - Beat tracking

KW - Music robot

KW - Musical human-robot interaction

KW - Theremin

UR - http://www.scopus.com/inward/record.url?scp=79551525401&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79551525401&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-13022-9_11

DO - 10.1007/978-3-642-13022-9_11

M3 - Conference contribution

SN - 3642130216

SN - 9783642130212

VL - 6096 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 102

EP - 112

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -