A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing

Kazumasa Murata, Kazuhiro Nakadai, Kazuyoshi Yoshii, Ryu Takeda, Toyotaka Torii, Hiroshi G. Okuno, Yuji Hasegawa, Hiroshi Tsujino

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Citations (Scopus)

Abstract

Musical beat tracking is one of the effective technologies for human-robot interaction such as musical sessions. Since such interaction should be performed in various environments in a natural way, musical beat tracking for a robot should cope with noise sources such as environmental noise, its own motor noises, and self voices, by using its own microphone. This paper addresses a musical beat tracking robot which can step, scat and sing according to musical beats by using its own microphone. To realize such a robot, we propose a robust beat tracking method by introducing two key techniques, that is, spectro-temporal pattern matching and echo cancellation. The former realizes robust tempo estimation with a shorter window length, thus, it can quickly adapt to tempo changes. The latter is effective to cancel self noises such as stepping, scatting, and singing. We implemented the proposed beat tracking method for Honda ASIMO. Experimental results showed ten times faster adaptation to tempo changes and high robustness in beat tracking for stepping, scatting and singing noises. We also demonstrated the robot times its steps while scatting or singing to musical beats.

Original languageEnglish
Title of host publication2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
Pages2459-2464
Number of pages6
DOIs
Publication statusPublished - 2008
Externally publishedYes
Event2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS - Nice
Duration: 2008 Sep 222008 Sep 26

Other

Other2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
CityNice
Period08/9/2208/9/26

Fingerprint

Microphones
Robots
Echo suppression
Human robot interaction
Pattern matching

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Murata, K., Nakadai, K., Yoshii, K., Takeda, R., Torii, T., Okuno, H. G., ... Tsujino, H. (2008). A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS (pp. 2459-2464). [4650596] https://doi.org/10.1109/IROS.2008.4650596

A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing. / Murata, Kazumasa; Nakadai, Kazuhiro; Yoshii, Kazuyoshi; Takeda, Ryu; Torii, Toyotaka; Okuno, Hiroshi G.; Hasegawa, Yuji; Tsujino, Hiroshi.

2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS. 2008. p. 2459-2464 4650596.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Murata, K, Nakadai, K, Yoshii, K, Takeda, R, Torii, T, Okuno, HG, Hasegawa, Y & Tsujino, H 2008, A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing. in 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS., 4650596, pp. 2459-2464, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, Nice, 08/9/22. https://doi.org/10.1109/IROS.2008.4650596
Murata K, Nakadai K, Yoshii K, Takeda R, Torii T, Okuno HG et al. A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS. 2008. p. 2459-2464. 4650596 https://doi.org/10.1109/IROS.2008.4650596
Murata, Kazumasa ; Nakadai, Kazuhiro ; Yoshii, Kazuyoshi ; Takeda, Ryu ; Torii, Toyotaka ; Okuno, Hiroshi G. ; Hasegawa, Yuji ; Tsujino, Hiroshi. / A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing. 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS. 2008. pp. 2459-2464
@inproceedings{0e625cd9d7624045bff1d89f9f7d45c5,
title = "A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing",
abstract = "Musical beat tracking is one of the effective technologies for human-robot interaction such as musical sessions. Since such interaction should be performed in various environments in a natural way, musical beat tracking for a robot should cope with noise sources such as environmental noise, its own motor noises, and self voices, by using its own microphone. This paper addresses a musical beat tracking robot which can step, scat and sing according to musical beats by using its own microphone. To realize such a robot, we propose a robust beat tracking method by introducing two key techniques, that is, spectro-temporal pattern matching and echo cancellation. The former realizes robust tempo estimation with a shorter window length, thus, it can quickly adapt to tempo changes. The latter is effective to cancel self noises such as stepping, scatting, and singing. We implemented the proposed beat tracking method for Honda ASIMO. Experimental results showed ten times faster adaptation to tempo changes and high robustness in beat tracking for stepping, scatting and singing noises. We also demonstrated the robot times its steps while scatting or singing to musical beats.",
author = "Kazumasa Murata and Kazuhiro Nakadai and Kazuyoshi Yoshii and Ryu Takeda and Toyotaka Torii and Okuno, {Hiroshi G.} and Yuji Hasegawa and Hiroshi Tsujino",
year = "2008",
doi = "10.1109/IROS.2008.4650596",
language = "English",
isbn = "9781424420582",
pages = "2459--2464",
booktitle = "2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS",

}

TY - GEN

T1 - A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing

AU - Murata, Kazumasa

AU - Nakadai, Kazuhiro

AU - Yoshii, Kazuyoshi

AU - Takeda, Ryu

AU - Torii, Toyotaka

AU - Okuno, Hiroshi G.

AU - Hasegawa, Yuji

AU - Tsujino, Hiroshi

PY - 2008

Y1 - 2008

N2 - Musical beat tracking is one of the effective technologies for human-robot interaction such as musical sessions. Since such interaction should be performed in various environments in a natural way, musical beat tracking for a robot should cope with noise sources such as environmental noise, its own motor noises, and self voices, by using its own microphone. This paper addresses a musical beat tracking robot which can step, scat and sing according to musical beats by using its own microphone. To realize such a robot, we propose a robust beat tracking method by introducing two key techniques, that is, spectro-temporal pattern matching and echo cancellation. The former realizes robust tempo estimation with a shorter window length, thus, it can quickly adapt to tempo changes. The latter is effective to cancel self noises such as stepping, scatting, and singing. We implemented the proposed beat tracking method for Honda ASIMO. Experimental results showed ten times faster adaptation to tempo changes and high robustness in beat tracking for stepping, scatting and singing noises. We also demonstrated the robot times its steps while scatting or singing to musical beats.

AB - Musical beat tracking is one of the effective technologies for human-robot interaction such as musical sessions. Since such interaction should be performed in various environments in a natural way, musical beat tracking for a robot should cope with noise sources such as environmental noise, its own motor noises, and self voices, by using its own microphone. This paper addresses a musical beat tracking robot which can step, scat and sing according to musical beats by using its own microphone. To realize such a robot, we propose a robust beat tracking method by introducing two key techniques, that is, spectro-temporal pattern matching and echo cancellation. The former realizes robust tempo estimation with a shorter window length, thus, it can quickly adapt to tempo changes. The latter is effective to cancel self noises such as stepping, scatting, and singing. We implemented the proposed beat tracking method for Honda ASIMO. Experimental results showed ten times faster adaptation to tempo changes and high robustness in beat tracking for stepping, scatting and singing noises. We also demonstrated the robot times its steps while scatting or singing to musical beats.

UR - http://www.scopus.com/inward/record.url?scp=69549136010&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=69549136010&partnerID=8YFLogxK

U2 - 10.1109/IROS.2008.4650596

DO - 10.1109/IROS.2008.4650596

M3 - Conference contribution

SN - 9781424420582

SP - 2459

EP - 2464

BT - 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS

ER -