Live assessment of beat tracking for robot audition

Joao Lobato Oliveira, Gökhan Ince, Keisuke Nakamura, Kazuhiro Nakadai, Hiroshi G. Okuno, Luis Paulo Reis, Fabien Gouyon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

In this paper we propose the integration of an online audio beat tracking system into the general framework of robot audition, to enable its application in musically-interactive robotic scenarios. To this purpose, we introduced a staterecovery mechanism into our beat tracking algorithm, for handling continuous musical stimuli, and applied different multi-channel preprocessing algorithms (e.g., beamforming, ego noise suppression) to enhance noisy auditory signals lively captured in a real environment. We assessed and compared the robustness of our audio beat tracker through a set of experimental setups, under different live acoustic conditions of incremental complexity. These included the presence of continuous musical stimuli, built of a set of concatenated musical pieces; the presence of noises of different natures (e.g., robot motion, speech); and the simultaneous processing of different audio sources on-the-fly, for music and speech. We successfully tackled all these challenging acoustic conditions and improved the beat tracking accuracy and reaction time to music transitions while simultaneously achieving robust automatic speech recognition.

Original languageEnglish
Title of host publicationIEEE International Conference on Intelligent Robots and Systems
Pages992-997
Number of pages6
DOIs
Publication statusPublished - 2012
Externally publishedYes
Event25th IEEE/RSJ International Conference on Robotics and Intelligent Systems, IROS 2012 - Vilamoura, Algarve
Duration: 2012 Oct 72012 Oct 12

Other

Other25th IEEE/RSJ International Conference on Robotics and Intelligent Systems, IROS 2012
CityVilamoura, Algarve
Period12/10/712/10/12

Fingerprint

Audition
Acoustics
Robots
Beamforming
Speech recognition
Robotics
Processing

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

Oliveira, J. L., Ince, G., Nakamura, K., Nakadai, K., Okuno, H. G., Reis, L. P., & Gouyon, F. (2012). Live assessment of beat tracking for robot audition. In IEEE International Conference on Intelligent Robots and Systems (pp. 992-997). [6386100] https://doi.org/10.1109/IROS.2012.6386100

Live assessment of beat tracking for robot audition. / Oliveira, Joao Lobato; Ince, Gökhan; Nakamura, Keisuke; Nakadai, Kazuhiro; Okuno, Hiroshi G.; Reis, Luis Paulo; Gouyon, Fabien.

IEEE International Conference on Intelligent Robots and Systems. 2012. p. 992-997 6386100.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Oliveira, JL, Ince, G, Nakamura, K, Nakadai, K, Okuno, HG, Reis, LP & Gouyon, F 2012, Live assessment of beat tracking for robot audition. in IEEE International Conference on Intelligent Robots and Systems., 6386100, pp. 992-997, 25th IEEE/RSJ International Conference on Robotics and Intelligent Systems, IROS 2012, Vilamoura, Algarve, 12/10/7. https://doi.org/10.1109/IROS.2012.6386100
Oliveira JL, Ince G, Nakamura K, Nakadai K, Okuno HG, Reis LP et al. Live assessment of beat tracking for robot audition. In IEEE International Conference on Intelligent Robots and Systems. 2012. p. 992-997. 6386100 https://doi.org/10.1109/IROS.2012.6386100
Oliveira, Joao Lobato ; Ince, Gökhan ; Nakamura, Keisuke ; Nakadai, Kazuhiro ; Okuno, Hiroshi G. ; Reis, Luis Paulo ; Gouyon, Fabien. / Live assessment of beat tracking for robot audition. IEEE International Conference on Intelligent Robots and Systems. 2012. pp. 992-997
@inproceedings{c2f132b107074947b91527b6a93e746f,
title = "Live assessment of beat tracking for robot audition",
abstract = "In this paper we propose the integration of an online audio beat tracking system into the general framework of robot audition, to enable its application in musically-interactive robotic scenarios. To this purpose, we introduced a staterecovery mechanism into our beat tracking algorithm, for handling continuous musical stimuli, and applied different multi-channel preprocessing algorithms (e.g., beamforming, ego noise suppression) to enhance noisy auditory signals lively captured in a real environment. We assessed and compared the robustness of our audio beat tracker through a set of experimental setups, under different live acoustic conditions of incremental complexity. These included the presence of continuous musical stimuli, built of a set of concatenated musical pieces; the presence of noises of different natures (e.g., robot motion, speech); and the simultaneous processing of different audio sources on-the-fly, for music and speech. We successfully tackled all these challenging acoustic conditions and improved the beat tracking accuracy and reaction time to music transitions while simultaneously achieving robust automatic speech recognition.",
author = "Oliveira, {Joao Lobato} and G{\"o}khan Ince and Keisuke Nakamura and Kazuhiro Nakadai and Okuno, {Hiroshi G.} and Reis, {Luis Paulo} and Fabien Gouyon",
year = "2012",
doi = "10.1109/IROS.2012.6386100",
language = "English",
isbn = "9781467317375",
pages = "992--997",
booktitle = "IEEE International Conference on Intelligent Robots and Systems",

}

TY - GEN

T1 - Live assessment of beat tracking for robot audition

AU - Oliveira, Joao Lobato

AU - Ince, Gökhan

AU - Nakamura, Keisuke

AU - Nakadai, Kazuhiro

AU - Okuno, Hiroshi G.

AU - Reis, Luis Paulo

AU - Gouyon, Fabien

PY - 2012

Y1 - 2012

N2 - In this paper we propose the integration of an online audio beat tracking system into the general framework of robot audition, to enable its application in musically-interactive robotic scenarios. To this purpose, we introduced a staterecovery mechanism into our beat tracking algorithm, for handling continuous musical stimuli, and applied different multi-channel preprocessing algorithms (e.g., beamforming, ego noise suppression) to enhance noisy auditory signals lively captured in a real environment. We assessed and compared the robustness of our audio beat tracker through a set of experimental setups, under different live acoustic conditions of incremental complexity. These included the presence of continuous musical stimuli, built of a set of concatenated musical pieces; the presence of noises of different natures (e.g., robot motion, speech); and the simultaneous processing of different audio sources on-the-fly, for music and speech. We successfully tackled all these challenging acoustic conditions and improved the beat tracking accuracy and reaction time to music transitions while simultaneously achieving robust automatic speech recognition.

AB - In this paper we propose the integration of an online audio beat tracking system into the general framework of robot audition, to enable its application in musically-interactive robotic scenarios. To this purpose, we introduced a staterecovery mechanism into our beat tracking algorithm, for handling continuous musical stimuli, and applied different multi-channel preprocessing algorithms (e.g., beamforming, ego noise suppression) to enhance noisy auditory signals lively captured in a real environment. We assessed and compared the robustness of our audio beat tracker through a set of experimental setups, under different live acoustic conditions of incremental complexity. These included the presence of continuous musical stimuli, built of a set of concatenated musical pieces; the presence of noises of different natures (e.g., robot motion, speech); and the simultaneous processing of different audio sources on-the-fly, for music and speech. We successfully tackled all these challenging acoustic conditions and improved the beat tracking accuracy and reaction time to music transitions while simultaneously achieving robust automatic speech recognition.

UR - http://www.scopus.com/inward/record.url?scp=84872314131&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872314131&partnerID=8YFLogxK

U2 - 10.1109/IROS.2012.6386100

DO - 10.1109/IROS.2012.6386100

M3 - Conference contribution

AN - SCOPUS:84872314131

SN - 9781467317375

SP - 992

EP - 997

BT - IEEE International Conference on Intelligent Robots and Systems

ER -