Live assessment of beat tracking for robot audition

Joao Lobato Oliveira, Gökhan Ince, Keisuke Nakamura, Kazuhiro Nakadai, Hiroshi G. Okuno, Luis Paulo Reis, Fabien Gouyon

研究成果: Conference contribution

8 引用 (Scopus)

抜粋

In this paper we propose the integration of an online audio beat tracking system into the general framework of robot audition, to enable its application in musically-interactive robotic scenarios. To this purpose, we introduced a staterecovery mechanism into our beat tracking algorithm, for handling continuous musical stimuli, and applied different multi-channel preprocessing algorithms (e.g., beamforming, ego noise suppression) to enhance noisy auditory signals lively captured in a real environment. We assessed and compared the robustness of our audio beat tracker through a set of experimental setups, under different live acoustic conditions of incremental complexity. These included the presence of continuous musical stimuli, built of a set of concatenated musical pieces; the presence of noises of different natures (e.g., robot motion, speech); and the simultaneous processing of different audio sources on-the-fly, for music and speech. We successfully tackled all these challenging acoustic conditions and improved the beat tracking accuracy and reaction time to music transitions while simultaneously achieving robust automatic speech recognition.

元の言語English
ホスト出版物のタイトルIEEE International Conference on Intelligent Robots and Systems
ページ992-997
ページ数6
DOI
出版物ステータスPublished - 2012
外部発表Yes
イベント25th IEEE/RSJ International Conference on Robotics and Intelligent Systems, IROS 2012 - Vilamoura, Algarve
継続期間: 2012 10 72012 10 12

Other

Other25th IEEE/RSJ International Conference on Robotics and Intelligent Systems, IROS 2012
Vilamoura, Algarve
期間12/10/712/10/12

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

フィンガープリント Live assessment of beat tracking for robot audition' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Oliveira, J. L., Ince, G., Nakamura, K., Nakadai, K., Okuno, H. G., Reis, L. P., & Gouyon, F. (2012). Live assessment of beat tracking for robot audition. : IEEE International Conference on Intelligent Robots and Systems (pp. 992-997). [6386100] https://doi.org/10.1109/IROS.2012.6386100