Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech

Shun'ichi Yamamoto, Kazuhiro Nakadai, Mikio Nakano, Hiroshi Tsujino, Jean Marc Valin, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Contribution to conferencePaper

20 Citations (Scopus)

Abstract

This paper addresses robot audition that can cope with speech that has a low signal-to-noise ratio (SNR) in real time by using robot-embedded microphones. To cope with such a noise, we exploited two key ideas; Preprocessing consisting of sound source localization and separation with a microphone array, and system integration based on missing feature theory (MFT). Preprocessing improves the SNR of a target sound signal using geometric source separation with multichannel post-filter. MFT uses only reliable acoustic features in speech recognition and masks unreliable parts caused by errors in preprocessing. MFT thus provides smooth integration between preprocessing and automatic speech recognition. A real-time robot audition system based on these two key ideas is constructed for Honda ASIMO and Humanoid SIG2 with 8-ch microphone arrays. The paper also reports the improvement of ASR performance by using two and three simultaneous speech signals.

Original languageEnglish
Pages111-116
Number of pages6
Publication statusPublished - 2007 Dec 1
Externally publishedYes
Event2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007 - Kyoto, Japan
Duration: 2007 Dec 92007 Dec 13

Conference

Conference2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007
CountryJapan
CityKyoto
Period07/12/907/12/13

Keywords

  • Automatic speech recognition
  • Geometric source separation
  • Missing feature theory
  • Robot audition

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech'. Together they form a unique fingerprint.

  • Cite this

    Yamamoto, S., Nakadai, K., Nakano, M., Tsujino, H., Valin, J. M., Komatani, K., Ogata, T., & Okuno, H. G. (2007). Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech. 111-116. Paper presented at 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Kyoto, Japan.