Computational auditory scene analysis and its application to robot audition

Hiroshi G. Okuno, Kazuhiro Nakadai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

Robot capability of hearing sounds, in particular, a mixture of sounds, by its own microphones, that is, robot audition, is important in improving human robot interaction. This paper presents the robot audition open-source software, called "HARK" (HRI-JP Audition for Robots with Kyoto University), which consists of primitive functions in computational auditory scene analysis; sound source localization, separation, and recognition of separated sounds. Since separated sounds suffer from spectral distortion due to separation, the HARK generates a time-spectral map of reliability, called "missing feature mask", for features of separated sounds. Then separated sounds are recognized by the Missing-Feature Theory (MFT) based ASR with missing feature masks. The HARK is implemented on the middleware called "FlowDesigner" to share intermediate audio data, which enables near real-time processing.

Original languageEnglish
Title of host publication2008 Hands-free Speech Communication and Microphone Arrays, Proceedings, HSCMA 2008
Pages124-127
Number of pages4
DOIs
Publication statusPublished - 2008
Externally publishedYes
Event2008 Hands-free Speech Communication and Microphone Arrays, HSCMA 2008 - Trento
Duration: 2008 May 62008 May 8

Other

Other2008 Hands-free Speech Communication and Microphone Arrays, HSCMA 2008
CityTrento
Period08/5/608/5/8

Keywords

  • Computational auditory scene analysis
  • Missing feature theory
  • Robot audition
  • Simultaneous speakers

ASJC Scopus subject areas

  • Hardware and Architecture
  • Electrical and Electronic Engineering
  • Communication

Fingerprint Dive into the research topics of 'Computational auditory scene analysis and its application to robot audition'. Together they form a unique fingerprint.

  • Cite this

    Okuno, H. G., & Nakadai, K. (2008). Computational auditory scene analysis and its application to robot audition. In 2008 Hands-free Speech Communication and Microphone Arrays, Proceedings, HSCMA 2008 (pp. 124-127). [4538702] https://doi.org/10.1109/HSCMA.2008.4538702