Abstract
Robot capability of hearing sounds, in particular, a mixture of sounds, by its own microphones, that is, robot audition, is important in improving human robot interaction. This paper presents the robot audition open-source software, called "HARK" (HRI-JP Audition for Robots with Kyoto University), which consists of primitive functions in computational auditory scene analysis; sound source localization, separation, and recognition of separated sounds. Since separated sounds suffer from spectral distortion due to separation, the HARK generates a time-spectral map of reliability, called "missing feature mask", for features of separated sounds. Then separated sounds are recognized by the Missing-Feature Theory (MFT) based ASR with missing feature masks. The HARK is implemented on the middleware called "FlowDesigner" to share intermediate audio data, which enables near real-time processing.
Original language | English |
---|---|
Title of host publication | 2008 Hands-free Speech Communication and Microphone Arrays, Proceedings, HSCMA 2008 |
Pages | 124-127 |
Number of pages | 4 |
DOIs | |
Publication status | Published - 2008 |
Externally published | Yes |
Event | 2008 Hands-free Speech Communication and Microphone Arrays, HSCMA 2008 - Trento Duration: 2008 May 6 → 2008 May 8 |
Other
Other | 2008 Hands-free Speech Communication and Microphone Arrays, HSCMA 2008 |
---|---|
City | Trento |
Period | 08/5/6 → 08/5/8 |
Keywords
- Computational auditory scene analysis
- Missing feature theory
- Robot audition
- Simultaneous speakers
ASJC Scopus subject areas
- Hardware and Architecture
- Electrical and Electronic Engineering
- Communication