Abstract
Robot capability of hearing sounds, in particular, a mixture of sounds, by its own microphones, that is, robot audition, is important in improving human robot interaction. This paper presents the robot audition open-source software, called "HARK" (HRI-JP Audition for Robots with Kyoto University), which consists of primitive functions in computational auditory scene analysis; sound source localization, separation, and recognition of separated sounds. Since separated sounds suffer from spectral distortion due to separation, the HARK generates a time-spectral map of reliability, called "missing feature mask", for features of separated sounds. Then separated sounds are recognized by the Missing-Feature Theory (MFT) based ASR with missing feature masks. The HARK is implemented on the middleware called "FlowDesigner" to share intermediate audio data, which enables near real-time processing.
| Original language | English |
|---|---|
| Title of host publication | 2008 Hands-free Speech Communication and Microphone Arrays, Proceedings, HSCMA 2008 |
| Pages | 124-127 |
| Number of pages | 4 |
| DOIs | |
| Publication status | Published - 2008 |
| Externally published | Yes |
| Event | 2008 Hands-free Speech Communication and Microphone Arrays, HSCMA 2008 - Trento Duration: 2008 May 6 → 2008 May 8 |
Other
| Other | 2008 Hands-free Speech Communication and Microphone Arrays, HSCMA 2008 |
|---|---|
| City | Trento |
| Period | 08/5/6 → 08/5/8 |
Keywords
- Computational auditory scene analysis
- Missing feature theory
- Robot audition
- Simultaneous speakers
ASJC Scopus subject areas
- Hardware and Architecture
- Electrical and Electronic Engineering
- Communication