Interfacing sound stream segregation to automatic speech recognition - preliminary results on listening to several sounds simultaneously

Hiroshi G. Okuno, Tomohiro Nakatani, Takeshi Kawabata

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper reports the preliminary results of experiments on listening to several sounds at once. Two issues are addressed: segregating speech streams from a mixture of sounds, and interfacing speech stream segregation with automatic speech recognition (ASR). Speech stream segregation (SSS) is modeled as a process of extracting harmonic fragments, grouping these extracted harmonic fragments, and substituting some sounds for non-harmonic parts of groups. This system is implemented by extending the harmonic-based stream segregation system reported at AAAI-94 and IJCAI-95. The main problem in interfacing SSS with HMM-based ASR is how to improve the recognition performance which is degraded by spectral distortion of segregated sounds caused mainly by the binaural input, grouping, and residue substitution. Our solution is to re-train the parameters of the HMM with training data binauralized for four directions, to group harmonic fragments according to their directions, and to substitute the residue of harmonic fragments for non-harmonic parts of each group. Experiments with 500 mixtures of two women's utterances of a word showed that the cumulative accuracy of word recognition up to the 10th candidate of each woman's utterance is, on average, 75%.

Original languageEnglish
Title of host publicationProceedings of the National Conference on Artificial Intelligence
Editors Anon
Place of PublicationMenlo Park, CA, United States
PublisherAAAI
Pages1082-1089
Number of pages8
Volume2
Publication statusPublished - 1996
Externally publishedYes
EventProceedings of the 1996 13th National Conference on Artificial Intelligence. Part 2 (of 2) - Portland, OR, USA
Duration: 1996 Aug 41996 Aug 8

Other

OtherProceedings of the 1996 13th National Conference on Artificial Intelligence. Part 2 (of 2)
CityPortland, OR, USA
Period96/8/496/8/8

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Interfacing sound stream segregation to automatic speech recognition - preliminary results on listening to several sounds simultaneously'. Together they form a unique fingerprint.

  • Cite this

    Okuno, H. G., Nakatani, T., & Kawabata, T. (1996). Interfacing sound stream segregation to automatic speech recognition - preliminary results on listening to several sounds simultaneously. In Anon (Ed.), Proceedings of the National Conference on Artificial Intelligence (Vol. 2, pp. 1082-1089). AAAI.