Separating three simultaneous speeches with two microphones by integrating auditory and visual processing

Hiroshi G. Okuno, Kazuhiro Nakadai, Tino Lourens, Hiroaki Kitano

研究成果: Conference contribution

5 被引用数 (Scopus)

抄録

This paper addresses the problem of automatic recognition of three simultaneous speeches with two microphones, that is, that of sound source separation where the number of sound sources is greater than that of microphones. The approach used is the direction-pass filter, which is implemented by hypothetical reasoning on the interaural phase difference (IPD) and interaural intensity difference (IID). Auditory processing calculates IPD and IID for each subband, and generates hypotheses for precalculated IPD and IID for every direction including one obtained by visual processing. Then the system calculates the belief factor of hypothesis by Dempster-Shafer theory and determines the direction of each subband. Subbands of the specific direction are collected and then converted to a wave form by inverse FFT. With 200 benchmarks of three simultaneous utterances of Japanese words, the average 1-best and 10-best recognition rates of extracted speeches are 60% and 81%, respectively.

本文言語English
ホスト出版物のタイトルEUROSPEECH 2001 - SCANDINAVIA - 7th European Conference on Speech Communication and Technology
出版社International Speech Communication Association
ページ2643-2646
ページ数4
ISBN(電子版)8790834100, 9788790834104
出版ステータスPublished - 2001
外部発表はい
イベント7th European Conference on Speech Communication and Technology - Scandinavia, EUROSPEECH 2001 - Aalborg, Denmark
継続期間: 2001 9 32001 9 7

Other

Other7th European Conference on Speech Communication and Technology - Scandinavia, EUROSPEECH 2001
国/地域Denmark
CityAalborg
Period01/9/301/9/7

ASJC Scopus subject areas

  • 通信
  • 言語学および言語
  • コンピュータ サイエンスの応用
  • ソフトウェア

フィンガープリント

「Separating three simultaneous speeches with two microphones by integrating auditory and visual processing」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル