Robot audition from the viewpoint of computational auditory scene analysis

Hiroshi G. Okuno, Tetsuya Ogata, Kazunori Komatani

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

We have been engaged in research on computational auditory scene analysis to attain sophisticated robot/computer human interaction by manipulating real-world sound signals. The objective of our research is the understanding of an arbitrary sound mixture including music and environmental sounds as well as voiced speech, obtained by robot's ears (microphones) embedded on the robot. Three main issues in computational auditory scene analysis are sound source localization, separation, and recognition of separated sounds for a mixture of speech signals as well as polyphonic music signals. The Missing Feature Theory (MFT) approach integrates sound source separation and automatic speech recognition by generating missing feature masks. This robot audition system has been successfully ported to three kinds of robots, SIG2, Robovie R2 and Honda ASIMO. A robot recognizes three simultaneous speeches such as placing a meal order ora referee for RockPaper-Scissors Sound Games with a delay of less than 2 seconds. The real-time beat tracking system is also developed for robot audition. A robot hears music, understands and predicts its musical beats to behave in accordance with the beat times in real-time.

本文言語English
ホスト出版物のタイトルProceedings - International Conference on Informatics Education and Research for Knowledge-Circulating Society, ICKS 2008
ページ35-40
ページ数6
DOI
出版ステータスPublished - 2008 8 29
外部発表はい
イベントInternational Conference on Informatics Education and Research for Knowledge-Circulating Society, ICKS 2008 - Kyoto, Japan
継続期間: 2008 1 172008 1 17

出版物シリーズ

名前Proceedings - International Conference on Informatics Education and Research for Knowledge-Circulating Society, ICKS 2008

Other

OtherInternational Conference on Informatics Education and Research for Knowledge-Circulating Society, ICKS 2008
国/地域Japan
CityKyoto
Period08/1/1708/1/17

ASJC Scopus subject areas

  • 情報システム
  • 教育

フィンガープリント

「Robot audition from the viewpoint of computational auditory scene analysis」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル