3D Auditory Scene Visualizer with face tracking: Design and implementation for auditory awareness compensation

Yuji Kubota*, Shun Shiramatsu, Masatoshi Yoshida, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

*この研究の対応する著者

研究成果: Conference contribution

3 被引用数 (Scopus)

抄録

This paper presents the design and implementation of 3D Auditory Scene Visualizer based on the visual information seeking mantra, "overview first, zoom and filter, then details on demand". The machine audition system called HARK captures 3D sounds with a microphone array. The natural language processing called SalienceGraph visualizes topic transition by using discourse salience. The 3D visualizer implemented in Java 3D displays topic transition and each sound stream as a beam originating from the microphones (overview mode), shows temporal snapshots with/without specifying focusing areas (zoom-andfilter mode), and shows detailed information about a particular sound stream (details-on-demand mode). This threemode visualization will give the user auditory awareness enhanced by HARK and SalienceGraph. In addition, a facetracking system automatically determines the user's intention by tracking the user's face. The resulting system will enable users to manage and browse auditory scene files effectively, so it should acceleration and support the information explosion to compensate the lack of auditory awareness.

本文言語English
ホスト出版物のタイトルProceedings of the 2nd International Symposium on Universal Communication, ISUC 2008
ページ42-49
ページ数8
DOI
出版ステータスPublished - 2008 12月 1
外部発表はい
イベント2nd International Symposium on Universal Communication, ISUC 2008 - Osaka, Japan
継続期間: 2008 12月 152008 12月 16

出版物シリーズ

名前Proceedings of the 2nd International Symposium on Universal Communication, ISUC 2008

Conference

Conference2nd International Symposium on Universal Communication, ISUC 2008
国/地域Japan
CityOsaka
Period08/12/1508/12/16

ASJC Scopus subject areas

  • 人工知能
  • コンピュータ サイエンスの応用
  • 情報システム
  • ソフトウェア

フィンガープリント

「3D Auditory Scene Visualizer with face tracking: Design and implementation for auditory awareness compensation」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル