Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array

Takahiro Iyama, Osamu Sugiyama, Takuma Otsuka, Katsutoshi Itoyama, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

We have developed a system for visualizing auditory awareness on the basis of sound source locations estimated using a depth sensor and microphone array. Previous studies on visualizing the acoustic environment viewed the level of sound pressures directly on the captured image, so the visualization was often based on a mixture of several sound sources. As a result, which targets to focus on was not intuitive. To help users selectively to find the targets and focus on the target analysis, we should extract the captured acoustic information and selectively propose it with the user demand. We have designed a three-layer visualization model for auditory awareness consisting of a sound source distribution layer, a sound location layer, and a sound saliency layer. The model extracts acoustic information by using the depth image and multi-directional sound sources captured with a depth sensor and microphone array. This model is used in the system we developed for visualizing auditory awareness.

Original languageEnglish
Title of host publicationIEEE International Conference on Intelligent Robots and Systems
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1908-1913
Number of pages6
ISBN (Print)9781479969340
DOIs
Publication statusPublished - 2014 Oct 31
Externally publishedYes
Event2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014 - Chicago
Duration: 2014 Sep 142014 Sep 18

Other

Other2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014
CityChicago
Period14/9/1414/9/18

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array'. Together they form a unique fingerprint.

  • Cite this

    Iyama, T., Sugiyama, O., Otsuka, T., Itoyama, K., & Okuno, H. G. (2014). Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array. In IEEE International Conference on Intelligent Robots and Systems (pp. 1908-1913). [6942814] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IROS.2014.6942814