Three-dimensional sound source localization using microphone array and its display with mixed reality technology

Tsubasa Kusano, Yasuhide Matsumoto, Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa, Kenichi Yoshida, Yoshimi Kitazumi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Visualization of sound information has many interests for understanding sound fields. Especially, sound source localization using a microphone array is helpful for sound source separations, acoustical design, abnormality detection, etc. However, three-dimensional (3D) sound source localization result is difficult to present intuitively on ordinary displays. On the other hand, in recent years, mixed reality (MR) technology has rapidly developed and attracts many attentions. MR devices install many sensors, displays, and ICT technologies, which realize interaction between real environment and virtual spaces. In this paper, we propose an MR display system for 3D sound source localization results, which are obtained from a microphone array data. MR technology enables presentation of 3D sound source localization results which is difficult for ordinary displays. In addition, the user can observe both 3D sound source localization results and the environment simultaneously.

Original languageEnglish
Title of host publicationINTER-NOISE 2019 MADRID - 48th International Congress and Exhibition on Noise Control Engineering
EditorsAntonio Calvo-Manzano, Ana Delgado, Antonio Perez-Lopez, Jose Salvador Santiago
PublisherSOCIEDAD ESPANOLA DE ACUSTICA - Spanish Acoustical Society, SEA
ISBN (Electronic)9788487985317
Publication statusPublished - 2019
Event48th International Congress and Exhibition on Noise Control Engineering, INTER-NOISE 2019 MADRID - Madrid, Spain
Duration: 2019 Jun 162019 Jun 19

Publication series

NameINTER-NOISE 2019 MADRID - 48th International Congress and Exhibition on Noise Control Engineering

Conference

Conference48th International Congress and Exhibition on Noise Control Engineering, INTER-NOISE 2019 MADRID
CountrySpain
CityMadrid
Period19/6/1619/6/19

Keywords

  • Acoustic imaging
  • Beamforming
  • See-through head mounted display
  • Simultaneous localization and mapping (SLAM)

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Fingerprint Dive into the research topics of 'Three-dimensional sound source localization using microphone array and its display with mixed reality technology'. Together they form a unique fingerprint.

  • Cite this

    Kusano, T., Matsumoto, Y., Kataoka, Y., Teraoka, W., Oikawa, Y., Yoshida, K., & Kitazumi, Y. (2019). Three-dimensional sound source localization using microphone array and its display with mixed reality technology. In A. Calvo-Manzano, A. Delgado, A. Perez-Lopez, & J. S. Santiago (Eds.), INTER-NOISE 2019 MADRID - 48th International Congress and Exhibition on Noise Control Engineering (INTER-NOISE 2019 MADRID - 48th International Congress and Exhibition on Noise Control Engineering). SOCIEDAD ESPANOLA DE ACUSTICA - Spanish Acoustical Society, SEA.