TY - GEN
T1 - Sound field projection sysem using optcal see-through head-mounted display
AU - Inoue, Atsuto
AU - Teraoka, Wataru
AU - Oikawa, Yasuhiro
AU - Satou, Takahiro
AU - Iwane, Yasuyuki
AU - Kobayashi, Masahito
N1 - Publisher Copyright:
© INTER-NOISE 2021 .All right reserved.
PY - 2021
Y1 - 2021
N2 - Sound field visalization is an effective technique to understand spatial sound information. For example, acoustical holography, optical methods, and beamforming have been proposed and studied. In recent years, mixed reality (MR) technology has advanced rapidly and is now more familiar. Many sensors, display devices, and ICT technologies have been implemented in MR equipment, which enable interactions between real and virtual worlds. In this paper, we propose an MR display system that displays the results obtained by the beamforming method. The system consists of a 16ch microphone array a real-time sound field visualization system and an optical see-through head-mounted display (OST-HMD). The real-time sound field visualization system analyzes sound signals recorded by the 16ch microphone array using the beamforming method. Processed sound pressure data are sent to the OST-HMD using a transmission control protocol (TCP), and a colormap is projected on the real world. The settings properties of a real-time sound field visualization system can be changed by using a virtual user interface (VI) and TCP. In addition, multiple users can experience the system by sharing sound pressures and settings property data. Using this system, users wearing an OST-HMD can observe the sound field information intuitvely.
AB - Sound field visalization is an effective technique to understand spatial sound information. For example, acoustical holography, optical methods, and beamforming have been proposed and studied. In recent years, mixed reality (MR) technology has advanced rapidly and is now more familiar. Many sensors, display devices, and ICT technologies have been implemented in MR equipment, which enable interactions between real and virtual worlds. In this paper, we propose an MR display system that displays the results obtained by the beamforming method. The system consists of a 16ch microphone array a real-time sound field visualization system and an optical see-through head-mounted display (OST-HMD). The real-time sound field visualization system analyzes sound signals recorded by the 16ch microphone array using the beamforming method. Processed sound pressure data are sent to the OST-HMD using a transmission control protocol (TCP), and a colormap is projected on the real world. The settings properties of a real-time sound field visualization system can be changed by using a virtual user interface (VI) and TCP. In addition, multiple users can experience the system by sharing sound pressures and settings property data. Using this system, users wearing an OST-HMD can observe the sound field information intuitvely.
UR - http://www.scopus.com/inward/record.url?scp=85117364360&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85117364360&partnerID=8YFLogxK
U2 - 10.3397/IN-2021-1797
DO - 10.3397/IN-2021-1797
M3 - Conference contribution
AN - SCOPUS:85117364360
T3 - Proceedings of INTER-NOISE 2021 - 2021 International Congress and Exposition of Noise Control Engineering
BT - Proceedings of INTER-NOISE 2021 - 2021 International Congress and Exposition of Noise Control Engineering
A2 - Dare, Tyler
A2 - Bolton, Stuart
A2 - Davies, Patricia
A2 - Xue, Yutong
A2 - Ebbitt, Gordon
PB - The Institute of Noise Control Engineering of the USA, Inc.
T2 - 50th International Congress and Exposition of Noise Control Engineering, INTER-NOISE 2021
Y2 - 1 August 2021 through 5 August 2021
ER -