Three-dimensional sound-field visualization system using head mounted display and stereo camera

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

    Research output: Contribution to journalConference article

    6 Citations (Scopus)

    Abstract

    Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.

    Original languageEnglish
    Article number025001
    JournalProceedings of Meetings on Acoustics
    Volume29
    Issue number1
    DOIs
    Publication statusPublished - 2016 Nov 28
    Event172nd Meeting of the Acoustical Society of America - Honolulu, United States
    Duration: 2016 Nov 282016 Dec 2

    Fingerprint

    sound fields
    cameras
    sound intensity
    microphones
    acoustics
    loudspeakers
    markers
    education
    sensors

    ASJC Scopus subject areas

    • Acoustics and Ultrasonics

    Cite this

    Three-dimensional sound-field visualization system using head mounted display and stereo camera. / Inoue, Atsuto; Ikeda, Yusuke; Yatabe, Kohei; Oikawa, Yasuhiro.

    In: Proceedings of Meetings on Acoustics, Vol. 29, No. 1, 025001, 28.11.2016.

    Research output: Contribution to journalConference article

    @article{515e5636cd8a4a9e982dd70bca7bc179,
    title = "Three-dimensional sound-field visualization system using head mounted display and stereo camera",
    abstract = "Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.",
    author = "Atsuto Inoue and Yusuke Ikeda and Kohei Yatabe and Yasuhiro Oikawa",
    year = "2016",
    month = "11",
    day = "28",
    doi = "10.1121/2.0000381",
    language = "English",
    volume = "29",
    journal = "Proceedings of Meetings on Acoustics",
    issn = "1939-800X",
    publisher = "Acoustical Society of America",
    number = "1",

    }

    TY - JOUR

    T1 - Three-dimensional sound-field visualization system using head mounted display and stereo camera

    AU - Inoue, Atsuto

    AU - Ikeda, Yusuke

    AU - Yatabe, Kohei

    AU - Oikawa, Yasuhiro

    PY - 2016/11/28

    Y1 - 2016/11/28

    N2 - Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.

    AB - Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.

    UR - http://www.scopus.com/inward/record.url?scp=85028590522&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85028590522&partnerID=8YFLogxK

    U2 - 10.1121/2.0000381

    DO - 10.1121/2.0000381

    M3 - Conference article

    VL - 29

    JO - Proceedings of Meetings on Acoustics

    JF - Proceedings of Meetings on Acoustics

    SN - 1939-800X

    IS - 1

    M1 - 025001

    ER -