Visualization system for sound field using see-through head-mounted display

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

    Research output: Contribution to journalArticle

    1 Citation (Scopus)

    Abstract

    For the visualization of a sound field, a widely used method is the superimposition of the sound information onto a camera view. Although it effectively enables the understanding the relationship between space and sound, a planar display cannot resolve depth information in a straightforward manner. In contrast, a see-through head-mounted display (STHMD) is capable of representing three-dimensional (3D) vision and natural augmented reality (AR) or mixed reality (MR). In this paper, we propose a system for the measurement and visualization of a sound field with an STHMD. We created two visualization systems using different types of STHMDs and technologies for realizing AR/MR and a measurement system for a 3D sound intensity map, which can be used together with the visualization system. Through three visualization experiments, we empirically found that the stereoscopic viewing and the convenient viewpoint movement associated with the STHMD enables understanding of the sound field in a short time.

    Original languageEnglish
    JournalAcoustical Science and Technology
    Volume40
    Issue number1
    DOIs
    Publication statusPublished - 2019 Jan 1

    Fingerprint

    sound fields
    sound intensity
    acoustics
    cameras

    Keywords

    • Augmented reality (AR)
    • Marker detection
    • Mixed reality (MR)
    • Simultaneous localization and mapping (SLAM)
    • Sound intensity

    ASJC Scopus subject areas

    • Acoustics and Ultrasonics

    Cite this

    Visualization system for sound field using see-through head-mounted display. / Inoue, Atsuto; Ikeda, Yusuke; Yatabe, Kohei; Oikawa, Yasuhiro.

    In: Acoustical Science and Technology, Vol. 40, No. 1, 01.01.2019.

    Research output: Contribution to journalArticle

    @article{94aa2201e8be469e9a9bdaa752750823,
    title = "Visualization system for sound field using see-through head-mounted display",
    abstract = "For the visualization of a sound field, a widely used method is the superimposition of the sound information onto a camera view. Although it effectively enables the understanding the relationship between space and sound, a planar display cannot resolve depth information in a straightforward manner. In contrast, a see-through head-mounted display (STHMD) is capable of representing three-dimensional (3D) vision and natural augmented reality (AR) or mixed reality (MR). In this paper, we propose a system for the measurement and visualization of a sound field with an STHMD. We created two visualization systems using different types of STHMDs and technologies for realizing AR/MR and a measurement system for a 3D sound intensity map, which can be used together with the visualization system. Through three visualization experiments, we empirically found that the stereoscopic viewing and the convenient viewpoint movement associated with the STHMD enables understanding of the sound field in a short time.",
    keywords = "Augmented reality (AR), Marker detection, Mixed reality (MR), Simultaneous localization and mapping (SLAM), Sound intensity",
    author = "Atsuto Inoue and Yusuke Ikeda and Kohei Yatabe and Yasuhiro Oikawa",
    year = "2019",
    month = "1",
    day = "1",
    doi = "10.1250/ast.40.1",
    language = "English",
    volume = "40",
    journal = "Acoustical Science and Technology",
    issn = "1346-3969",
    publisher = "Acoustical Society of Japan",
    number = "1",

    }

    TY - JOUR

    T1 - Visualization system for sound field using see-through head-mounted display

    AU - Inoue, Atsuto

    AU - Ikeda, Yusuke

    AU - Yatabe, Kohei

    AU - Oikawa, Yasuhiro

    PY - 2019/1/1

    Y1 - 2019/1/1

    N2 - For the visualization of a sound field, a widely used method is the superimposition of the sound information onto a camera view. Although it effectively enables the understanding the relationship between space and sound, a planar display cannot resolve depth information in a straightforward manner. In contrast, a see-through head-mounted display (STHMD) is capable of representing three-dimensional (3D) vision and natural augmented reality (AR) or mixed reality (MR). In this paper, we propose a system for the measurement and visualization of a sound field with an STHMD. We created two visualization systems using different types of STHMDs and technologies for realizing AR/MR and a measurement system for a 3D sound intensity map, which can be used together with the visualization system. Through three visualization experiments, we empirically found that the stereoscopic viewing and the convenient viewpoint movement associated with the STHMD enables understanding of the sound field in a short time.

    AB - For the visualization of a sound field, a widely used method is the superimposition of the sound information onto a camera view. Although it effectively enables the understanding the relationship between space and sound, a planar display cannot resolve depth information in a straightforward manner. In contrast, a see-through head-mounted display (STHMD) is capable of representing three-dimensional (3D) vision and natural augmented reality (AR) or mixed reality (MR). In this paper, we propose a system for the measurement and visualization of a sound field with an STHMD. We created two visualization systems using different types of STHMDs and technologies for realizing AR/MR and a measurement system for a 3D sound intensity map, which can be used together with the visualization system. Through three visualization experiments, we empirically found that the stereoscopic viewing and the convenient viewpoint movement associated with the STHMD enables understanding of the sound field in a short time.

    KW - Augmented reality (AR)

    KW - Marker detection

    KW - Mixed reality (MR)

    KW - Simultaneous localization and mapping (SLAM)

    KW - Sound intensity

    UR - http://www.scopus.com/inward/record.url?scp=85060081993&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85060081993&partnerID=8YFLogxK

    U2 - 10.1250/ast.40.1

    DO - 10.1250/ast.40.1

    M3 - Article

    VL - 40

    JO - Acoustical Science and Technology

    JF - Acoustical Science and Technology

    SN - 1346-3969

    IS - 1

    ER -