Audiovisual semantic congruency effect with onomatopoeia

Antonio Rei Fidalgo, Kohshe Takahashi, Aiko Murata, Katsumi Watanabe

    研究成果: Conference contribution

    抜粋

    It has been reported that when a congruent natural sound precedes briefly presented visual stimuli, it promotes performance in psychophysics detection tasks. Onomatopoeias refer to words that phonetically mimic or suggest actual sounds. Onomatopoeic words are a form of sound symbolism and are frequently used in Japanese language. In this study, we examined whether the presentation of spoken Japanese onomatopoeia to Japanese native-speakers results in visual detection sensitivity changes. Results indicate that when onomatopoeias are presented 227 ms before a visual stimulus, they have a modulatory audiovisual effect. This effect is closer to the results observed with natural sounds than spoken words, with d' being lower for onomatopoeias when compared with natural sounds. Such suggests that Japanese spoken onomatopoeias may be processed in a manner that is closer to natural sounds than spoken words and points to behavioral consequences of sound symbolism.

    元の言語English
    ホスト出版物のタイトル2018 10th International Conference on Knowledge and Smart Technology
    ホスト出版物のサブタイトルCybernetics in the Next Decades, KST 2018
    出版者Institute of Electrical and Electronics Engineers Inc.
    ページ254-259
    ページ数6
    ISBN(印刷物)9781538640159
    DOI
    出版物ステータスPublished - 2018 8 6
    イベント10th International Conference on Knowledge and Smart Technology, KST 2018 - Chiang Mai, Thailand
    継続期間: 2018 1 312018 2 3

    Other

    Other10th International Conference on Knowledge and Smart Technology, KST 2018
    Thailand
    Chiang Mai
    期間18/1/3118/2/3

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Science Applications
    • Control and Optimization

    フィンガープリント Audiovisual semantic congruency effect with onomatopoeia' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Fidalgo, A. R., Takahashi, K., Murata, A., & Watanabe, K. (2018). Audiovisual semantic congruency effect with onomatopoeia. : 2018 10th International Conference on Knowledge and Smart Technology: Cybernetics in the Next Decades, KST 2018 (pp. 254-259). [8426115] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/KST.2018.8426115