Beyond perceptual modality: Auditory effects on visual perception

Shinsuke Shimojo, Christian Scheier, Romi Nijhawan, Ladan Shams, Yukiyasu Kamitani, Katsumi Watanabe

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

Three sets of new findings with regard to modulation of visual perception by auditory stimuli are reviewed. First, we show that visual temporal resolution can be either improved or deteriorated by accompanying sounds, depending on the sequence and delay among the auditory and visual stimuli. Second, a single visual flash can be perceived as multiple flashes when accompanied by multiple sounds. Third, an ambiguous motion display consisting of two objects moving toward each other is perceived as streaming with or without an unsynchronized sound, but as bouncing with a synchronized sound. Based on these findings, we argue, against the traditional belief of visual dominance, that audition can modify vision particularly when it provides strong transient signal(s).

Original languageEnglish
Pages (from-to)61-67
Number of pages7
JournalAcoustical Science and Technology
Volume22
Issue number2
DOIs
Publication statusPublished - 2001
Externally publishedYes

Fingerprint

visual perception
auditory stimuli
acoustics
flash
visual stimuli
temporal resolution
modulation

Keywords

  • Ambiguous motion
  • Attention
  • Auditory-visual interaction
  • Crossmodal interaction
  • Visual temporal resolution

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Cite this

Beyond perceptual modality : Auditory effects on visual perception. / Shimojo, Shinsuke; Scheier, Christian; Nijhawan, Romi; Shams, Ladan; Kamitani, Yukiyasu; Watanabe, Katsumi.

In: Acoustical Science and Technology, Vol. 22, No. 2, 2001, p. 61-67.

Research output: Contribution to journalArticle

Shimojo, S, Scheier, C, Nijhawan, R, Shams, L, Kamitani, Y & Watanabe, K 2001, 'Beyond perceptual modality: Auditory effects on visual perception', Acoustical Science and Technology, vol. 22, no. 2, pp. 61-67. https://doi.org/10.1250/ast.22.61
Shimojo, Shinsuke ; Scheier, Christian ; Nijhawan, Romi ; Shams, Ladan ; Kamitani, Yukiyasu ; Watanabe, Katsumi. / Beyond perceptual modality : Auditory effects on visual perception. In: Acoustical Science and Technology. 2001 ; Vol. 22, No. 2. pp. 61-67.
@article{bf5d1f80db2345d7819f142b3679c421,
title = "Beyond perceptual modality: Auditory effects on visual perception",
abstract = "Three sets of new findings with regard to modulation of visual perception by auditory stimuli are reviewed. First, we show that visual temporal resolution can be either improved or deteriorated by accompanying sounds, depending on the sequence and delay among the auditory and visual stimuli. Second, a single visual flash can be perceived as multiple flashes when accompanied by multiple sounds. Third, an ambiguous motion display consisting of two objects moving toward each other is perceived as streaming with or without an unsynchronized sound, but as bouncing with a synchronized sound. Based on these findings, we argue, against the traditional belief of visual dominance, that audition can modify vision particularly when it provides strong transient signal(s).",
keywords = "Ambiguous motion, Attention, Auditory-visual interaction, Crossmodal interaction, Visual temporal resolution",
author = "Shinsuke Shimojo and Christian Scheier and Romi Nijhawan and Ladan Shams and Yukiyasu Kamitani and Katsumi Watanabe",
year = "2001",
doi = "10.1250/ast.22.61",
language = "English",
volume = "22",
pages = "61--67",
journal = "Acoustical Science and Technology",
issn = "1346-3969",
publisher = "Acoustical Society of Japan",
number = "2",

}

TY - JOUR

T1 - Beyond perceptual modality

T2 - Auditory effects on visual perception

AU - Shimojo, Shinsuke

AU - Scheier, Christian

AU - Nijhawan, Romi

AU - Shams, Ladan

AU - Kamitani, Yukiyasu

AU - Watanabe, Katsumi

PY - 2001

Y1 - 2001

N2 - Three sets of new findings with regard to modulation of visual perception by auditory stimuli are reviewed. First, we show that visual temporal resolution can be either improved or deteriorated by accompanying sounds, depending on the sequence and delay among the auditory and visual stimuli. Second, a single visual flash can be perceived as multiple flashes when accompanied by multiple sounds. Third, an ambiguous motion display consisting of two objects moving toward each other is perceived as streaming with or without an unsynchronized sound, but as bouncing with a synchronized sound. Based on these findings, we argue, against the traditional belief of visual dominance, that audition can modify vision particularly when it provides strong transient signal(s).

AB - Three sets of new findings with regard to modulation of visual perception by auditory stimuli are reviewed. First, we show that visual temporal resolution can be either improved or deteriorated by accompanying sounds, depending on the sequence and delay among the auditory and visual stimuli. Second, a single visual flash can be perceived as multiple flashes when accompanied by multiple sounds. Third, an ambiguous motion display consisting of two objects moving toward each other is perceived as streaming with or without an unsynchronized sound, but as bouncing with a synchronized sound. Based on these findings, we argue, against the traditional belief of visual dominance, that audition can modify vision particularly when it provides strong transient signal(s).

KW - Ambiguous motion

KW - Attention

KW - Auditory-visual interaction

KW - Crossmodal interaction

KW - Visual temporal resolution

UR - http://www.scopus.com/inward/record.url?scp=0034985203&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034985203&partnerID=8YFLogxK

U2 - 10.1250/ast.22.61

DO - 10.1250/ast.22.61

M3 - Article

AN - SCOPUS:0034985203

VL - 22

SP - 61

EP - 67

JO - Acoustical Science and Technology

JF - Acoustical Science and Technology

SN - 1346-3969

IS - 2

ER -