Beyond perceptual modality: Auditory effects on visual perception

Shinsuke Shimojo*, Christian Scheier, Romi Nijhawan, Ladan Shams, Yukiyasu Kamitani, Katsumi Watanabe

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

42 Citations (Scopus)

Abstract

Three sets of new findings with regard to modulation of visual perception by auditory stimuli are reviewed. First, we show that visual temporal resolution can be either improved or deteriorated by accompanying sounds, depending on the sequence and delay among the auditory and visual stimuli. Second, a single visual flash can be perceived as multiple flashes when accompanied by multiple sounds. Third, an ambiguous motion display consisting of two objects moving toward each other is perceived as streaming with or without an unsynchronized sound, but as bouncing with a synchronized sound. Based on these findings, we argue, against the traditional belief of visual dominance, that audition can modify vision particularly when it provides strong transient signal(s).

Original languageEnglish
Pages (from-to)61-67
Number of pages7
JournalAcoustical Science and Technology
Volume22
Issue number2
DOIs
Publication statusPublished - 2001
Externally publishedYes

Keywords

  • Ambiguous motion
  • Attention
  • Auditory-visual interaction
  • Crossmodal interaction
  • Visual temporal resolution

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Fingerprint

Dive into the research topics of 'Beyond perceptual modality: Auditory effects on visual perception'. Together they form a unique fingerprint.

Cite this