When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception

Katsumi Watanabe, Shinsuke Shimojo

Research output: Contribution to journalArticle

138 Citations (Scopus)

Abstract

Two identical visual targets moving across each other can be perceived either to bounce off or to stream through each other. A brief sound at the moment the targets coincide biases perception toward bouncing. We found that this bounce-inducing effect was attenuated when other identical sounds (auditory flankers) were presented 300 ms before and after the simultaneous sound. The attenuation occurred only when the simultaneous sound and auditory flankers had similar acoustic characteristics and the simultaneous sound was not salient. These results suggest that there is an aspect of auditory-grouping (saliency-assigning) processes that is context-sensitive and can be utilized by the visual system for solving ambiguity. Furthermore, control experiments revealed that such auditory context did not affect the perceptual qualities of the simultaneous sound. Because the attenuation effect is not manifest in the perception of acoustic characteristics of individual sound elements, we conclude that it is a genuine cross-modal effect.

Original languageEnglish
Pages (from-to)109-116
Number of pages8
JournalPsychological Science
Volume12
Issue number2
Publication statusPublished - 2001 Mar
Externally publishedYes

Fingerprint

Motion Perception
Visual Perception
Acoustics

ASJC Scopus subject areas

  • Psychology(all)

Cite this

When Sound Affects Vision : Effects of Auditory Grouping on Visual Motion Perception. / Watanabe, Katsumi; Shimojo, Shinsuke.

In: Psychological Science, Vol. 12, No. 2, 03.2001, p. 109-116.

Research output: Contribution to journalArticle

@article{663c1cb850d14b46b2afc41306ee50fe,
title = "When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception",
abstract = "Two identical visual targets moving across each other can be perceived either to bounce off or to stream through each other. A brief sound at the moment the targets coincide biases perception toward bouncing. We found that this bounce-inducing effect was attenuated when other identical sounds (auditory flankers) were presented 300 ms before and after the simultaneous sound. The attenuation occurred only when the simultaneous sound and auditory flankers had similar acoustic characteristics and the simultaneous sound was not salient. These results suggest that there is an aspect of auditory-grouping (saliency-assigning) processes that is context-sensitive and can be utilized by the visual system for solving ambiguity. Furthermore, control experiments revealed that such auditory context did not affect the perceptual qualities of the simultaneous sound. Because the attenuation effect is not manifest in the perception of acoustic characteristics of individual sound elements, we conclude that it is a genuine cross-modal effect.",
author = "Katsumi Watanabe and Shinsuke Shimojo",
year = "2001",
month = "3",
language = "English",
volume = "12",
pages = "109--116",
journal = "Psychological Science",
issn = "0956-7976",
publisher = "SAGE Publications Inc.",
number = "2",

}

TY - JOUR

T1 - When Sound Affects Vision

T2 - Effects of Auditory Grouping on Visual Motion Perception

AU - Watanabe, Katsumi

AU - Shimojo, Shinsuke

PY - 2001/3

Y1 - 2001/3

N2 - Two identical visual targets moving across each other can be perceived either to bounce off or to stream through each other. A brief sound at the moment the targets coincide biases perception toward bouncing. We found that this bounce-inducing effect was attenuated when other identical sounds (auditory flankers) were presented 300 ms before and after the simultaneous sound. The attenuation occurred only when the simultaneous sound and auditory flankers had similar acoustic characteristics and the simultaneous sound was not salient. These results suggest that there is an aspect of auditory-grouping (saliency-assigning) processes that is context-sensitive and can be utilized by the visual system for solving ambiguity. Furthermore, control experiments revealed that such auditory context did not affect the perceptual qualities of the simultaneous sound. Because the attenuation effect is not manifest in the perception of acoustic characteristics of individual sound elements, we conclude that it is a genuine cross-modal effect.

AB - Two identical visual targets moving across each other can be perceived either to bounce off or to stream through each other. A brief sound at the moment the targets coincide biases perception toward bouncing. We found that this bounce-inducing effect was attenuated when other identical sounds (auditory flankers) were presented 300 ms before and after the simultaneous sound. The attenuation occurred only when the simultaneous sound and auditory flankers had similar acoustic characteristics and the simultaneous sound was not salient. These results suggest that there is an aspect of auditory-grouping (saliency-assigning) processes that is context-sensitive and can be utilized by the visual system for solving ambiguity. Furthermore, control experiments revealed that such auditory context did not affect the perceptual qualities of the simultaneous sound. Because the attenuation effect is not manifest in the perception of acoustic characteristics of individual sound elements, we conclude that it is a genuine cross-modal effect.

UR - http://www.scopus.com/inward/record.url?scp=0035291353&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035291353&partnerID=8YFLogxK

M3 - Article

C2 - 11340918

AN - SCOPUS:0035291353

VL - 12

SP - 109

EP - 116

JO - Psychological Science

JF - Psychological Science

SN - 0956-7976

IS - 2

ER -