Neural mechanisms underlying sound-induced visual motion perception

An fMRI study

Souta Hidaka, Satomi Higuchi, Wataru Teramoto, Yoichi Sugita

Research output: Contribution to journalArticle

Abstract

Studies of crossmodal interactions in motion perception have reported activation in several brain areas, including those related to motion processing and/or sensory association, in response to multimodal (e.g., visual and auditory) stimuli that were both in motion. Recent studies have demonstrated that sounds can trigger illusory visual apparent motion to static visual stimuli (sound-induced visual motion: SIVM): A visual stimulus blinking at a fixed location is perceived to be moving laterally when an alternating left-right sound is also present. Here, we investigated brain activity related to the perception of SIVM using a 7 T functional magnetic resonance imaging technique. Specifically, we focused on the patterns of neural activities in SIVM and visually induced visual apparent motion (VIVM). We observed shared activations in the middle occipital area (V5/hMT), which is thought to be involved in visual motion processing, for SIVM and VIVM. Moreover, as compared to VIVM, SIVM resulted in greater activation in the superior temporal area and dominant functional connectivity between the V5/hMT area and the areas related to auditory and crossmodal motion processing. These findings indicate that similar but partially different neural mechanisms could be involved in auditory-induced and visually-induced motion perception, and neural signals in auditory, visual, and, crossmodal motion processing areas closely and directly interact in the perception of SIVM.

Original languageEnglish
Pages (from-to)66-72
Number of pages7
JournalActa Psychologica
Volume178
DOIs
Publication statusPublished - 2017 Jul 1

Fingerprint

Motion Perception
Visual Perception
Magnetic Resonance Imaging
Functional Magnetic Resonance Imaging
Sound
Blinking
Brain

Keywords

  • Audiovisual interaction
  • Human motion processing area
  • Motion perception
  • Sensory association areas
  • Sound-induced visual motion
  • Visual apparent motion

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)

Cite this

Neural mechanisms underlying sound-induced visual motion perception : An fMRI study. / Hidaka, Souta; Higuchi, Satomi; Teramoto, Wataru; Sugita, Yoichi.

In: Acta Psychologica, Vol. 178, 01.07.2017, p. 66-72.

Research output: Contribution to journalArticle

Hidaka, Souta ; Higuchi, Satomi ; Teramoto, Wataru ; Sugita, Yoichi. / Neural mechanisms underlying sound-induced visual motion perception : An fMRI study. In: Acta Psychologica. 2017 ; Vol. 178. pp. 66-72.
@article{ec22dbaf4ef445dc84715386669a0e8d,
title = "Neural mechanisms underlying sound-induced visual motion perception: An fMRI study",
abstract = "Studies of crossmodal interactions in motion perception have reported activation in several brain areas, including those related to motion processing and/or sensory association, in response to multimodal (e.g., visual and auditory) stimuli that were both in motion. Recent studies have demonstrated that sounds can trigger illusory visual apparent motion to static visual stimuli (sound-induced visual motion: SIVM): A visual stimulus blinking at a fixed location is perceived to be moving laterally when an alternating left-right sound is also present. Here, we investigated brain activity related to the perception of SIVM using a 7 T functional magnetic resonance imaging technique. Specifically, we focused on the patterns of neural activities in SIVM and visually induced visual apparent motion (VIVM). We observed shared activations in the middle occipital area (V5/hMT), which is thought to be involved in visual motion processing, for SIVM and VIVM. Moreover, as compared to VIVM, SIVM resulted in greater activation in the superior temporal area and dominant functional connectivity between the V5/hMT area and the areas related to auditory and crossmodal motion processing. These findings indicate that similar but partially different neural mechanisms could be involved in auditory-induced and visually-induced motion perception, and neural signals in auditory, visual, and, crossmodal motion processing areas closely and directly interact in the perception of SIVM.",
keywords = "Audiovisual interaction, Human motion processing area, Motion perception, Sensory association areas, Sound-induced visual motion, Visual apparent motion",
author = "Souta Hidaka and Satomi Higuchi and Wataru Teramoto and Yoichi Sugita",
year = "2017",
month = "7",
day = "1",
doi = "10.1016/j.actpsy.2017.05.013",
language = "English",
volume = "178",
pages = "66--72",
journal = "Acta Psychologica",
issn = "0001-6918",
publisher = "Elsevier",

}

TY - JOUR

T1 - Neural mechanisms underlying sound-induced visual motion perception

T2 - An fMRI study

AU - Hidaka, Souta

AU - Higuchi, Satomi

AU - Teramoto, Wataru

AU - Sugita, Yoichi

PY - 2017/7/1

Y1 - 2017/7/1

N2 - Studies of crossmodal interactions in motion perception have reported activation in several brain areas, including those related to motion processing and/or sensory association, in response to multimodal (e.g., visual and auditory) stimuli that were both in motion. Recent studies have demonstrated that sounds can trigger illusory visual apparent motion to static visual stimuli (sound-induced visual motion: SIVM): A visual stimulus blinking at a fixed location is perceived to be moving laterally when an alternating left-right sound is also present. Here, we investigated brain activity related to the perception of SIVM using a 7 T functional magnetic resonance imaging technique. Specifically, we focused on the patterns of neural activities in SIVM and visually induced visual apparent motion (VIVM). We observed shared activations in the middle occipital area (V5/hMT), which is thought to be involved in visual motion processing, for SIVM and VIVM. Moreover, as compared to VIVM, SIVM resulted in greater activation in the superior temporal area and dominant functional connectivity between the V5/hMT area and the areas related to auditory and crossmodal motion processing. These findings indicate that similar but partially different neural mechanisms could be involved in auditory-induced and visually-induced motion perception, and neural signals in auditory, visual, and, crossmodal motion processing areas closely and directly interact in the perception of SIVM.

AB - Studies of crossmodal interactions in motion perception have reported activation in several brain areas, including those related to motion processing and/or sensory association, in response to multimodal (e.g., visual and auditory) stimuli that were both in motion. Recent studies have demonstrated that sounds can trigger illusory visual apparent motion to static visual stimuli (sound-induced visual motion: SIVM): A visual stimulus blinking at a fixed location is perceived to be moving laterally when an alternating left-right sound is also present. Here, we investigated brain activity related to the perception of SIVM using a 7 T functional magnetic resonance imaging technique. Specifically, we focused on the patterns of neural activities in SIVM and visually induced visual apparent motion (VIVM). We observed shared activations in the middle occipital area (V5/hMT), which is thought to be involved in visual motion processing, for SIVM and VIVM. Moreover, as compared to VIVM, SIVM resulted in greater activation in the superior temporal area and dominant functional connectivity between the V5/hMT area and the areas related to auditory and crossmodal motion processing. These findings indicate that similar but partially different neural mechanisms could be involved in auditory-induced and visually-induced motion perception, and neural signals in auditory, visual, and, crossmodal motion processing areas closely and directly interact in the perception of SIVM.

KW - Audiovisual interaction

KW - Human motion processing area

KW - Motion perception

KW - Sensory association areas

KW - Sound-induced visual motion

KW - Visual apparent motion

UR - http://www.scopus.com/inward/record.url?scp=85020299346&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85020299346&partnerID=8YFLogxK

U2 - 10.1016/j.actpsy.2017.05.013

DO - 10.1016/j.actpsy.2017.05.013

M3 - Article

VL - 178

SP - 66

EP - 72

JO - Acta Psychologica

JF - Acta Psychologica

SN - 0001-6918

ER -