Spatiotemporal processing in crossmodal interactions for perception of the external world

A review

Souta Hidaka, Wataru Teramoto, Yoichi Sugita

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Research regarding crossmodal interactions has garnered much interest in the last few decades. A variety of studies have demonstrated that multisensory information (vision, audition, tactile sensation, and so on) can perceptually interact with each other in the spatial and temporal domains. Findings regarding crossmodal interactions in the spatiotemporal domain (i.e., motion processing) have also been reported, with updates in the last few years. In this review, we summarize past and recent findings on spatiotemporal processing in crossmodal interactions regarding perception of the external world. A traditional view regarding crossmodal interactions holds that vision is superior to audition in spatial processing, but audition is dominant over vision in temporal processing. Similarly, vision is considered to have dominant effects over the other sensory modalities (i.e., visual capture) in spatiotemporal processing. However, recent findings demonstrate that sound could have a driving effect on visual motion perception. Moreover, studies regarding perceptual associative learning reported that, after association is established between a sound sequence without spatial information and visual motion information, the sound sequence could trigger visual motion perception. Other sensory information, such as motor action or smell, has also exhibited similar driving effects on visual motion perception. Additionally, recent brain imaging studies demonstrate that similar activation patterns could be observed in several brain areas, including the motion processing areas, between spatiotemporal information from different sensory modalities. Based on these findings, we suggest that multimodal information could mutually interact in spatiotemporal processing in the percept of the external world and that common perceptual and neural underlying mechanisms would exist for spatiotemporal processing.

Original languageEnglish
Article number62
JournalFrontiers in Integrative Neuroscience
Volume9
Issue numberDEC
DOIs
Publication statusPublished - 2015 Dec 14

Fingerprint

Motion Perception
Visual Perception
Hearing
Smell
Touch
Neuroimaging
Learning
Brain
Research

Keywords

  • Crossmodal interaction
  • Motion processing
  • Neural representations
  • Spatial processing
  • Spatiotemporal processing
  • Temporal processing

ASJC Scopus subject areas

  • Sensory Systems
  • Cognitive Neuroscience
  • Cellular and Molecular Neuroscience

Cite this

Spatiotemporal processing in crossmodal interactions for perception of the external world : A review. / Hidaka, Souta; Teramoto, Wataru; Sugita, Yoichi.

In: Frontiers in Integrative Neuroscience, Vol. 9, No. DEC, 62, 14.12.2015.

Research output: Contribution to journalArticle

@article{55445bee93584f81838233a900104972,
title = "Spatiotemporal processing in crossmodal interactions for perception of the external world: A review",
abstract = "Research regarding crossmodal interactions has garnered much interest in the last few decades. A variety of studies have demonstrated that multisensory information (vision, audition, tactile sensation, and so on) can perceptually interact with each other in the spatial and temporal domains. Findings regarding crossmodal interactions in the spatiotemporal domain (i.e., motion processing) have also been reported, with updates in the last few years. In this review, we summarize past and recent findings on spatiotemporal processing in crossmodal interactions regarding perception of the external world. A traditional view regarding crossmodal interactions holds that vision is superior to audition in spatial processing, but audition is dominant over vision in temporal processing. Similarly, vision is considered to have dominant effects over the other sensory modalities (i.e., visual capture) in spatiotemporal processing. However, recent findings demonstrate that sound could have a driving effect on visual motion perception. Moreover, studies regarding perceptual associative learning reported that, after association is established between a sound sequence without spatial information and visual motion information, the sound sequence could trigger visual motion perception. Other sensory information, such as motor action or smell, has also exhibited similar driving effects on visual motion perception. Additionally, recent brain imaging studies demonstrate that similar activation patterns could be observed in several brain areas, including the motion processing areas, between spatiotemporal information from different sensory modalities. Based on these findings, we suggest that multimodal information could mutually interact in spatiotemporal processing in the percept of the external world and that common perceptual and neural underlying mechanisms would exist for spatiotemporal processing.",
keywords = "Crossmodal interaction, Motion processing, Neural representations, Spatial processing, Spatiotemporal processing, Temporal processing",
author = "Souta Hidaka and Wataru Teramoto and Yoichi Sugita",
year = "2015",
month = "12",
day = "14",
doi = "10.3389/fnint.2015.00062",
language = "English",
volume = "9",
journal = "Frontiers in Integrative Neuroscience",
issn = "1662-5145",
publisher = "Frontiers Research Foundation",
number = "DEC",

}

TY - JOUR

T1 - Spatiotemporal processing in crossmodal interactions for perception of the external world

T2 - A review

AU - Hidaka, Souta

AU - Teramoto, Wataru

AU - Sugita, Yoichi

PY - 2015/12/14

Y1 - 2015/12/14

N2 - Research regarding crossmodal interactions has garnered much interest in the last few decades. A variety of studies have demonstrated that multisensory information (vision, audition, tactile sensation, and so on) can perceptually interact with each other in the spatial and temporal domains. Findings regarding crossmodal interactions in the spatiotemporal domain (i.e., motion processing) have also been reported, with updates in the last few years. In this review, we summarize past and recent findings on spatiotemporal processing in crossmodal interactions regarding perception of the external world. A traditional view regarding crossmodal interactions holds that vision is superior to audition in spatial processing, but audition is dominant over vision in temporal processing. Similarly, vision is considered to have dominant effects over the other sensory modalities (i.e., visual capture) in spatiotemporal processing. However, recent findings demonstrate that sound could have a driving effect on visual motion perception. Moreover, studies regarding perceptual associative learning reported that, after association is established between a sound sequence without spatial information and visual motion information, the sound sequence could trigger visual motion perception. Other sensory information, such as motor action or smell, has also exhibited similar driving effects on visual motion perception. Additionally, recent brain imaging studies demonstrate that similar activation patterns could be observed in several brain areas, including the motion processing areas, between spatiotemporal information from different sensory modalities. Based on these findings, we suggest that multimodal information could mutually interact in spatiotemporal processing in the percept of the external world and that common perceptual and neural underlying mechanisms would exist for spatiotemporal processing.

AB - Research regarding crossmodal interactions has garnered much interest in the last few decades. A variety of studies have demonstrated that multisensory information (vision, audition, tactile sensation, and so on) can perceptually interact with each other in the spatial and temporal domains. Findings regarding crossmodal interactions in the spatiotemporal domain (i.e., motion processing) have also been reported, with updates in the last few years. In this review, we summarize past and recent findings on spatiotemporal processing in crossmodal interactions regarding perception of the external world. A traditional view regarding crossmodal interactions holds that vision is superior to audition in spatial processing, but audition is dominant over vision in temporal processing. Similarly, vision is considered to have dominant effects over the other sensory modalities (i.e., visual capture) in spatiotemporal processing. However, recent findings demonstrate that sound could have a driving effect on visual motion perception. Moreover, studies regarding perceptual associative learning reported that, after association is established between a sound sequence without spatial information and visual motion information, the sound sequence could trigger visual motion perception. Other sensory information, such as motor action or smell, has also exhibited similar driving effects on visual motion perception. Additionally, recent brain imaging studies demonstrate that similar activation patterns could be observed in several brain areas, including the motion processing areas, between spatiotemporal information from different sensory modalities. Based on these findings, we suggest that multimodal information could mutually interact in spatiotemporal processing in the percept of the external world and that common perceptual and neural underlying mechanisms would exist for spatiotemporal processing.

KW - Crossmodal interaction

KW - Motion processing

KW - Neural representations

KW - Spatial processing

KW - Spatiotemporal processing

KW - Temporal processing

UR - http://www.scopus.com/inward/record.url?scp=84957559145&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84957559145&partnerID=8YFLogxK

U2 - 10.3389/fnint.2015.00062

DO - 10.3389/fnint.2015.00062

M3 - Article

VL - 9

JO - Frontiers in Integrative Neuroscience

JF - Frontiers in Integrative Neuroscience

SN - 1662-5145

IS - DEC

M1 - 62

ER -