Decoding subjective simultaneity from neuromagnetic signals

Kohske Takahashi, Shohei Hidaka, Katsumi Watanabe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The present study examined neural correlates of subjective simultaneity by using magnetoencephalography. Observers were asked to judge whether the visual and auditory stimuli occurred simultaneously. The subjective judgment for 90-ms-asynchronous stimuli showed trial-by-trial variation, and we successfully classified subjective simultaneity using neuromagnetic signals. We submitted raw MEG signals, a wavelet transform, and nonlinear dynamics to a naive Bayes classifier. In the case of raw signals and nonlinear dynamics, the classifier trained with the VA (where the visual stimulus was given first) or AV (where the visual stimulus was given second) data could predict the subjective simultaneity of the other VA (or AV) data at a rate better than chance. The classification rate using nonlinear dynamics was comparable to that using raw signals, despite the fact that the dimension was considerably low (101 vs. 88,000 dimensions). In the case of the wavelet transform, the classifier trained with the VA data was able to decode the AV data, and vice versa. These results suggest that (1) we can decode subjective simultaneity using MEG signals, (2) nonlinear dynamics may encode simultaneity specific to the order of the audiovisual inputs, (3) the time-frequency characteristics of neural activity may predict subjective simultaneity independently of the physical order of the audiovisual inputs, and (4) the neural activity (time-frequency characteristics) reflecting subjective simultaneity may share a common mechanism among different sensory modalities.

Original languageEnglish
Title of host publicationIFMBE Proceedings
Pages191-194
Number of pages4
Volume28
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event17th International Conference on Biomagnetism Advances in Biomagnetism, Biomag2010 - Dubrovnik, Croatia
Duration: 2010 Mar 282010 Apr 1

Other

Other17th International Conference on Biomagnetism Advances in Biomagnetism, Biomag2010
CountryCroatia
CityDubrovnik
Period10/3/2810/4/1

Fingerprint

Decoding
Classifiers
Wavelet transforms
Magnetoencephalography

Keywords

  • Decoding
  • Magnetoencephalography (MEG)
  • Subjective simultaneity
  • Time perception

ASJC Scopus subject areas

  • Biomedical Engineering
  • Bioengineering

Cite this

Takahashi, K., Hidaka, S., & Watanabe, K. (2010). Decoding subjective simultaneity from neuromagnetic signals. In IFMBE Proceedings (Vol. 28, pp. 191-194) https://doi.org/10.1007/978-3-642-12197-5_42

Decoding subjective simultaneity from neuromagnetic signals. / Takahashi, Kohske; Hidaka, Shohei; Watanabe, Katsumi.

IFMBE Proceedings. Vol. 28 2010. p. 191-194.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Takahashi, K, Hidaka, S & Watanabe, K 2010, Decoding subjective simultaneity from neuromagnetic signals. in IFMBE Proceedings. vol. 28, pp. 191-194, 17th International Conference on Biomagnetism Advances in Biomagnetism, Biomag2010, Dubrovnik, Croatia, 10/3/28. https://doi.org/10.1007/978-3-642-12197-5_42
Takahashi, Kohske ; Hidaka, Shohei ; Watanabe, Katsumi. / Decoding subjective simultaneity from neuromagnetic signals. IFMBE Proceedings. Vol. 28 2010. pp. 191-194
@inproceedings{b610d17f6fca416b95be2aaf98729e93,
title = "Decoding subjective simultaneity from neuromagnetic signals",
abstract = "The present study examined neural correlates of subjective simultaneity by using magnetoencephalography. Observers were asked to judge whether the visual and auditory stimuli occurred simultaneously. The subjective judgment for 90-ms-asynchronous stimuli showed trial-by-trial variation, and we successfully classified subjective simultaneity using neuromagnetic signals. We submitted raw MEG signals, a wavelet transform, and nonlinear dynamics to a naive Bayes classifier. In the case of raw signals and nonlinear dynamics, the classifier trained with the VA (where the visual stimulus was given first) or AV (where the visual stimulus was given second) data could predict the subjective simultaneity of the other VA (or AV) data at a rate better than chance. The classification rate using nonlinear dynamics was comparable to that using raw signals, despite the fact that the dimension was considerably low (101 vs. 88,000 dimensions). In the case of the wavelet transform, the classifier trained with the VA data was able to decode the AV data, and vice versa. These results suggest that (1) we can decode subjective simultaneity using MEG signals, (2) nonlinear dynamics may encode simultaneity specific to the order of the audiovisual inputs, (3) the time-frequency characteristics of neural activity may predict subjective simultaneity independently of the physical order of the audiovisual inputs, and (4) the neural activity (time-frequency characteristics) reflecting subjective simultaneity may share a common mechanism among different sensory modalities.",
keywords = "Decoding, Magnetoencephalography (MEG), Subjective simultaneity, Time perception",
author = "Kohske Takahashi and Shohei Hidaka and Katsumi Watanabe",
year = "2010",
doi = "10.1007/978-3-642-12197-5_42",
language = "English",
isbn = "9783642121968",
volume = "28",
pages = "191--194",
booktitle = "IFMBE Proceedings",

}

TY - GEN

T1 - Decoding subjective simultaneity from neuromagnetic signals

AU - Takahashi, Kohske

AU - Hidaka, Shohei

AU - Watanabe, Katsumi

PY - 2010

Y1 - 2010

N2 - The present study examined neural correlates of subjective simultaneity by using magnetoencephalography. Observers were asked to judge whether the visual and auditory stimuli occurred simultaneously. The subjective judgment for 90-ms-asynchronous stimuli showed trial-by-trial variation, and we successfully classified subjective simultaneity using neuromagnetic signals. We submitted raw MEG signals, a wavelet transform, and nonlinear dynamics to a naive Bayes classifier. In the case of raw signals and nonlinear dynamics, the classifier trained with the VA (where the visual stimulus was given first) or AV (where the visual stimulus was given second) data could predict the subjective simultaneity of the other VA (or AV) data at a rate better than chance. The classification rate using nonlinear dynamics was comparable to that using raw signals, despite the fact that the dimension was considerably low (101 vs. 88,000 dimensions). In the case of the wavelet transform, the classifier trained with the VA data was able to decode the AV data, and vice versa. These results suggest that (1) we can decode subjective simultaneity using MEG signals, (2) nonlinear dynamics may encode simultaneity specific to the order of the audiovisual inputs, (3) the time-frequency characteristics of neural activity may predict subjective simultaneity independently of the physical order of the audiovisual inputs, and (4) the neural activity (time-frequency characteristics) reflecting subjective simultaneity may share a common mechanism among different sensory modalities.

AB - The present study examined neural correlates of subjective simultaneity by using magnetoencephalography. Observers were asked to judge whether the visual and auditory stimuli occurred simultaneously. The subjective judgment for 90-ms-asynchronous stimuli showed trial-by-trial variation, and we successfully classified subjective simultaneity using neuromagnetic signals. We submitted raw MEG signals, a wavelet transform, and nonlinear dynamics to a naive Bayes classifier. In the case of raw signals and nonlinear dynamics, the classifier trained with the VA (where the visual stimulus was given first) or AV (where the visual stimulus was given second) data could predict the subjective simultaneity of the other VA (or AV) data at a rate better than chance. The classification rate using nonlinear dynamics was comparable to that using raw signals, despite the fact that the dimension was considerably low (101 vs. 88,000 dimensions). In the case of the wavelet transform, the classifier trained with the VA data was able to decode the AV data, and vice versa. These results suggest that (1) we can decode subjective simultaneity using MEG signals, (2) nonlinear dynamics may encode simultaneity specific to the order of the audiovisual inputs, (3) the time-frequency characteristics of neural activity may predict subjective simultaneity independently of the physical order of the audiovisual inputs, and (4) the neural activity (time-frequency characteristics) reflecting subjective simultaneity may share a common mechanism among different sensory modalities.

KW - Decoding

KW - Magnetoencephalography (MEG)

KW - Subjective simultaneity

KW - Time perception

UR - http://www.scopus.com/inward/record.url?scp=77952406200&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77952406200&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-12197-5_42

DO - 10.1007/978-3-642-12197-5_42

M3 - Conference contribution

AN - SCOPUS:77952406200

SN - 9783642121968

VL - 28

SP - 191

EP - 194

BT - IFMBE Proceedings

ER -