Switch or stay? Automatic classification of internal mental states in bistable perception

Susmita Sen, Syed Naser Daimi, Katsumi Watanabe, Kohske Takahashi, Joydeep Bhattacharya, Goutam Saha

Research output: Contribution to journalArticle

Abstract

The human brain goes through numerous cognitive states, most of these being hidden or implicit while performing a task, and understanding them is of great practical importance. However, identifying internal mental states is quite challenging as these states are difficult to label, usually short-lived, and generally, overlap with other tasks. One such problem pertains to bistable perception, which we consider to consist of two internal mental states, namely, transition and maintenance. The transition state is short-lived and represents a change in perception while the maintenance state is comparatively longer and represents a stable perception. In this study, we proposed a novel approach for characterizing the duration of transition and maintenance states and classified them from the neuromagnetic brain responses. Participants were presented with various types of ambiguous visual stimuli on which they indicated the moments of perceptual switches, while their magnetoencephalogram (MEG) data were recorded. We extracted different spatio-temporal features based on wavelet transform, and classified transition and maintenance states on a trial-by-trial basis. We obtained a classification accuracy of 79.58% and 78.40% using SVM and ANN classifiers, respectively. Next, we investigated the temporal fluctuations of these internal mental representations as captured by our classifier model and found that the accuracy showed a decreasing trend as the maintenance state was moved towards the next transition state. Further, to identify the neural sources corresponding to these internal mental states, we performed source analysis on MEG signals. We observed the involvement of sources from the parietal lobe, occipital lobe, and cerebellum in distinguishing transition and maintenance states. Cross-conditional classification analysis established generalization potential of wavelet features. Altogether, this study presents an automatic classification of endogenous mental states involved in bistable perception by establishing brain-behavior relationships at the single-trial level.

Original languageEnglish
JournalCognitive Neurodynamics
DOIs
Publication statusPublished - 2019 Jan 1

Fingerprint

Maintenance
Brain
Wavelet Analysis
Occipital Lobe
Parietal Lobe
Cerebellum

Keywords

  • ANN
  • Bistable perception
  • Internal mental states
  • MEG
  • Single-trial classification
  • Source reconstruction
  • SVM

ASJC Scopus subject areas

  • Cognitive Neuroscience

Cite this

Switch or stay? Automatic classification of internal mental states in bistable perception. / Sen, Susmita; Daimi, Syed Naser; Watanabe, Katsumi; Takahashi, Kohske; Bhattacharya, Joydeep; Saha, Goutam.

In: Cognitive Neurodynamics, 01.01.2019.

Research output: Contribution to journalArticle

Sen, Susmita ; Daimi, Syed Naser ; Watanabe, Katsumi ; Takahashi, Kohske ; Bhattacharya, Joydeep ; Saha, Goutam. / Switch or stay? Automatic classification of internal mental states in bistable perception. In: Cognitive Neurodynamics. 2019.
@article{b844dab6446e4f4781c3ab37f54a16e3,
title = "Switch or stay? Automatic classification of internal mental states in bistable perception",
abstract = "The human brain goes through numerous cognitive states, most of these being hidden or implicit while performing a task, and understanding them is of great practical importance. However, identifying internal mental states is quite challenging as these states are difficult to label, usually short-lived, and generally, overlap with other tasks. One such problem pertains to bistable perception, which we consider to consist of two internal mental states, namely, transition and maintenance. The transition state is short-lived and represents a change in perception while the maintenance state is comparatively longer and represents a stable perception. In this study, we proposed a novel approach for characterizing the duration of transition and maintenance states and classified them from the neuromagnetic brain responses. Participants were presented with various types of ambiguous visual stimuli on which they indicated the moments of perceptual switches, while their magnetoencephalogram (MEG) data were recorded. We extracted different spatio-temporal features based on wavelet transform, and classified transition and maintenance states on a trial-by-trial basis. We obtained a classification accuracy of 79.58{\%} and 78.40{\%} using SVM and ANN classifiers, respectively. Next, we investigated the temporal fluctuations of these internal mental representations as captured by our classifier model and found that the accuracy showed a decreasing trend as the maintenance state was moved towards the next transition state. Further, to identify the neural sources corresponding to these internal mental states, we performed source analysis on MEG signals. We observed the involvement of sources from the parietal lobe, occipital lobe, and cerebellum in distinguishing transition and maintenance states. Cross-conditional classification analysis established generalization potential of wavelet features. Altogether, this study presents an automatic classification of endogenous mental states involved in bistable perception by establishing brain-behavior relationships at the single-trial level.",
keywords = "ANN, Bistable perception, Internal mental states, MEG, Single-trial classification, Source reconstruction, SVM",
author = "Susmita Sen and Daimi, {Syed Naser} and Katsumi Watanabe and Kohske Takahashi and Joydeep Bhattacharya and Goutam Saha",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/s11571-019-09548-7",
language = "English",
journal = "Cognitive Neurodynamics",
issn = "1871-4080",
publisher = "Springer Netherlands",

}

TY - JOUR

T1 - Switch or stay? Automatic classification of internal mental states in bistable perception

AU - Sen, Susmita

AU - Daimi, Syed Naser

AU - Watanabe, Katsumi

AU - Takahashi, Kohske

AU - Bhattacharya, Joydeep

AU - Saha, Goutam

PY - 2019/1/1

Y1 - 2019/1/1

N2 - The human brain goes through numerous cognitive states, most of these being hidden or implicit while performing a task, and understanding them is of great practical importance. However, identifying internal mental states is quite challenging as these states are difficult to label, usually short-lived, and generally, overlap with other tasks. One such problem pertains to bistable perception, which we consider to consist of two internal mental states, namely, transition and maintenance. The transition state is short-lived and represents a change in perception while the maintenance state is comparatively longer and represents a stable perception. In this study, we proposed a novel approach for characterizing the duration of transition and maintenance states and classified them from the neuromagnetic brain responses. Participants were presented with various types of ambiguous visual stimuli on which they indicated the moments of perceptual switches, while their magnetoencephalogram (MEG) data were recorded. We extracted different spatio-temporal features based on wavelet transform, and classified transition and maintenance states on a trial-by-trial basis. We obtained a classification accuracy of 79.58% and 78.40% using SVM and ANN classifiers, respectively. Next, we investigated the temporal fluctuations of these internal mental representations as captured by our classifier model and found that the accuracy showed a decreasing trend as the maintenance state was moved towards the next transition state. Further, to identify the neural sources corresponding to these internal mental states, we performed source analysis on MEG signals. We observed the involvement of sources from the parietal lobe, occipital lobe, and cerebellum in distinguishing transition and maintenance states. Cross-conditional classification analysis established generalization potential of wavelet features. Altogether, this study presents an automatic classification of endogenous mental states involved in bistable perception by establishing brain-behavior relationships at the single-trial level.

AB - The human brain goes through numerous cognitive states, most of these being hidden or implicit while performing a task, and understanding them is of great practical importance. However, identifying internal mental states is quite challenging as these states are difficult to label, usually short-lived, and generally, overlap with other tasks. One such problem pertains to bistable perception, which we consider to consist of two internal mental states, namely, transition and maintenance. The transition state is short-lived and represents a change in perception while the maintenance state is comparatively longer and represents a stable perception. In this study, we proposed a novel approach for characterizing the duration of transition and maintenance states and classified them from the neuromagnetic brain responses. Participants were presented with various types of ambiguous visual stimuli on which they indicated the moments of perceptual switches, while their magnetoencephalogram (MEG) data were recorded. We extracted different spatio-temporal features based on wavelet transform, and classified transition and maintenance states on a trial-by-trial basis. We obtained a classification accuracy of 79.58% and 78.40% using SVM and ANN classifiers, respectively. Next, we investigated the temporal fluctuations of these internal mental representations as captured by our classifier model and found that the accuracy showed a decreasing trend as the maintenance state was moved towards the next transition state. Further, to identify the neural sources corresponding to these internal mental states, we performed source analysis on MEG signals. We observed the involvement of sources from the parietal lobe, occipital lobe, and cerebellum in distinguishing transition and maintenance states. Cross-conditional classification analysis established generalization potential of wavelet features. Altogether, this study presents an automatic classification of endogenous mental states involved in bistable perception by establishing brain-behavior relationships at the single-trial level.

KW - ANN

KW - Bistable perception

KW - Internal mental states

KW - MEG

KW - Single-trial classification

KW - Source reconstruction

KW - SVM

UR - http://www.scopus.com/inward/record.url?scp=85069448285&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069448285&partnerID=8YFLogxK

U2 - 10.1007/s11571-019-09548-7

DO - 10.1007/s11571-019-09548-7

M3 - Article

JO - Cognitive Neurodynamics

JF - Cognitive Neurodynamics

SN - 1871-4080

ER -