Classification of patient's reaction in language assessment during awake craniotomy

Toshihiko Nishimura, Tomoharu Nagao, Hiroshi Iseki, Yoshihiro Muragaki, Manabu Tamura, Shinji Minami

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Surgical video recording is widely used in operation rooms in order to analyze such as surgical procedures and intraoperative incident detection. Therefore, a number of useful operation video records are stored in the hospitals. It is considered that these video records contain significant information, so it is needed to utilize these video data. In awake craniotomy, which is one of the advanced neurological surgery, surgeon peforms direct electrical stimulation to patient's brain area during linguistic tasks(such as, naming objects or generating verbs) in order to detect brain functional areas. The electrical stimulation of the cortical speech area causes temporary speech arrest. Hence, video segments which speech arrest is caused are significant in terms of surgical video analysis. The electrical stimulation timings are obtained from sound information, however that segments are not tagged speech arrest or not. In this paper, we report on the performance of a classification method for classifying patient's response for linguistic tasks just after electrical stimulation. In order to extract patient's speech features, we used melfrequency cepstrum coefficient(MFCC) and its delta parameters which are often used in speech recognition. We used Relevance Vector Machine(RVM) and Support Vector Machine(SVM) for classification and compared their results. We applied RVM and SVM for extracted patient's speech features and evaluated in F-measure. The classifier achieves in classification rates about 80[%] in 10-fold cross validation. The result shows that speech features are effective for classifying patient's responses.

Original languageEnglish
Title of host publication2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages207-212
Number of pages6
ISBN (Print)9781479947706
DOIs
Publication statusPublished - 2014 Dec 16
Externally publishedYes
Event2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Hiroshima
Duration: 2014 Nov 72014 Nov 8

Other

Other2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014
CityHiroshima
Period14/11/714/11/8

Fingerprint

Linguistics
Support vector machines
Brain
Video recording
Speech recognition
Surgery
Classifiers
Acoustic waves

Keywords

  • Awake Craniotomy
  • MFCC
  • Relevance Vector Machine
  • Surgical Records

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications

Cite this

Nishimura, T., Nagao, T., Iseki, H., Muragaki, Y., Tamura, M., & Minami, S. (2014). Classification of patient's reaction in language assessment during awake craniotomy. In 2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings (pp. 207-212). [6988107] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWCIA.2014.6988107

Classification of patient's reaction in language assessment during awake craniotomy. / Nishimura, Toshihiko; Nagao, Tomoharu; Iseki, Hiroshi; Muragaki, Yoshihiro; Tamura, Manabu; Minami, Shinji.

2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. p. 207-212 6988107.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nishimura, T, Nagao, T, Iseki, H, Muragaki, Y, Tamura, M & Minami, S 2014, Classification of patient's reaction in language assessment during awake craniotomy. in 2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings., 6988107, Institute of Electrical and Electronics Engineers Inc., pp. 207-212, 2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014, Hiroshima, 14/11/7. https://doi.org/10.1109/IWCIA.2014.6988107
Nishimura T, Nagao T, Iseki H, Muragaki Y, Tamura M, Minami S. Classification of patient's reaction in language assessment during awake craniotomy. In 2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2014. p. 207-212. 6988107 https://doi.org/10.1109/IWCIA.2014.6988107
Nishimura, Toshihiko ; Nagao, Tomoharu ; Iseki, Hiroshi ; Muragaki, Yoshihiro ; Tamura, Manabu ; Minami, Shinji. / Classification of patient's reaction in language assessment during awake craniotomy. 2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 207-212
@inproceedings{63b6f01ce82c487687377d7736a0c673,
title = "Classification of patient's reaction in language assessment during awake craniotomy",
abstract = "Surgical video recording is widely used in operation rooms in order to analyze such as surgical procedures and intraoperative incident detection. Therefore, a number of useful operation video records are stored in the hospitals. It is considered that these video records contain significant information, so it is needed to utilize these video data. In awake craniotomy, which is one of the advanced neurological surgery, surgeon peforms direct electrical stimulation to patient's brain area during linguistic tasks(such as, naming objects or generating verbs) in order to detect brain functional areas. The electrical stimulation of the cortical speech area causes temporary speech arrest. Hence, video segments which speech arrest is caused are significant in terms of surgical video analysis. The electrical stimulation timings are obtained from sound information, however that segments are not tagged speech arrest or not. In this paper, we report on the performance of a classification method for classifying patient's response for linguistic tasks just after electrical stimulation. In order to extract patient's speech features, we used melfrequency cepstrum coefficient(MFCC) and its delta parameters which are often used in speech recognition. We used Relevance Vector Machine(RVM) and Support Vector Machine(SVM) for classification and compared their results. We applied RVM and SVM for extracted patient's speech features and evaluated in F-measure. The classifier achieves in classification rates about 80[{\%}] in 10-fold cross validation. The result shows that speech features are effective for classifying patient's responses.",
keywords = "Awake Craniotomy, MFCC, Relevance Vector Machine, Surgical Records",
author = "Toshihiko Nishimura and Tomoharu Nagao and Hiroshi Iseki and Yoshihiro Muragaki and Manabu Tamura and Shinji Minami",
year = "2014",
month = "12",
day = "16",
doi = "10.1109/IWCIA.2014.6988107",
language = "English",
isbn = "9781479947706",
pages = "207--212",
booktitle = "2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Classification of patient's reaction in language assessment during awake craniotomy

AU - Nishimura, Toshihiko

AU - Nagao, Tomoharu

AU - Iseki, Hiroshi

AU - Muragaki, Yoshihiro

AU - Tamura, Manabu

AU - Minami, Shinji

PY - 2014/12/16

Y1 - 2014/12/16

N2 - Surgical video recording is widely used in operation rooms in order to analyze such as surgical procedures and intraoperative incident detection. Therefore, a number of useful operation video records are stored in the hospitals. It is considered that these video records contain significant information, so it is needed to utilize these video data. In awake craniotomy, which is one of the advanced neurological surgery, surgeon peforms direct electrical stimulation to patient's brain area during linguistic tasks(such as, naming objects or generating verbs) in order to detect brain functional areas. The electrical stimulation of the cortical speech area causes temporary speech arrest. Hence, video segments which speech arrest is caused are significant in terms of surgical video analysis. The electrical stimulation timings are obtained from sound information, however that segments are not tagged speech arrest or not. In this paper, we report on the performance of a classification method for classifying patient's response for linguistic tasks just after electrical stimulation. In order to extract patient's speech features, we used melfrequency cepstrum coefficient(MFCC) and its delta parameters which are often used in speech recognition. We used Relevance Vector Machine(RVM) and Support Vector Machine(SVM) for classification and compared their results. We applied RVM and SVM for extracted patient's speech features and evaluated in F-measure. The classifier achieves in classification rates about 80[%] in 10-fold cross validation. The result shows that speech features are effective for classifying patient's responses.

AB - Surgical video recording is widely used in operation rooms in order to analyze such as surgical procedures and intraoperative incident detection. Therefore, a number of useful operation video records are stored in the hospitals. It is considered that these video records contain significant information, so it is needed to utilize these video data. In awake craniotomy, which is one of the advanced neurological surgery, surgeon peforms direct electrical stimulation to patient's brain area during linguistic tasks(such as, naming objects or generating verbs) in order to detect brain functional areas. The electrical stimulation of the cortical speech area causes temporary speech arrest. Hence, video segments which speech arrest is caused are significant in terms of surgical video analysis. The electrical stimulation timings are obtained from sound information, however that segments are not tagged speech arrest or not. In this paper, we report on the performance of a classification method for classifying patient's response for linguistic tasks just after electrical stimulation. In order to extract patient's speech features, we used melfrequency cepstrum coefficient(MFCC) and its delta parameters which are often used in speech recognition. We used Relevance Vector Machine(RVM) and Support Vector Machine(SVM) for classification and compared their results. We applied RVM and SVM for extracted patient's speech features and evaluated in F-measure. The classifier achieves in classification rates about 80[%] in 10-fold cross validation. The result shows that speech features are effective for classifying patient's responses.

KW - Awake Craniotomy

KW - MFCC

KW - Relevance Vector Machine

KW - Surgical Records

UR - http://www.scopus.com/inward/record.url?scp=84920713197&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84920713197&partnerID=8YFLogxK

U2 - 10.1109/IWCIA.2014.6988107

DO - 10.1109/IWCIA.2014.6988107

M3 - Conference contribution

AN - SCOPUS:84920713197

SN - 9781479947706

SP - 207

EP - 212

BT - 2014 IEEE 7th International Workshop on Computational Intelligence and Applications, IWCIA 2014 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -