Decoding syllables from human fMRI activity

Yohei Otaka, Rieko Osu, Mitsuo Kawato, Meigen Liu, Satoshi Murata, Yukiyasu Kamitani

研究成果: Conference contribution

2 引用 (Scopus)

抜粋

Language plays essential roles in human cognition and social communication, and therefore technology of reading out speech using non-invasively measured brain activity will have both scientific and clinical merits. Here, we examined whether it is possible to decode each syllable from human fMRI activity. Four healthy subjects participated in the experiments. In a decoding session, the subjects repeatedly uttered a syllable presented on a screen at 3Hz for a 12-s block. Nine different syllables are presented in a single experimental run which was repeated 8 times. We also specified the voxels which showed articulation-related activities by utterance of all the syllables in Japanese phonology in a conventional task-rest sequence. Then, we used either all of these voxels or a part of these voxels that exist in anatomically specified ROIs (M1, cerebellum) during decoding sessions as data samples for training and testing a decoder (linear support vector machine) that classifies brain activity patterns for different syllables. To evaluate decoding performance, we performed cross-validation by testing the sample of one decoding session using a decoder trained with the samples of the remaining sessions. As a result, syllables were correctly decoded at above-chance levels. The results suggest the possibility of using non-invasively measured brain activity to read out the intended speech of disabled patients in speech motor control.

元の言語English
ホスト出版物のタイトルNeural Information Processing - 14th International Conference, ICONIP 2007, Revised Selected Papers
ページ979-986
ページ数8
エディションPART 2
DOI
出版物ステータスPublished - 2008 10 23
外部発表Yes
イベント14th International Conference on Neural Information Processing, ICONIP 2007 - Kitakyushu, Japan
継続期間: 2007 11 132007 11 16

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
番号PART 2
4985 LNCS
ISSN(印刷物)0302-9743
ISSN(電子版)1611-3349

Conference

Conference14th International Conference on Neural Information Processing, ICONIP 2007
Japan
Kitakyushu
期間07/11/1307/11/16

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント Decoding syllables from human fMRI activity' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Otaka, Y., Osu, R., Kawato, M., Liu, M., Murata, S., & Kamitani, Y. (2008). Decoding syllables from human fMRI activity. : Neural Information Processing - 14th International Conference, ICONIP 2007, Revised Selected Papers (PART 2 版, pp. 979-986). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 4985 LNCS, 番号 PART 2). https://doi.org/10.1007/978-3-540-69162-4_102