Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation

Satoshi Miura; Yuya Matsumoto; Yo Kobayashi; Kazuya Kawamura; Yasutaka Nakashima; Masakatsu G. Fujie

doi:10.1109/EMBC.2015.7318250

Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation

Satoshi Miura, Yuya Matsumoto, Yo Kobayashi, Kazuya Kawamura, Yasutaka Nakashima, Masakatsu G. Fujie

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p

Original language	English
Title of host publication	Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	17-20
Number of pages	4
Volume	2015-November
ISBN (Print)	9781424492718
DOIs	https://doi.org/10.1109/EMBC.2015.7318250
Publication status	Published - 2015 Nov 4
Event	37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 - Milan, Italy Duration: 2015 Aug 25 → 2015 Aug 29

Other

Other	37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
Country	Italy
City	Milan
Period	15/8/25 → 15/8/29

Fingerprint

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Signal Processing
Biomedical Engineering
Health Informatics

Cite this

Miura, S., Matsumoto, Y., Kobayashi, Y., Kawamura, K., Nakashima, Y., & Fujie, M. G. (2015). Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS (Vol. 2015-November, pp. 17-20). [7318250] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2015.7318250

Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. / Miura, Satoshi; Matsumoto, Yuya; Kobayashi, Yo; Kawamura, Kazuya; Nakashima, Yasutaka; Fujie, Masakatsu G.

Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November Institute of Electrical and Electronics Engineers Inc., 2015. p. 17-20 7318250.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Miura, S, Matsumoto, Y, Kobayashi, Y, Kawamura, K, Nakashima, Y & Fujie, MG 2015, Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. vol. 2015-November, 7318250, Institute of Electrical and Electronics Engineers Inc., pp. 17-20, 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015, Milan, Italy, 15/8/25. https://doi.org/10.1109/EMBC.2015.7318250

Miura S, Matsumoto Y, Kobayashi Y, Kawamura K, Nakashima Y, Fujie MG. Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November. Institute of Electrical and Electronics Engineers Inc. 2015. p. 17-20. 7318250 https://doi.org/10.1109/EMBC.2015.7318250

Miura, Satoshi ; Matsumoto, Yuya ; Kobayashi, Yo ; Kawamura, Kazuya ; Nakashima, Yasutaka ; Fujie, Masakatsu G. / Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November Institute of Electrical and Electronics Engineers Inc., 2015. pp. 17-20

@inproceedings{1f95fb4132154551a695e47c6af1e6e8,

title = "Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation",

abstract = "This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p",

author = "Satoshi Miura and Yuya Matsumoto and Yo Kobayashi and Kazuya Kawamura and Yasutaka Nakashima and Fujie, {Masakatsu G.}",

year = "2015",

month = nov,

day = "4",

doi = "10.1109/EMBC.2015.7318250",

language = "English",

isbn = "9781424492718",

volume = "2015-November",

pages = "17--20",

booktitle = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 ; Conference date: 25-08-2015 Through 29-08-2015",

}

TY - GEN

T1 - Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation

AU - Miura, Satoshi

AU - Matsumoto, Yuya

AU - Kobayashi, Yo

AU - Kawamura, Kazuya

AU - Nakashima, Yasutaka

AU - Fujie, Masakatsu G.

PY - 2015/11/4

Y1 - 2015/11/4

N2 - This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p

AB - This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p

UR - http://www.scopus.com/inward/record.url?scp=84953216111&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84953216111&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2015.7318250

DO - 10.1109/EMBC.2015.7318250

M3 - Conference contribution

C2 - 26736190

AN - SCOPUS:84953216111

SN - 9781424492718

VL - 2015-November

SP - 17

EP - 20

BT - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015

Y2 - 25 August 2015 through 29 August 2015

ER -

Access to Document

10.1109/EMBC.2015.7318250