Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation

Satoshi Miura, Yuya Matsumoto, Yo Kobayashi, Kazuya Kawamura, Yasutaka Nakashima, Masakatsu G. Fujie

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p

    Original languageEnglish
    Title of host publicationProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages17-20
    Number of pages4
    Volume2015-November
    ISBN (Print)9781424492718
    DOIs
    Publication statusPublished - 2015 Nov 4
    Event37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 - Milan, Italy
    Duration: 2015 Aug 252015 Aug 29

    Other

    Other37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
    CountryItaly
    CityMilan
    Period15/8/2515/8/29

    Fingerprint

    Sensory feedback
    Sensory Feedback
    Parietal Lobe
    Brain
    Arm
    Feedback
    Hand
    Neuroimaging
    End effectors
    Topography
    Simulators
    Chemical activation
    Robotic surgery
    Infrared radiation
    Imaging techniques
    Controllers
    Experiments

    ASJC Scopus subject areas

    • Computer Vision and Pattern Recognition
    • Signal Processing
    • Biomedical Engineering
    • Health Informatics

    Cite this

    Miura, S., Matsumoto, Y., Kobayashi, Y., Kawamura, K., Nakashima, Y., & Fujie, M. G. (2015). Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS (Vol. 2015-November, pp. 17-20). [7318250] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2015.7318250

    Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. / Miura, Satoshi; Matsumoto, Yuya; Kobayashi, Yo; Kawamura, Kazuya; Nakashima, Yasutaka; Fujie, Masakatsu G.

    Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November Institute of Electrical and Electronics Engineers Inc., 2015. p. 17-20 7318250.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Miura, S, Matsumoto, Y, Kobayashi, Y, Kawamura, K, Nakashima, Y & Fujie, MG 2015, Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. vol. 2015-November, 7318250, Institute of Electrical and Electronics Engineers Inc., pp. 17-20, 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015, Milan, Italy, 15/8/25. https://doi.org/10.1109/EMBC.2015.7318250
    Miura S, Matsumoto Y, Kobayashi Y, Kawamura K, Nakashima Y, Fujie MG. Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November. Institute of Electrical and Electronics Engineers Inc. 2015. p. 17-20. 7318250 https://doi.org/10.1109/EMBC.2015.7318250
    Miura, Satoshi ; Matsumoto, Yuya ; Kobayashi, Yo ; Kawamura, Kazuya ; Nakashima, Yasutaka ; Fujie, Masakatsu G. / Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November Institute of Electrical and Electronics Engineers Inc., 2015. pp. 17-20
    @inproceedings{1f95fb4132154551a695e47c6af1e6e8,
    title = "Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation",
    abstract = "This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p",
    author = "Satoshi Miura and Yuya Matsumoto and Yo Kobayashi and Kazuya Kawamura and Yasutaka Nakashima and Fujie, {Masakatsu G.}",
    year = "2015",
    month = "11",
    day = "4",
    doi = "10.1109/EMBC.2015.7318250",
    language = "English",
    isbn = "9781424492718",
    volume = "2015-November",
    pages = "17--20",
    booktitle = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",

    }

    TY - GEN

    T1 - Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation

    AU - Miura, Satoshi

    AU - Matsumoto, Yuya

    AU - Kobayashi, Yo

    AU - Kawamura, Kazuya

    AU - Nakashima, Yasutaka

    AU - Fujie, Masakatsu G.

    PY - 2015/11/4

    Y1 - 2015/11/4

    N2 - This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p

    AB - This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p

    UR - http://www.scopus.com/inward/record.url?scp=84953216111&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84953216111&partnerID=8YFLogxK

    U2 - 10.1109/EMBC.2015.7318250

    DO - 10.1109/EMBC.2015.7318250

    M3 - Conference contribution

    C2 - 26736190

    AN - SCOPUS:84953216111

    SN - 9781424492718

    VL - 2015-November

    SP - 17

    EP - 20

    BT - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -