Pupil Variation Applied to the Eye Tracking Control of an Endoscopic Manipulator

Yang Cao, Satoshi Miura, Yo Kobayashi, Kazuya Kawamura, Shigeki Sugano, Masakatsu G. Fujie

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

In laparoscopic surgery, numerous devices have been developed to allow surgeons to manipulate the laparoscope by themselves. Some previously adopted approaches include hands-free strategies, such as eye tracking. In this letter, we propose a new approach for the control of an endoscopic manipulator using pupil variation, which has not been previously attempted. We developed an intention recognition system for an endoscopic manipulator based on a support vector machine (SVM) and a probabilistic neural network (PNN). The SVM classifier, trained on pupil variation and eye rotation velocity data, recognizes when the operator wants to alter the direction of the endoscope. The PNN classifier determines in which direction the operator wants to move. We set up an experimental task to evaluate our proposal, and conclude that pupil variation has a significant effect on judging the timing for activating the endoscopic manipulator to project the operative field onto the center of the visual field on monitor. Moreover, it shows better performance than endoscope manipulation by an assistant.

Original languageEnglish
Article number7393466
Pages (from-to)531-538
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume1
Issue number1
DOIs
Publication statusPublished - 2016 Jan 1

Fingerprint

Eye Tracking
Tracking Control
Manipulator
Manipulators
Endoscope
Probabilistic Neural Network
Endoscopy
Support vector machines
Support Vector Machine
Classifiers
Classifier
Laparoscopy
Neural networks
Operator
Surgery
Manipulation
Timing
Monitor
Evaluate

Keywords

  • Cognitive Human-Robot Interaction
  • Recognition
  • Surgical Robotics: Laparoscopy

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Human-Computer Interaction
  • Biomedical Engineering
  • Mechanical Engineering
  • Control and Optimization
  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Cite this

Pupil Variation Applied to the Eye Tracking Control of an Endoscopic Manipulator. / Cao, Yang; Miura, Satoshi; Kobayashi, Yo; Kawamura, Kazuya; Sugano, Shigeki; Fujie, Masakatsu G.

In: IEEE Robotics and Automation Letters, Vol. 1, No. 1, 7393466, 01.01.2016, p. 531-538.

Research output: Contribution to journalArticle

Cao, Yang ; Miura, Satoshi ; Kobayashi, Yo ; Kawamura, Kazuya ; Sugano, Shigeki ; Fujie, Masakatsu G. / Pupil Variation Applied to the Eye Tracking Control of an Endoscopic Manipulator. In: IEEE Robotics and Automation Letters. 2016 ; Vol. 1, No. 1. pp. 531-538.
@article{e2dd4157b67d4a02af0abd67561f24ba,
title = "Pupil Variation Applied to the Eye Tracking Control of an Endoscopic Manipulator",
abstract = "In laparoscopic surgery, numerous devices have been developed to allow surgeons to manipulate the laparoscope by themselves. Some previously adopted approaches include hands-free strategies, such as eye tracking. In this letter, we propose a new approach for the control of an endoscopic manipulator using pupil variation, which has not been previously attempted. We developed an intention recognition system for an endoscopic manipulator based on a support vector machine (SVM) and a probabilistic neural network (PNN). The SVM classifier, trained on pupil variation and eye rotation velocity data, recognizes when the operator wants to alter the direction of the endoscope. The PNN classifier determines in which direction the operator wants to move. We set up an experimental task to evaluate our proposal, and conclude that pupil variation has a significant effect on judging the timing for activating the endoscopic manipulator to project the operative field onto the center of the visual field on monitor. Moreover, it shows better performance than endoscope manipulation by an assistant.",
keywords = "Cognitive Human-Robot Interaction, Recognition, Surgical Robotics: Laparoscopy",
author = "Yang Cao and Satoshi Miura and Yo Kobayashi and Kazuya Kawamura and Shigeki Sugano and Fujie, {Masakatsu G.}",
year = "2016",
month = "1",
day = "1",
doi = "10.1109/LRA.2016.2521894",
language = "English",
volume = "1",
pages = "531--538",
journal = "IEEE Robotics and Automation Letters",
issn = "2377-3766",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Pupil Variation Applied to the Eye Tracking Control of an Endoscopic Manipulator

AU - Cao, Yang

AU - Miura, Satoshi

AU - Kobayashi, Yo

AU - Kawamura, Kazuya

AU - Sugano, Shigeki

AU - Fujie, Masakatsu G.

PY - 2016/1/1

Y1 - 2016/1/1

N2 - In laparoscopic surgery, numerous devices have been developed to allow surgeons to manipulate the laparoscope by themselves. Some previously adopted approaches include hands-free strategies, such as eye tracking. In this letter, we propose a new approach for the control of an endoscopic manipulator using pupil variation, which has not been previously attempted. We developed an intention recognition system for an endoscopic manipulator based on a support vector machine (SVM) and a probabilistic neural network (PNN). The SVM classifier, trained on pupil variation and eye rotation velocity data, recognizes when the operator wants to alter the direction of the endoscope. The PNN classifier determines in which direction the operator wants to move. We set up an experimental task to evaluate our proposal, and conclude that pupil variation has a significant effect on judging the timing for activating the endoscopic manipulator to project the operative field onto the center of the visual field on monitor. Moreover, it shows better performance than endoscope manipulation by an assistant.

AB - In laparoscopic surgery, numerous devices have been developed to allow surgeons to manipulate the laparoscope by themselves. Some previously adopted approaches include hands-free strategies, such as eye tracking. In this letter, we propose a new approach for the control of an endoscopic manipulator using pupil variation, which has not been previously attempted. We developed an intention recognition system for an endoscopic manipulator based on a support vector machine (SVM) and a probabilistic neural network (PNN). The SVM classifier, trained on pupil variation and eye rotation velocity data, recognizes when the operator wants to alter the direction of the endoscope. The PNN classifier determines in which direction the operator wants to move. We set up an experimental task to evaluate our proposal, and conclude that pupil variation has a significant effect on judging the timing for activating the endoscopic manipulator to project the operative field onto the center of the visual field on monitor. Moreover, it shows better performance than endoscope manipulation by an assistant.

KW - Cognitive Human-Robot Interaction

KW - Recognition

KW - Surgical Robotics: Laparoscopy

UR - http://www.scopus.com/inward/record.url?scp=85058585420&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058585420&partnerID=8YFLogxK

U2 - 10.1109/LRA.2016.2521894

DO - 10.1109/LRA.2016.2521894

M3 - Article

VL - 1

SP - 531

EP - 538

JO - IEEE Robotics and Automation Letters

JF - IEEE Robotics and Automation Letters

SN - 2377-3766

IS - 1

M1 - 7393466

ER -