Gaze pattern analysis in multi-display systems for teleoperated disaster response robots

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3534-3539
Number of pages6
ISBN (Electronic)9781509018970
DOIs
Publication statusPublished - 2017 Feb 6
Event2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Budapest, Hungary
Duration: 2016 Oct 92016 Oct 12

Other

Other2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016
CountryHungary
CityBudapest
Period16/10/916/10/12

Fingerprint

Pattern Analysis
Disaster
Disasters
Display
Robot
Display devices
Robots
Debris
Virtual reality
Operator
Cognitive Load
Simulators
Cameras
Grasping
Control systems
Hierarchical Clustering
Virtual Reality
Simulator
Choose
Camera

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence
  • Control and Optimization
  • Human-Computer Interaction

Cite this

Sato, R., Kamezaki, M., Sugano, S., & Iwata, H. (2017). Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. In 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings (pp. 3534-3539). [7844780] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2016.7844780

Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. / Sato, Ryuya; Kamezaki, Mitsuhiro; Sugano, Shigeki; Iwata, Hiroyasu.

2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. p. 3534-3539 7844780.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sato, R, Kamezaki, M, Sugano, S & Iwata, H 2017, Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. in 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings., 7844780, Institute of Electrical and Electronics Engineers Inc., pp. 3534-3539, 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016, Budapest, Hungary, 16/10/9. https://doi.org/10.1109/SMC.2016.7844780
Sato R, Kamezaki M, Sugano S, Iwata H. Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. In 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2017. p. 3534-3539. 7844780 https://doi.org/10.1109/SMC.2016.7844780
Sato, Ryuya ; Kamezaki, Mitsuhiro ; Sugano, Shigeki ; Iwata, Hiroyasu. / Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 3534-3539
@inproceedings{3980b9916639480594fc474618e36737,
title = "Gaze pattern analysis in multi-display systems for teleoperated disaster response robots",
abstract = "In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.",
author = "Ryuya Sato and Mitsuhiro Kamezaki and Shigeki Sugano and Hiroyasu Iwata",
year = "2017",
month = "2",
day = "6",
doi = "10.1109/SMC.2016.7844780",
language = "English",
pages = "3534--3539",
booktitle = "2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - Gaze pattern analysis in multi-display systems for teleoperated disaster response robots

AU - Sato, Ryuya

AU - Kamezaki, Mitsuhiro

AU - Sugano, Shigeki

AU - Iwata, Hiroyasu

PY - 2017/2/6

Y1 - 2017/2/6

N2 - In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.

AB - In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.

UR - http://www.scopus.com/inward/record.url?scp=85015790393&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015790393&partnerID=8YFLogxK

U2 - 10.1109/SMC.2016.7844780

DO - 10.1109/SMC.2016.7844780

M3 - Conference contribution

SP - 3534

EP - 3539

BT - 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -