A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle

Udara E. Manawadu, Mitsuhiro Kamezaki, Masaaki Ishikawa, Takahiro Kawano, Shigeki Sugano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Autonomous vehicles would make the future roads safer by keeping the human driver out of the loop. However, reduced degree of human-control could result in loss of the feeling of driving for some drivers. Therefore, in this study we proposed a method of interaction between the driver and autonomous vehicle by allowing the driver to control the vehicle's lateral and longitudinal motions. We adopted hand gestures as input modality because it can reduce driver's visual and cognitive demands. We first derived seven fundamental vehicle maneuvers to improve driver experience, and related them to seven independent hand gestures. We then created a hand gesture interface to control an autonomous vehicle, using Leap Motion as the gesture recognition platform. We conducted driving experiments involving twenty drivers in a virtual reality driving simulator to investigate the effectiveness of this interface for vehicle control. We evaluated the driving experience and drivers' opinions regarding the gestural interface. The results proved that semi-autonomous controlling using the hand gesture interface significantly reduced drivers' perceived workload.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1785-1790
Number of pages6
ISBN (Electronic)9781509018970
DOIs
Publication statusPublished - 2017 Feb 6
Event2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Budapest, Hungary
Duration: 2016 Oct 92016 Oct 12

Other

Other2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016
CountryHungary
CityBudapest
Period16/10/916/10/12

Fingerprint

Autonomous Vehicles
Gesture
Driver
Lateral
Motion
Gesture recognition
Virtual reality
Driving Simulator
Gesture Recognition
Simulators
Virtual Reality
Modality
Workload
Experiments

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence
  • Control and Optimization
  • Human-Computer Interaction

Cite this

Manawadu, U. E., Kamezaki, M., Ishikawa, M., Kawano, T., & Sugano, S. (2017). A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle. In 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings (pp. 1785-1790). [7844497] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2016.7844497

A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle. / Manawadu, Udara E.; Kamezaki, Mitsuhiro; Ishikawa, Masaaki; Kawano, Takahiro; Sugano, Shigeki.

2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. p. 1785-1790 7844497.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Manawadu, UE, Kamezaki, M, Ishikawa, M, Kawano, T & Sugano, S 2017, A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle. in 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings., 7844497, Institute of Electrical and Electronics Engineers Inc., pp. 1785-1790, 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016, Budapest, Hungary, 16/10/9. https://doi.org/10.1109/SMC.2016.7844497
Manawadu UE, Kamezaki M, Ishikawa M, Kawano T, Sugano S. A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle. In 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1785-1790. 7844497 https://doi.org/10.1109/SMC.2016.7844497
Manawadu, Udara E. ; Kamezaki, Mitsuhiro ; Ishikawa, Masaaki ; Kawano, Takahiro ; Sugano, Shigeki. / A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle. 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1785-1790
@inproceedings{c499a8b55df446c9ba539639045b5b82,
title = "A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle",
abstract = "Autonomous vehicles would make the future roads safer by keeping the human driver out of the loop. However, reduced degree of human-control could result in loss of the feeling of driving for some drivers. Therefore, in this study we proposed a method of interaction between the driver and autonomous vehicle by allowing the driver to control the vehicle's lateral and longitudinal motions. We adopted hand gestures as input modality because it can reduce driver's visual and cognitive demands. We first derived seven fundamental vehicle maneuvers to improve driver experience, and related them to seven independent hand gestures. We then created a hand gesture interface to control an autonomous vehicle, using Leap Motion as the gesture recognition platform. We conducted driving experiments involving twenty drivers in a virtual reality driving simulator to investigate the effectiveness of this interface for vehicle control. We evaluated the driving experience and drivers' opinions regarding the gestural interface. The results proved that semi-autonomous controlling using the hand gesture interface significantly reduced drivers' perceived workload.",
author = "Manawadu, {Udara E.} and Mitsuhiro Kamezaki and Masaaki Ishikawa and Takahiro Kawano and Shigeki Sugano",
year = "2017",
month = "2",
day = "6",
doi = "10.1109/SMC.2016.7844497",
language = "English",
pages = "1785--1790",
booktitle = "2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle

AU - Manawadu, Udara E.

AU - Kamezaki, Mitsuhiro

AU - Ishikawa, Masaaki

AU - Kawano, Takahiro

AU - Sugano, Shigeki

PY - 2017/2/6

Y1 - 2017/2/6

N2 - Autonomous vehicles would make the future roads safer by keeping the human driver out of the loop. However, reduced degree of human-control could result in loss of the feeling of driving for some drivers. Therefore, in this study we proposed a method of interaction between the driver and autonomous vehicle by allowing the driver to control the vehicle's lateral and longitudinal motions. We adopted hand gestures as input modality because it can reduce driver's visual and cognitive demands. We first derived seven fundamental vehicle maneuvers to improve driver experience, and related them to seven independent hand gestures. We then created a hand gesture interface to control an autonomous vehicle, using Leap Motion as the gesture recognition platform. We conducted driving experiments involving twenty drivers in a virtual reality driving simulator to investigate the effectiveness of this interface for vehicle control. We evaluated the driving experience and drivers' opinions regarding the gestural interface. The results proved that semi-autonomous controlling using the hand gesture interface significantly reduced drivers' perceived workload.

AB - Autonomous vehicles would make the future roads safer by keeping the human driver out of the loop. However, reduced degree of human-control could result in loss of the feeling of driving for some drivers. Therefore, in this study we proposed a method of interaction between the driver and autonomous vehicle by allowing the driver to control the vehicle's lateral and longitudinal motions. We adopted hand gestures as input modality because it can reduce driver's visual and cognitive demands. We first derived seven fundamental vehicle maneuvers to improve driver experience, and related them to seven independent hand gestures. We then created a hand gesture interface to control an autonomous vehicle, using Leap Motion as the gesture recognition platform. We conducted driving experiments involving twenty drivers in a virtual reality driving simulator to investigate the effectiveness of this interface for vehicle control. We evaluated the driving experience and drivers' opinions regarding the gestural interface. The results proved that semi-autonomous controlling using the hand gesture interface significantly reduced drivers' perceived workload.

UR - http://www.scopus.com/inward/record.url?scp=85015749583&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015749583&partnerID=8YFLogxK

U2 - 10.1109/SMC.2016.7844497

DO - 10.1109/SMC.2016.7844497

M3 - Conference contribution

SP - 1785

EP - 1790

BT - 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -