Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles

Udara E. Manawadu, Hiroaki Hayashi, Takaaki Ema, Takahiro Kawano, Mitsuhiro Kamezaki, Shigeki Sugano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Automated vehicles operating in level 3 may request the human driver to intervene in certain situations due to system limitations. Unscheduled transferring of control to manual driving will create safety issues as consequences of inadequate situational awareness and sudden increase of driver workload. In this study, we propose and evaluate tactical-level input (TLI) method with a multimodal human-machine interface (HMI) for driver intervention in short-term system limitations. The HMI system consists of touchscreen, gesture, and haptic interfaces enabling bilateral driver-vehicle interaction. TLI along with the HMI capable of multimodal feedback can provide situation-adaptive spatial information which enhance the driver situational awareness in a short time. To evaluate the proposed system we conducted driving experiments involving unscheduled takeover situations in urban environment using a driving simulator. We analyzed driver reaction times, physiological responses including heart rate, skin conductance and subjective workload as well as qualitative feedback comparing with manual takeover. The results show that TLI can reduce driver workload, reaction times, and improve driver behavior. Moreover, 90% of drivers preferred to use TLI method over manual takeover.

Original languageEnglish
Title of host publicationAIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages634-639
Number of pages6
Volume2018-July
ISBN (Print)9781538618547
DOIs
Publication statusPublished - 2018 Aug 30
Event2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2018 - Auckland, New Zealand
Duration: 2018 Jul 92018 Jul 12

Other

Other2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2018
CountryNew Zealand
CityAuckland
Period18/7/918/7/12

Fingerprint

Feedback
Haptic interfaces
Touch screens
Skin
Simulators
Experiments

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Computer Science Applications
  • Software

Cite this

Manawadu, U. E., Hayashi, H., Ema, T., Kawano, T., Kamezaki, M., & Sugano, S. (2018). Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles. In AIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Vol. 2018-July, pp. 634-639). [8452227] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/AIM.2018.8452227

Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles. / Manawadu, Udara E.; Hayashi, Hiroaki; Ema, Takaaki; Kawano, Takahiro; Kamezaki, Mitsuhiro; Sugano, Shigeki.

AIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Vol. 2018-July Institute of Electrical and Electronics Engineers Inc., 2018. p. 634-639 8452227.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Manawadu, UE, Hayashi, H, Ema, T, Kawano, T, Kamezaki, M & Sugano, S 2018, Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles. in AIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics. vol. 2018-July, 8452227, Institute of Electrical and Electronics Engineers Inc., pp. 634-639, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2018, Auckland, New Zealand, 18/7/9. https://doi.org/10.1109/AIM.2018.8452227
Manawadu UE, Hayashi H, Ema T, Kawano T, Kamezaki M, Sugano S. Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles. In AIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Vol. 2018-July. Institute of Electrical and Electronics Engineers Inc. 2018. p. 634-639. 8452227 https://doi.org/10.1109/AIM.2018.8452227
Manawadu, Udara E. ; Hayashi, Hiroaki ; Ema, Takaaki ; Kawano, Takahiro ; Kamezaki, Mitsuhiro ; Sugano, Shigeki. / Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles. AIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Vol. 2018-July Institute of Electrical and Electronics Engineers Inc., 2018. pp. 634-639
@inproceedings{6b7c24c0c28c406fa6841834bd5b96cc,
title = "Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles",
abstract = "Automated vehicles operating in level 3 may request the human driver to intervene in certain situations due to system limitations. Unscheduled transferring of control to manual driving will create safety issues as consequences of inadequate situational awareness and sudden increase of driver workload. In this study, we propose and evaluate tactical-level input (TLI) method with a multimodal human-machine interface (HMI) for driver intervention in short-term system limitations. The HMI system consists of touchscreen, gesture, and haptic interfaces enabling bilateral driver-vehicle interaction. TLI along with the HMI capable of multimodal feedback can provide situation-adaptive spatial information which enhance the driver situational awareness in a short time. To evaluate the proposed system we conducted driving experiments involving unscheduled takeover situations in urban environment using a driving simulator. We analyzed driver reaction times, physiological responses including heart rate, skin conductance and subjective workload as well as qualitative feedback comparing with manual takeover. The results show that TLI can reduce driver workload, reaction times, and improve driver behavior. Moreover, 90{\%} of drivers preferred to use TLI method over manual takeover.",
author = "Manawadu, {Udara E.} and Hiroaki Hayashi and Takaaki Ema and Takahiro Kawano and Mitsuhiro Kamezaki and Shigeki Sugano",
year = "2018",
month = "8",
day = "30",
doi = "10.1109/AIM.2018.8452227",
language = "English",
isbn = "9781538618547",
volume = "2018-July",
pages = "634--639",
booktitle = "AIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Tactical-level input with multimodal feedback for unscheduled takeover situations in human-centered automated vehicles

AU - Manawadu, Udara E.

AU - Hayashi, Hiroaki

AU - Ema, Takaaki

AU - Kawano, Takahiro

AU - Kamezaki, Mitsuhiro

AU - Sugano, Shigeki

PY - 2018/8/30

Y1 - 2018/8/30

N2 - Automated vehicles operating in level 3 may request the human driver to intervene in certain situations due to system limitations. Unscheduled transferring of control to manual driving will create safety issues as consequences of inadequate situational awareness and sudden increase of driver workload. In this study, we propose and evaluate tactical-level input (TLI) method with a multimodal human-machine interface (HMI) for driver intervention in short-term system limitations. The HMI system consists of touchscreen, gesture, and haptic interfaces enabling bilateral driver-vehicle interaction. TLI along with the HMI capable of multimodal feedback can provide situation-adaptive spatial information which enhance the driver situational awareness in a short time. To evaluate the proposed system we conducted driving experiments involving unscheduled takeover situations in urban environment using a driving simulator. We analyzed driver reaction times, physiological responses including heart rate, skin conductance and subjective workload as well as qualitative feedback comparing with manual takeover. The results show that TLI can reduce driver workload, reaction times, and improve driver behavior. Moreover, 90% of drivers preferred to use TLI method over manual takeover.

AB - Automated vehicles operating in level 3 may request the human driver to intervene in certain situations due to system limitations. Unscheduled transferring of control to manual driving will create safety issues as consequences of inadequate situational awareness and sudden increase of driver workload. In this study, we propose and evaluate tactical-level input (TLI) method with a multimodal human-machine interface (HMI) for driver intervention in short-term system limitations. The HMI system consists of touchscreen, gesture, and haptic interfaces enabling bilateral driver-vehicle interaction. TLI along with the HMI capable of multimodal feedback can provide situation-adaptive spatial information which enhance the driver situational awareness in a short time. To evaluate the proposed system we conducted driving experiments involving unscheduled takeover situations in urban environment using a driving simulator. We analyzed driver reaction times, physiological responses including heart rate, skin conductance and subjective workload as well as qualitative feedback comparing with manual takeover. The results show that TLI can reduce driver workload, reaction times, and improve driver behavior. Moreover, 90% of drivers preferred to use TLI method over manual takeover.

UR - http://www.scopus.com/inward/record.url?scp=85053891108&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053891108&partnerID=8YFLogxK

U2 - 10.1109/AIM.2018.8452227

DO - 10.1109/AIM.2018.8452227

M3 - Conference contribution

SN - 9781538618547

VL - 2018-July

SP - 634

EP - 639

BT - AIM 2018 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics

PB - Institute of Electrical and Electronics Engineers Inc.

ER -