Driver confusion status detection using recurrent neural networks

Chiori Hori, Shinji Watanabe, Takaaki Hori, Bret A. Harsham, Johnr Hershey, Yusuke Koji, Yoichi Fujii, Yuki Furumoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

In this paper, we present a method for estimating the confusion level of a driver using a classifier trained on multimodal sensor data. Using the driver confusion status detector, a car navigation system can proactively support the driver when he/she is confused. A corpus of data was collected during on-road driving in traffic using a navigation system and a car instrumented with a variety of sensors. The data was manually annotated with the driver's confusion status and with multiple features representing driver's behavior and the traffic conditions. We compared different types of classifiers trained from the data: logistic regression, a feed-forward neural network, a recurrent neural networks, and a long short-term memory (LSTM)-based recurrent neural network. The accuracy was evaluated using F-max as well as precision/recall. We found that the LSTM outperformed the other models.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Multimedia and Expo, ICME 2016
PublisherIEEE Computer Society
ISBN (Electronic)9781467372589
DOIs
Publication statusPublished - 2016 Aug 25
Externally publishedYes
Event2016 IEEE International Conference on Multimedia and Expo, ICME 2016 - Seattle, United States
Duration: 2016 Jul 112016 Jul 15

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
Volume2016-August
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Other

Other2016 IEEE International Conference on Multimedia and Expo, ICME 2016
Country/TerritoryUnited States
CitySeattle
Period16/7/1116/7/15

Keywords

  • driver confusion status prediction
  • long short-term memory
  • multimodal processing
  • recurrent neural network

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Driver confusion status detection using recurrent neural networks'. Together they form a unique fingerprint.

Cite this