Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism

Tsuyoshi Sakuma, Satoshi Miura, Tomoyuki Miyashita, Masakatsu G. Fujie, Shigeki Sugano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94%) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.

Original languageEnglish
Title of host publicationProceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages770-775
Number of pages6
ISBN (Electronic)9781538636152
DOIs
Publication statusPublished - 2019 Apr 25
Event2019 IEEE/SICE International Symposium on System Integration, SII 2019 - Paris, France
Duration: 2019 Jan 142019 Jan 16

Publication series

NameProceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019

Conference

Conference2019 IEEE/SICE International Symposium on System Integration, SII 2019
CountryFrance
CityParis
Period19/1/1419/1/16

Fingerprint

decision making
brain
Brain
Decision making
learning
control stability
sensory feedback
brakes
Reinforcement learning
reinforcement
Brakes
Teaching
education
electronics

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Electrical and Electronic Engineering

Cite this

Sakuma, T., Miura, S., Miyashita, T., Fujie, M. G., & Sugano, S. (2019). Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. In Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019 (pp. 770-775). [8700430] (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SII.2019.8700430

Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. / Sakuma, Tsuyoshi; Miura, Satoshi; Miyashita, Tomoyuki; Fujie, Masakatsu G.; Sugano, Shigeki.

Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 770-775 8700430 (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sakuma, T, Miura, S, Miyashita, T, Fujie, MG & Sugano, S 2019, Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. in Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019., 8700430, Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019, Institute of Electrical and Electronics Engineers Inc., pp. 770-775, 2019 IEEE/SICE International Symposium on System Integration, SII 2019, Paris, France, 19/1/14. https://doi.org/10.1109/SII.2019.8700430
Sakuma T, Miura S, Miyashita T, Fujie MG, Sugano S. Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. In Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 770-775. 8700430. (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019). https://doi.org/10.1109/SII.2019.8700430
Sakuma, Tsuyoshi ; Miura, Satoshi ; Miyashita, Tomoyuki ; Fujie, Masakatsu G. ; Sugano, Shigeki. / Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 770-775 (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019).
@inproceedings{c9ca842e29ee42ef9b66d8e39287deda,
title = "Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism",
abstract = "Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94{\%}) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.",
author = "Tsuyoshi Sakuma and Satoshi Miura and Tomoyuki Miyashita and Fujie, {Masakatsu G.} and Shigeki Sugano",
year = "2019",
month = "4",
day = "25",
doi = "10.1109/SII.2019.8700430",
language = "English",
series = "Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "770--775",
booktitle = "Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019",

}

TY - GEN

T1 - Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism

AU - Sakuma, Tsuyoshi

AU - Miura, Satoshi

AU - Miyashita, Tomoyuki

AU - Fujie, Masakatsu G.

AU - Sugano, Shigeki

PY - 2019/4/25

Y1 - 2019/4/25

N2 - Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94%) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.

AB - Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94%) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.

UR - http://www.scopus.com/inward/record.url?scp=85065641994&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065641994&partnerID=8YFLogxK

U2 - 10.1109/SII.2019.8700430

DO - 10.1109/SII.2019.8700430

M3 - Conference contribution

T3 - Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019

SP - 770

EP - 775

BT - Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -