Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism

Tsuyoshi Sakuma, Satoshi Miura, Tomoyuki Miyashita, Masakatsu G. Fujie, Shigeki Sugano

研究成果: Conference contribution

抄録

Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94%) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.

元の言語English
ホスト出版物のタイトルProceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019
出版者Institute of Electrical and Electronics Engineers Inc.
ページ770-775
ページ数6
ISBN(電子版)9781538636152
DOI
出版物ステータスPublished - 2019 4 25
イベント2019 IEEE/SICE International Symposium on System Integration, SII 2019 - Paris, France
継続期間: 2019 1 142019 1 16

出版物シリーズ

名前Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019

Conference

Conference2019 IEEE/SICE International Symposium on System Integration, SII 2019
France
Paris
期間19/1/1419/1/16

Fingerprint

decision making
brain
Brain
Decision making
learning
control stability
sensory feedback
brakes
Reinforcement learning
reinforcement
Brakes
Teaching
education
electronics

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Electrical and Electronic Engineering

これを引用

Sakuma, T., Miura, S., Miyashita, T., Fujie, M. G., & Sugano, S. (2019). Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. : Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019 (pp. 770-775). [8700430] (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SII.2019.8700430

Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. / Sakuma, Tsuyoshi; Miura, Satoshi; Miyashita, Tomoyuki; Fujie, Masakatsu G.; Sugano, Shigeki.

Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 770-775 8700430 (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019).

研究成果: Conference contribution

Sakuma, T, Miura, S, Miyashita, T, Fujie, MG & Sugano, S 2019, Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. : Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019., 8700430, Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019, Institute of Electrical and Electronics Engineers Inc., pp. 770-775, 2019 IEEE/SICE International Symposium on System Integration, SII 2019, Paris, France, 19/1/14. https://doi.org/10.1109/SII.2019.8700430
Sakuma T, Miura S, Miyashita T, Fujie MG, Sugano S. Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. : Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 770-775. 8700430. (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019). https://doi.org/10.1109/SII.2019.8700430
Sakuma, Tsuyoshi ; Miura, Satoshi ; Miyashita, Tomoyuki ; Fujie, Masakatsu G. ; Sugano, Shigeki. / Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism. Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 770-775 (Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019).
@inproceedings{c9ca842e29ee42ef9b66d8e39287deda,
title = "Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism",
abstract = "Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94{\%}) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.",
author = "Tsuyoshi Sakuma and Satoshi Miura and Tomoyuki Miyashita and Fujie, {Masakatsu G.} and Shigeki Sugano",
year = "2019",
month = "4",
day = "25",
doi = "10.1109/SII.2019.8700430",
language = "English",
series = "Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "770--775",
booktitle = "Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019",

}

TY - GEN

T1 - Development of Human-Like Driving Decision Making Model based on Human Brain Mechanism

AU - Sakuma, Tsuyoshi

AU - Miura, Satoshi

AU - Miyashita, Tomoyuki

AU - Fujie, Masakatsu G.

AU - Sugano, Shigeki

PY - 2019/4/25

Y1 - 2019/4/25

N2 - Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94%) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.

AB - Recent driving assistance technologies such as Electronic Stability Control (ESC) and auto brake system release drivers from complicated driving tasks. On the other hand, there is concern that it reduces pleasure feelings of a driver if these system's behaviors are different from the driver's intention. To avoid such problem, it is important to evaluate the driver's intention and decision-making process, and design the assistance system to fit it. In this research, we propose an unsupervised reinforcement learning driver model based on human cognitive mechanism and human brain architecture. Because this study's objective is to analyze the process of driving decision making, we hire a simple actor-critic model as a driver model. We set learning parameters from the driver's decision making characteristics which are derived from the task execution process of the human brain, and set state space from driver's sensory characteristics. This driver model can predict lane change decision making adequately and shows high accuracy (ACC=94%) on verification tests with real driving data. This result is similar to unpublished results of a deep neural network driver model which use the same data as teaching data. From these results, we consider that the proposed reward function and learned state space represent the driver's decision making characteristics.

UR - http://www.scopus.com/inward/record.url?scp=85065641994&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065641994&partnerID=8YFLogxK

U2 - 10.1109/SII.2019.8700430

DO - 10.1109/SII.2019.8700430

M3 - Conference contribution

AN - SCOPUS:85065641994

T3 - Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019

SP - 770

EP - 775

BT - Proceedings of the 2019 IEEE/SICE International Symposium on System Integration, SII 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -