Two-dimensional emotion evaluation with multiple physiological signals

Jyun Rong Zhuang, Ya Jing Guan, Hayato Nagayoshi, Louis Yuge, HeeHyol Lee, Eiichiro Tanaka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Extended roles of robots for activities of daily living (ADL) lead to researchers’ increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users’ emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.

LanguageEnglish
Title of host publicationAdvances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018
PublisherSpringer-Verlag
Pages158-168
Number of pages11
ISBN (Print)9783319949437
DOIs
Publication statusPublished - 2019 Jan 1
EventAHFE International Conference on Affective and Pleasurable Design, 2018 - [state] FL, United States
Duration: 2018 Jul 212018 Jul 25

Publication series

NameAdvances in Intelligent Systems and Computing
Volume774
ISSN (Print)2194-5357

Other

OtherAHFE International Conference on Affective and Pleasurable Design, 2018
CountryUnited States
City[state] FL
Period18/7/2118/7/25

Fingerprint

Human robot interaction
Robots
Deep neural networks

Keywords

  • Emotion evaluation
  • Physiological data
  • Promotion of exercise
  • Rehabilitation

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science(all)

Cite this

Zhuang, J. R., Guan, Y. J., Nagayoshi, H., Yuge, L., Lee, H., & Tanaka, E. (2019). Two-dimensional emotion evaluation with multiple physiological signals. In Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018 (pp. 158-168). (Advances in Intelligent Systems and Computing; Vol. 774). Springer-Verlag. https://doi.org/10.1007/978-3-319-94944-4_18

Two-dimensional emotion evaluation with multiple physiological signals. / Zhuang, Jyun Rong; Guan, Ya Jing; Nagayoshi, Hayato; Yuge, Louis; Lee, HeeHyol; Tanaka, Eiichiro.

Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. Springer-Verlag, 2019. p. 158-168 (Advances in Intelligent Systems and Computing; Vol. 774).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhuang, JR, Guan, YJ, Nagayoshi, H, Yuge, L, Lee, H & Tanaka, E 2019, Two-dimensional emotion evaluation with multiple physiological signals. in Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. Advances in Intelligent Systems and Computing, vol. 774, Springer-Verlag, pp. 158-168, AHFE International Conference on Affective and Pleasurable Design, 2018, [state] FL, United States, 18/7/21. https://doi.org/10.1007/978-3-319-94944-4_18
Zhuang JR, Guan YJ, Nagayoshi H, Yuge L, Lee H, Tanaka E. Two-dimensional emotion evaluation with multiple physiological signals. In Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. Springer-Verlag. 2019. p. 158-168. (Advances in Intelligent Systems and Computing). https://doi.org/10.1007/978-3-319-94944-4_18
Zhuang, Jyun Rong ; Guan, Ya Jing ; Nagayoshi, Hayato ; Yuge, Louis ; Lee, HeeHyol ; Tanaka, Eiichiro. / Two-dimensional emotion evaluation with multiple physiological signals. Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. Springer-Verlag, 2019. pp. 158-168 (Advances in Intelligent Systems and Computing).
@inproceedings{d65610e5c7a74441974adfe38f9836e7,
title = "Two-dimensional emotion evaluation with multiple physiological signals",
abstract = "Extended roles of robots for activities of daily living (ADL) lead to researchers’ increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users’ emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.",
keywords = "Emotion evaluation, Physiological data, Promotion of exercise, Rehabilitation",
author = "Zhuang, {Jyun Rong} and Guan, {Ya Jing} and Hayato Nagayoshi and Louis Yuge and HeeHyol Lee and Eiichiro Tanaka",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-319-94944-4_18",
language = "English",
isbn = "9783319949437",
series = "Advances in Intelligent Systems and Computing",
publisher = "Springer-Verlag",
pages = "158--168",
booktitle = "Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018",

}

TY - GEN

T1 - Two-dimensional emotion evaluation with multiple physiological signals

AU - Zhuang, Jyun Rong

AU - Guan, Ya Jing

AU - Nagayoshi, Hayato

AU - Yuge, Louis

AU - Lee, HeeHyol

AU - Tanaka, Eiichiro

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Extended roles of robots for activities of daily living (ADL) lead to researchers’ increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users’ emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.

AB - Extended roles of robots for activities of daily living (ADL) lead to researchers’ increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users’ emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.

KW - Emotion evaluation

KW - Physiological data

KW - Promotion of exercise

KW - Rehabilitation

UR - http://www.scopus.com/inward/record.url?scp=85049666344&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049666344&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-94944-4_18

DO - 10.1007/978-3-319-94944-4_18

M3 - Conference contribution

SN - 9783319949437

T3 - Advances in Intelligent Systems and Computing

SP - 158

EP - 168

BT - Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018

PB - Springer-Verlag

ER -