Optimal hand sign selection using information theory for custom sign-based communication

Tokio Takahashi, Masato Uchida

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Improving the communication abilities of people suffering from speech disorders or hearing impairments and who are struggling to learn sign or spoken language can improve their quality of life. However, methods to assist such people are not varied, and those that consider the degree of physical disability usually fail to attend particular needs. Thus, it is necessary to provide various communication methods according to the characteristics of each physical disability. In this paper, we devise a customized hand sign recognition system according to the degree of physical disability, and propose a method to select a customized set of signs comprising specific hand motions that an individual can effortlessly perform. We consider the optimal set as that providing high reliability and efficiency to realize smooth communication and apply information theory towards their selection. That is, we consider hand sign recognition from myoelectric potentials elicited by finger movement as a communication channel. Then, the optimal hand sign set is determined considering the set with the maximum channel capacity, as it reflects the most reliable and efficient combination. Finally, experimental results obtained from three subjects verify that the proposed method can determine the optimal set of hand signs according to each subject and that increasing the available hand signs or choosing hand signs with high recognition rate do not necessarily contribute to the optimal set.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019
EditorsVladimir Getov, Jean-Luc Gaudiot, Nariyoshi Yamai, Stelvio Cimato, Morris Chang, Yuuichi Teranishi, Ji-Jiang Yang, Hong Va Leong, Hossian Shahriar, Michiharu Takemoto, Dave Towey, Hiroki Takakura, Atilla Elci, Susumu Takeuchi, Satish Puri
PublisherIEEE Computer Society
Pages610-615
Number of pages6
ISBN (Electronic)9781728126074
DOIs
Publication statusPublished - 2019 Jul
Event43rd IEEE Annual Computer Software and Applications Conference, COMPSAC 2019 - Milwaukee, United States
Duration: 2019 Jul 152019 Jul 19

Publication series

NameProceedings - International Computer Software and Applications Conference
Volume1
ISSN (Print)0730-3157

Conference

Conference43rd IEEE Annual Computer Software and Applications Conference, COMPSAC 2019
CountryUnited States
CityMilwaukee
Period19/7/1519/7/19

Fingerprint

Information theory
Communication
Channel capacity
Audition

Keywords

  • Channel capacity
  • Hand sign
  • Myoelectric signal
  • Wearable device

ASJC Scopus subject areas

  • Software
  • Computer Science Applications

Cite this

Takahashi, T., & Uchida, M. (2019). Optimal hand sign selection using information theory for custom sign-based communication. In V. Getov, J-L. Gaudiot, N. Yamai, S. Cimato, M. Chang, Y. Teranishi, J-J. Yang, H. V. Leong, H. Shahriar, M. Takemoto, D. Towey, H. Takakura, A. Elci, S. Takeuchi, ... S. Puri (Eds.), Proceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019 (pp. 610-615). [8754297] (Proceedings - International Computer Software and Applications Conference; Vol. 1). IEEE Computer Society. https://doi.org/10.1109/COMPSAC.2019.00093

Optimal hand sign selection using information theory for custom sign-based communication. / Takahashi, Tokio; Uchida, Masato.

Proceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019. ed. / Vladimir Getov; Jean-Luc Gaudiot; Nariyoshi Yamai; Stelvio Cimato; Morris Chang; Yuuichi Teranishi; Ji-Jiang Yang; Hong Va Leong; Hossian Shahriar; Michiharu Takemoto; Dave Towey; Hiroki Takakura; Atilla Elci; Susumu Takeuchi; Satish Puri. IEEE Computer Society, 2019. p. 610-615 8754297 (Proceedings - International Computer Software and Applications Conference; Vol. 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Takahashi, T & Uchida, M 2019, Optimal hand sign selection using information theory for custom sign-based communication. in V Getov, J-L Gaudiot, N Yamai, S Cimato, M Chang, Y Teranishi, J-J Yang, HV Leong, H Shahriar, M Takemoto, D Towey, H Takakura, A Elci, S Takeuchi & S Puri (eds), Proceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019., 8754297, Proceedings - International Computer Software and Applications Conference, vol. 1, IEEE Computer Society, pp. 610-615, 43rd IEEE Annual Computer Software and Applications Conference, COMPSAC 2019, Milwaukee, United States, 19/7/15. https://doi.org/10.1109/COMPSAC.2019.00093
Takahashi T, Uchida M. Optimal hand sign selection using information theory for custom sign-based communication. In Getov V, Gaudiot J-L, Yamai N, Cimato S, Chang M, Teranishi Y, Yang J-J, Leong HV, Shahriar H, Takemoto M, Towey D, Takakura H, Elci A, Takeuchi S, Puri S, editors, Proceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019. IEEE Computer Society. 2019. p. 610-615. 8754297. (Proceedings - International Computer Software and Applications Conference). https://doi.org/10.1109/COMPSAC.2019.00093
Takahashi, Tokio ; Uchida, Masato. / Optimal hand sign selection using information theory for custom sign-based communication. Proceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019. editor / Vladimir Getov ; Jean-Luc Gaudiot ; Nariyoshi Yamai ; Stelvio Cimato ; Morris Chang ; Yuuichi Teranishi ; Ji-Jiang Yang ; Hong Va Leong ; Hossian Shahriar ; Michiharu Takemoto ; Dave Towey ; Hiroki Takakura ; Atilla Elci ; Susumu Takeuchi ; Satish Puri. IEEE Computer Society, 2019. pp. 610-615 (Proceedings - International Computer Software and Applications Conference).
@inproceedings{3886e39a4c3042148dee938b93ac2cab,
title = "Optimal hand sign selection using information theory for custom sign-based communication",
abstract = "Improving the communication abilities of people suffering from speech disorders or hearing impairments and who are struggling to learn sign or spoken language can improve their quality of life. However, methods to assist such people are not varied, and those that consider the degree of physical disability usually fail to attend particular needs. Thus, it is necessary to provide various communication methods according to the characteristics of each physical disability. In this paper, we devise a customized hand sign recognition system according to the degree of physical disability, and propose a method to select a customized set of signs comprising specific hand motions that an individual can effortlessly perform. We consider the optimal set as that providing high reliability and efficiency to realize smooth communication and apply information theory towards their selection. That is, we consider hand sign recognition from myoelectric potentials elicited by finger movement as a communication channel. Then, the optimal hand sign set is determined considering the set with the maximum channel capacity, as it reflects the most reliable and efficient combination. Finally, experimental results obtained from three subjects verify that the proposed method can determine the optimal set of hand signs according to each subject and that increasing the available hand signs or choosing hand signs with high recognition rate do not necessarily contribute to the optimal set.",
keywords = "Channel capacity, Hand sign, Myoelectric signal, Wearable device",
author = "Tokio Takahashi and Masato Uchida",
year = "2019",
month = "7",
doi = "10.1109/COMPSAC.2019.00093",
language = "English",
series = "Proceedings - International Computer Software and Applications Conference",
publisher = "IEEE Computer Society",
pages = "610--615",
editor = "Vladimir Getov and Jean-Luc Gaudiot and Nariyoshi Yamai and Stelvio Cimato and Morris Chang and Yuuichi Teranishi and Ji-Jiang Yang and Leong, {Hong Va} and Hossian Shahriar and Michiharu Takemoto and Dave Towey and Hiroki Takakura and Atilla Elci and Susumu Takeuchi and Satish Puri",
booktitle = "Proceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019",

}

TY - GEN

T1 - Optimal hand sign selection using information theory for custom sign-based communication

AU - Takahashi, Tokio

AU - Uchida, Masato

PY - 2019/7

Y1 - 2019/7

N2 - Improving the communication abilities of people suffering from speech disorders or hearing impairments and who are struggling to learn sign or spoken language can improve their quality of life. However, methods to assist such people are not varied, and those that consider the degree of physical disability usually fail to attend particular needs. Thus, it is necessary to provide various communication methods according to the characteristics of each physical disability. In this paper, we devise a customized hand sign recognition system according to the degree of physical disability, and propose a method to select a customized set of signs comprising specific hand motions that an individual can effortlessly perform. We consider the optimal set as that providing high reliability and efficiency to realize smooth communication and apply information theory towards their selection. That is, we consider hand sign recognition from myoelectric potentials elicited by finger movement as a communication channel. Then, the optimal hand sign set is determined considering the set with the maximum channel capacity, as it reflects the most reliable and efficient combination. Finally, experimental results obtained from three subjects verify that the proposed method can determine the optimal set of hand signs according to each subject and that increasing the available hand signs or choosing hand signs with high recognition rate do not necessarily contribute to the optimal set.

AB - Improving the communication abilities of people suffering from speech disorders or hearing impairments and who are struggling to learn sign or spoken language can improve their quality of life. However, methods to assist such people are not varied, and those that consider the degree of physical disability usually fail to attend particular needs. Thus, it is necessary to provide various communication methods according to the characteristics of each physical disability. In this paper, we devise a customized hand sign recognition system according to the degree of physical disability, and propose a method to select a customized set of signs comprising specific hand motions that an individual can effortlessly perform. We consider the optimal set as that providing high reliability and efficiency to realize smooth communication and apply information theory towards their selection. That is, we consider hand sign recognition from myoelectric potentials elicited by finger movement as a communication channel. Then, the optimal hand sign set is determined considering the set with the maximum channel capacity, as it reflects the most reliable and efficient combination. Finally, experimental results obtained from three subjects verify that the proposed method can determine the optimal set of hand signs according to each subject and that increasing the available hand signs or choosing hand signs with high recognition rate do not necessarily contribute to the optimal set.

KW - Channel capacity

KW - Hand sign

KW - Myoelectric signal

KW - Wearable device

UR - http://www.scopus.com/inward/record.url?scp=85072715663&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072715663&partnerID=8YFLogxK

U2 - 10.1109/COMPSAC.2019.00093

DO - 10.1109/COMPSAC.2019.00093

M3 - Conference contribution

AN - SCOPUS:85072715663

T3 - Proceedings - International Computer Software and Applications Conference

SP - 610

EP - 615

BT - Proceedings - 2019 IEEE 43rd Annual Computer Software and Applications Conference, COMPSAC 2019

A2 - Getov, Vladimir

A2 - Gaudiot, Jean-Luc

A2 - Yamai, Nariyoshi

A2 - Cimato, Stelvio

A2 - Chang, Morris

A2 - Teranishi, Yuuichi

A2 - Yang, Ji-Jiang

A2 - Leong, Hong Va

A2 - Shahriar, Hossian

A2 - Takemoto, Michiharu

A2 - Towey, Dave

A2 - Takakura, Hiroki

A2 - Elci, Atilla

A2 - Takeuchi, Susumu

A2 - Puri, Satish

PB - IEEE Computer Society

ER -