Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body

Tomohiro Yokota, Tomoko Hashida

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    4 Citations (Scopus)

    Abstract

    In this paper, we present a novel acoustic sensing technique that recognizes two convenient input actions: hand gestures and on-body touch. We achieved them by observing the fre-quency spectrum of the wave propagated in the body, around the periphery of the wrist. Our approach can recognize hand gestures and on-body touch concurrently in real-time and is expected to obtain rich input variations by combining them. We conducted a user study that showed classification accu-racy of 97%, 96%, and 97% for hand gestures, touches on the forearm, and touches on the back of the hand.

    Original languageEnglish
    Title of host publicationUIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology
    PublisherAssociation for Computing Machinery, Inc
    Pages113-115
    Number of pages3
    ISBN (Electronic)9781450345316
    DOIs
    Publication statusPublished - 2016 Oct 16
    Event29th Annual Symposium on User Interface Software and Technology, UIST 2016 - Tokyo, Japan
    Duration: 2016 Oct 162016 Oct 19

    Other

    Other29th Annual Symposium on User Interface Software and Technology, UIST 2016
    CountryJapan
    CityTokyo
    Period16/10/1616/10/19

    Fingerprint

    Acoustics

    Keywords

    • Acoustic sensing
    • Combined input
    • Hand gestures
    • Machine learning
    • On-body touch

    ASJC Scopus subject areas

    • Software
    • Human-Computer Interaction

    Cite this

    Yokota, T., & Hashida, T. (2016). Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body. In UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology (pp. 113-115). Association for Computing Machinery, Inc. https://doi.org/10.1145/2984751.2985721

    Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body. / Yokota, Tomohiro; Hashida, Tomoko.

    UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2016. p. 113-115.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Yokota, T & Hashida, T 2016, Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body. in UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, pp. 113-115, 29th Annual Symposium on User Interface Software and Technology, UIST 2016, Tokyo, Japan, 16/10/16. https://doi.org/10.1145/2984751.2985721
    Yokota T, Hashida T. Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body. In UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc. 2016. p. 113-115 https://doi.org/10.1145/2984751.2985721
    Yokota, Tomohiro ; Hashida, Tomoko. / Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body. UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2016. pp. 113-115
    @inproceedings{f976fc1bdede4c76befe4033f8399fb1,
    title = "Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body",
    abstract = "In this paper, we present a novel acoustic sensing technique that recognizes two convenient input actions: hand gestures and on-body touch. We achieved them by observing the fre-quency spectrum of the wave propagated in the body, around the periphery of the wrist. Our approach can recognize hand gestures and on-body touch concurrently in real-time and is expected to obtain rich input variations by combining them. We conducted a user study that showed classification accu-racy of 97{\%}, 96{\%}, and 97{\%} for hand gestures, touches on the forearm, and touches on the back of the hand.",
    keywords = "Acoustic sensing, Combined input, Hand gestures, Machine learning, On-body touch",
    author = "Tomohiro Yokota and Tomoko Hashida",
    year = "2016",
    month = "10",
    day = "16",
    doi = "10.1145/2984751.2985721",
    language = "English",
    pages = "113--115",
    booktitle = "UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology",
    publisher = "Association for Computing Machinery, Inc",

    }

    TY - GEN

    T1 - Hand gesture and on-body touch recognition by active acoustic sensing throughout the human body

    AU - Yokota, Tomohiro

    AU - Hashida, Tomoko

    PY - 2016/10/16

    Y1 - 2016/10/16

    N2 - In this paper, we present a novel acoustic sensing technique that recognizes two convenient input actions: hand gestures and on-body touch. We achieved them by observing the fre-quency spectrum of the wave propagated in the body, around the periphery of the wrist. Our approach can recognize hand gestures and on-body touch concurrently in real-time and is expected to obtain rich input variations by combining them. We conducted a user study that showed classification accu-racy of 97%, 96%, and 97% for hand gestures, touches on the forearm, and touches on the back of the hand.

    AB - In this paper, we present a novel acoustic sensing technique that recognizes two convenient input actions: hand gestures and on-body touch. We achieved them by observing the fre-quency spectrum of the wave propagated in the body, around the periphery of the wrist. Our approach can recognize hand gestures and on-body touch concurrently in real-time and is expected to obtain rich input variations by combining them. We conducted a user study that showed classification accu-racy of 97%, 96%, and 97% for hand gestures, touches on the forearm, and touches on the back of the hand.

    KW - Acoustic sensing

    KW - Combined input

    KW - Hand gestures

    KW - Machine learning

    KW - On-body touch

    UR - http://www.scopus.com/inward/record.url?scp=84995579308&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84995579308&partnerID=8YFLogxK

    U2 - 10.1145/2984751.2985721

    DO - 10.1145/2984751.2985721

    M3 - Conference contribution

    SP - 113

    EP - 115

    BT - UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology

    PB - Association for Computing Machinery, Inc

    ER -