Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging

Yukihiro Nishimura, Tomoko Hashida

    研究成果: Conference contribution

    抄録

    In public speaking, speakers are evaluated on verbal delivery and nonverbal delivery, and in particular, the mouth shape has an important role to support both of these. The mouth shape is mainly set during vowel utterance. We define the mouth shape, which can prompt the pronunciation of the speaker clearly and enrich the facial expression, as a good mouth shape in this research. The authors assume that a good mouth shape can be inferred from the bulging of the platysma muscle in the neck. We aim to support vowel utterances with a good mouth shape, and propose a system to recognize them. Specifically, we measure the uplift of the platysma muscle with photoreflectors and apply a machine learning method to implement a system to judge whether vowel utterances are being performed with a good shape. We conduct an accuracy measurement experiment of the proposed system and report the result. Finally, we describe the application that provides feedback of vowel utterances with a good mouth shape.

    本文言語English
    ホスト出版物のタイトルProceedings of the 9th Augmented Human International Conference, AH 2018
    出版社Association for Computing Machinery
    Part F134484
    ISBN(電子版)9781450354158
    DOI
    出版ステータスPublished - 2018 2 6
    イベント9th Augmented Human International Conference, AH 2018 - Seoul, Korea, Republic of
    継続期間: 2018 2 72018 2 9

    Other

    Other9th Augmented Human International Conference, AH 2018
    国/地域Korea, Republic of
    CitySeoul
    Period18/2/718/2/9

    ASJC Scopus subject areas

    • 人間とコンピュータの相互作用
    • コンピュータ ネットワークおよび通信
    • コンピュータ ビジョンおよびパターン認識
    • ソフトウェア

    フィンガープリント

    「Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

    引用スタイル