Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging

Yukihiro Nishimura, Tomoko Hashida

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    In public speaking, speakers are evaluated on verbal delivery and nonverbal delivery, and in particular, the mouth shape has an important role to support both of these. The mouth shape is mainly set during vowel utterance. We define the mouth shape, which can prompt the pronunciation of the speaker clearly and enrich the facial expression, as a good mouth shape in this research. The authors assume that a good mouth shape can be inferred from the bulging of the platysma muscle in the neck. We aim to support vowel utterances with a good mouth shape, and propose a system to recognize them. Specifically, we measure the uplift of the platysma muscle with photoreflectors and apply a machine learning method to implement a system to judge whether vowel utterances are being performed with a good shape. We conduct an accuracy measurement experiment of the proposed system and report the result. Finally, we describe the application that provides feedback of vowel utterances with a good mouth shape.

    Original languageEnglish
    Title of host publicationProceedings of the 9th Augmented Human International Conference, AH 2018
    PublisherAssociation for Computing Machinery
    VolumePart F134484
    ISBN (Electronic)9781450354158
    DOIs
    Publication statusPublished - 2018 Feb 6
    Event9th Augmented Human International Conference, AH 2018 - Seoul, Korea, Republic of
    Duration: 2018 Feb 72018 Feb 9

    Other

    Other9th Augmented Human International Conference, AH 2018
    CountryKorea, Republic of
    CitySeoul
    Period18/2/718/2/9

    Fingerprint

    Muscle
    Feedback
    Learning systems
    Experiments

    Keywords

    • Machine Learning.
    • Mouth Shape
    • Presentation Training
    • Public Speech

    ASJC Scopus subject areas

    • Human-Computer Interaction
    • Computer Networks and Communications
    • Computer Vision and Pattern Recognition
    • Software

    Cite this

    Nishimura, Y., & Hashida, T. (2018). Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging. In Proceedings of the 9th Augmented Human International Conference, AH 2018 (Vol. Part F134484). [a18] Association for Computing Machinery. https://doi.org/10.1145/3174910.3174944

    Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging. / Nishimura, Yukihiro; Hashida, Tomoko.

    Proceedings of the 9th Augmented Human International Conference, AH 2018. Vol. Part F134484 Association for Computing Machinery, 2018. a18.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Nishimura, Y & Hashida, T 2018, Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging. in Proceedings of the 9th Augmented Human International Conference, AH 2018. vol. Part F134484, a18, Association for Computing Machinery, 9th Augmented Human International Conference, AH 2018, Seoul, Korea, Republic of, 18/2/7. https://doi.org/10.1145/3174910.3174944
    Nishimura Y, Hashida T. Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging. In Proceedings of the 9th Augmented Human International Conference, AH 2018. Vol. Part F134484. Association for Computing Machinery. 2018. a18 https://doi.org/10.1145/3174910.3174944
    Nishimura, Yukihiro ; Hashida, Tomoko. / Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging. Proceedings of the 9th Augmented Human International Conference, AH 2018. Vol. Part F134484 Association for Computing Machinery, 2018.
    @inproceedings{1111e77f2f894ca4a0fc5d7582dcfeb8,
    title = "Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging",
    abstract = "In public speaking, speakers are evaluated on verbal delivery and nonverbal delivery, and in particular, the mouth shape has an important role to support both of these. The mouth shape is mainly set during vowel utterance. We define the mouth shape, which can prompt the pronunciation of the speaker clearly and enrich the facial expression, as a good mouth shape in this research. The authors assume that a good mouth shape can be inferred from the bulging of the platysma muscle in the neck. We aim to support vowel utterances with a good mouth shape, and propose a system to recognize them. Specifically, we measure the uplift of the platysma muscle with photoreflectors and apply a machine learning method to implement a system to judge whether vowel utterances are being performed with a good shape. We conduct an accuracy measurement experiment of the proposed system and report the result. Finally, we describe the application that provides feedback of vowel utterances with a good mouth shape.",
    keywords = "Machine Learning., Mouth Shape, Presentation Training, Public Speech",
    author = "Yukihiro Nishimura and Tomoko Hashida",
    year = "2018",
    month = "2",
    day = "6",
    doi = "10.1145/3174910.3174944",
    language = "English",
    volume = "Part F134484",
    booktitle = "Proceedings of the 9th Augmented Human International Conference, AH 2018",
    publisher = "Association for Computing Machinery",

    }

    TY - GEN

    T1 - Recognition and feedback of vowel utterance with a good mouth shape based on sensing Platysma muscle bulging

    AU - Nishimura, Yukihiro

    AU - Hashida, Tomoko

    PY - 2018/2/6

    Y1 - 2018/2/6

    N2 - In public speaking, speakers are evaluated on verbal delivery and nonverbal delivery, and in particular, the mouth shape has an important role to support both of these. The mouth shape is mainly set during vowel utterance. We define the mouth shape, which can prompt the pronunciation of the speaker clearly and enrich the facial expression, as a good mouth shape in this research. The authors assume that a good mouth shape can be inferred from the bulging of the platysma muscle in the neck. We aim to support vowel utterances with a good mouth shape, and propose a system to recognize them. Specifically, we measure the uplift of the platysma muscle with photoreflectors and apply a machine learning method to implement a system to judge whether vowel utterances are being performed with a good shape. We conduct an accuracy measurement experiment of the proposed system and report the result. Finally, we describe the application that provides feedback of vowel utterances with a good mouth shape.

    AB - In public speaking, speakers are evaluated on verbal delivery and nonverbal delivery, and in particular, the mouth shape has an important role to support both of these. The mouth shape is mainly set during vowel utterance. We define the mouth shape, which can prompt the pronunciation of the speaker clearly and enrich the facial expression, as a good mouth shape in this research. The authors assume that a good mouth shape can be inferred from the bulging of the platysma muscle in the neck. We aim to support vowel utterances with a good mouth shape, and propose a system to recognize them. Specifically, we measure the uplift of the platysma muscle with photoreflectors and apply a machine learning method to implement a system to judge whether vowel utterances are being performed with a good shape. We conduct an accuracy measurement experiment of the proposed system and report the result. Finally, we describe the application that provides feedback of vowel utterances with a good mouth shape.

    KW - Machine Learning.

    KW - Mouth Shape

    KW - Presentation Training

    KW - Public Speech

    UR - http://www.scopus.com/inward/record.url?scp=85044266016&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85044266016&partnerID=8YFLogxK

    U2 - 10.1145/3174910.3174944

    DO - 10.1145/3174910.3174944

    M3 - Conference contribution

    VL - Part F134484

    BT - Proceedings of the 9th Augmented Human International Conference, AH 2018

    PB - Association for Computing Machinery

    ER -