Text-to-speech of a talking robot for interactive speech training of hearing impaired

Thanh Vo Nhu, Hideyuki Sawada

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    The authors are developing a talking robot which is a mechanical vocalization system modeling the human articulatory system. The talking robot is constructed with mechanical parts that are made by referring to human vocal organs biologically and functionally. In this study, a newly redesign artificial vocal cord is developed for the purpose of extending the speaking capability of the talking robot. The artificial vocal cord is developed using functional approach. A thin layer of rubber band with a width of 7mm is attached on a plastic body in a sealed chamber creates an artificial sound source. The fundamental frequency of the sound source vary from 80Hz to 280 Hz depending on the pressure to the rubber band and the curving shape of the rubber band. The curving shape of the rubber band is adjustable by an innovative design mechanism driven by a servo motor. The amount of air pressure applied to the rubber band is controlled by another servo motor which is referred as volume motor in this study. The experiment to verify the speak capability of the talking robot with this newly redesigned vocal cord is conducted by letting the robot generating five vowel sounds with difference combination of 20 levels of rubber band shape and 10 levels of air pressure input. The pitch and volume of each sound is extracted to determine the effect of the rubber band shape and the pressure input on the output sound. The result shows that this newly redesigned vocal cord greatly increase the speaking capability of the talking robot, especially its singing performance.

    Original languageEnglish
    Title of host publicationProceedings - 2017 10th International Conference on Human System Interactions, HSI 2017
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages166-171
    Number of pages6
    ISBN (Electronic)9781509046881
    DOIs
    Publication statusPublished - 2017 Aug 8
    Event10th International Conference on Human System Interactions, HSI 2017 - Ulsan, Korea, Republic of
    Duration: 2017 Jul 172017 Jul 19

    Other

    Other10th International Conference on Human System Interactions, HSI 2017
    CountryKorea, Republic of
    CityUlsan
    Period17/7/1717/7/19

    Fingerprint

    talking
    Rubber
    Audition
    hearing
    robot
    robots
    rubber
    Hearing
    vocal cords
    education
    Robots
    Vocal Cords
    Acoustic waves
    acoustics
    Air Pressure
    speaking
    air
    plastic bodies
    singing
    Pressure

    Keywords

    • Artificial vocal cord
    • Curving shape
    • Fundamental frequency
    • Pressure
    • Talking-robot

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Vision and Pattern Recognition
    • Human-Computer Interaction
    • Health Informatics
    • Instrumentation
    • Education
    • Health(social science)
    • Communication

    Cite this

    Vo Nhu, T., & Sawada, H. (2017). Text-to-speech of a talking robot for interactive speech training of hearing impaired. In Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017 (pp. 166-171). [8005021] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/HSI.2017.8005021

    Text-to-speech of a talking robot for interactive speech training of hearing impaired. / Vo Nhu, Thanh; Sawada, Hideyuki.

    Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 166-171 8005021.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Vo Nhu, T & Sawada, H 2017, Text-to-speech of a talking robot for interactive speech training of hearing impaired. in Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017., 8005021, Institute of Electrical and Electronics Engineers Inc., pp. 166-171, 10th International Conference on Human System Interactions, HSI 2017, Ulsan, Korea, Republic of, 17/7/17. https://doi.org/10.1109/HSI.2017.8005021
    Vo Nhu T, Sawada H. Text-to-speech of a talking robot for interactive speech training of hearing impaired. In Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 166-171. 8005021 https://doi.org/10.1109/HSI.2017.8005021
    Vo Nhu, Thanh ; Sawada, Hideyuki. / Text-to-speech of a talking robot for interactive speech training of hearing impaired. Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 166-171
    @inproceedings{6ecddd1f196d4d78b628c555bf53790a,
    title = "Text-to-speech of a talking robot for interactive speech training of hearing impaired",
    abstract = "The authors are developing a talking robot which is a mechanical vocalization system modeling the human articulatory system. The talking robot is constructed with mechanical parts that are made by referring to human vocal organs biologically and functionally. In this study, a newly redesign artificial vocal cord is developed for the purpose of extending the speaking capability of the talking robot. The artificial vocal cord is developed using functional approach. A thin layer of rubber band with a width of 7mm is attached on a plastic body in a sealed chamber creates an artificial sound source. The fundamental frequency of the sound source vary from 80Hz to 280 Hz depending on the pressure to the rubber band and the curving shape of the rubber band. The curving shape of the rubber band is adjustable by an innovative design mechanism driven by a servo motor. The amount of air pressure applied to the rubber band is controlled by another servo motor which is referred as volume motor in this study. The experiment to verify the speak capability of the talking robot with this newly redesigned vocal cord is conducted by letting the robot generating five vowel sounds with difference combination of 20 levels of rubber band shape and 10 levels of air pressure input. The pitch and volume of each sound is extracted to determine the effect of the rubber band shape and the pressure input on the output sound. The result shows that this newly redesigned vocal cord greatly increase the speaking capability of the talking robot, especially its singing performance.",
    keywords = "Artificial vocal cord, Curving shape, Fundamental frequency, Pressure, Talking-robot",
    author = "{Vo Nhu}, Thanh and Hideyuki Sawada",
    year = "2017",
    month = "8",
    day = "8",
    doi = "10.1109/HSI.2017.8005021",
    language = "English",
    pages = "166--171",
    booktitle = "Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    address = "United States",

    }

    TY - GEN

    T1 - Text-to-speech of a talking robot for interactive speech training of hearing impaired

    AU - Vo Nhu, Thanh

    AU - Sawada, Hideyuki

    PY - 2017/8/8

    Y1 - 2017/8/8

    N2 - The authors are developing a talking robot which is a mechanical vocalization system modeling the human articulatory system. The talking robot is constructed with mechanical parts that are made by referring to human vocal organs biologically and functionally. In this study, a newly redesign artificial vocal cord is developed for the purpose of extending the speaking capability of the talking robot. The artificial vocal cord is developed using functional approach. A thin layer of rubber band with a width of 7mm is attached on a plastic body in a sealed chamber creates an artificial sound source. The fundamental frequency of the sound source vary from 80Hz to 280 Hz depending on the pressure to the rubber band and the curving shape of the rubber band. The curving shape of the rubber band is adjustable by an innovative design mechanism driven by a servo motor. The amount of air pressure applied to the rubber band is controlled by another servo motor which is referred as volume motor in this study. The experiment to verify the speak capability of the talking robot with this newly redesigned vocal cord is conducted by letting the robot generating five vowel sounds with difference combination of 20 levels of rubber band shape and 10 levels of air pressure input. The pitch and volume of each sound is extracted to determine the effect of the rubber band shape and the pressure input on the output sound. The result shows that this newly redesigned vocal cord greatly increase the speaking capability of the talking robot, especially its singing performance.

    AB - The authors are developing a talking robot which is a mechanical vocalization system modeling the human articulatory system. The talking robot is constructed with mechanical parts that are made by referring to human vocal organs biologically and functionally. In this study, a newly redesign artificial vocal cord is developed for the purpose of extending the speaking capability of the talking robot. The artificial vocal cord is developed using functional approach. A thin layer of rubber band with a width of 7mm is attached on a plastic body in a sealed chamber creates an artificial sound source. The fundamental frequency of the sound source vary from 80Hz to 280 Hz depending on the pressure to the rubber band and the curving shape of the rubber band. The curving shape of the rubber band is adjustable by an innovative design mechanism driven by a servo motor. The amount of air pressure applied to the rubber band is controlled by another servo motor which is referred as volume motor in this study. The experiment to verify the speak capability of the talking robot with this newly redesigned vocal cord is conducted by letting the robot generating five vowel sounds with difference combination of 20 levels of rubber band shape and 10 levels of air pressure input. The pitch and volume of each sound is extracted to determine the effect of the rubber band shape and the pressure input on the output sound. The result shows that this newly redesigned vocal cord greatly increase the speaking capability of the talking robot, especially its singing performance.

    KW - Artificial vocal cord

    KW - Curving shape

    KW - Fundamental frequency

    KW - Pressure

    KW - Talking-robot

    UR - http://www.scopus.com/inward/record.url?scp=85030235488&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85030235488&partnerID=8YFLogxK

    U2 - 10.1109/HSI.2017.8005021

    DO - 10.1109/HSI.2017.8005021

    M3 - Conference contribution

    SP - 166

    EP - 171

    BT - Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -