A talking and singing robot based on the mechanical construction of human vocal system

Hideyuki Sawada, Mitsuhiro Nakamura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A talking and singing robot is being developed based on the mechanical model of the human vocal system by using mechatronics and feedback control technologies. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot is able to adaptively learn the relations between motor control parameters and the produced vocal sounds using an auditory feedback with neural networks, by mimicking a human vocalization. This paper presents the construction of the robot and its taking and singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.

Original languageEnglish
Title of host publicationProceedings - 2004 International Conference on Intelligent Mechatronics and Automation
Pages89-94
Number of pages6
Publication statusPublished - 2004
Externally publishedYes
EventProceedings - 2004 International Conference on Intelligent Mechatronics and Automation - Chengdu, China
Duration: 2004 Aug 262004 Aug 31

Other

OtherProceedings - 2004 International Conference on Intelligent Mechatronics and Automation
CountryChina
CityChengdu
Period04/8/2604/8/31

Fingerprint

Robots
Acoustic waves
Mechatronics
Fluid dynamics
Feedback control
Neural networks
Feedback

Keywords

  • Auditory feedback
  • Human vocal system
  • Singing performance
  • Talking robot
  • Vocalization skill

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Sawada, H., & Nakamura, M. (2004). A talking and singing robot based on the mechanical construction of human vocal system. In Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation (pp. 89-94)

A talking and singing robot based on the mechanical construction of human vocal system. / Sawada, Hideyuki; Nakamura, Mitsuhiro.

Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation. 2004. p. 89-94.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sawada, H & Nakamura, M 2004, A talking and singing robot based on the mechanical construction of human vocal system. in Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation. pp. 89-94, Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation, Chengdu, China, 04/8/26.
Sawada H, Nakamura M. A talking and singing robot based on the mechanical construction of human vocal system. In Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation. 2004. p. 89-94
Sawada, Hideyuki ; Nakamura, Mitsuhiro. / A talking and singing robot based on the mechanical construction of human vocal system. Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation. 2004. pp. 89-94
@inproceedings{b424424b82ed4d138c4b9b136da81ada,
title = "A talking and singing robot based on the mechanical construction of human vocal system",
abstract = "A talking and singing robot is being developed based on the mechanical model of the human vocal system by using mechatronics and feedback control technologies. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot is able to adaptively learn the relations between motor control parameters and the produced vocal sounds using an auditory feedback with neural networks, by mimicking a human vocalization. This paper presents the construction of the robot and its taking and singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.",
keywords = "Auditory feedback, Human vocal system, Singing performance, Talking robot, Vocalization skill",
author = "Hideyuki Sawada and Mitsuhiro Nakamura",
year = "2004",
language = "English",
isbn = "0780387481",
pages = "89--94",
booktitle = "Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation",

}

TY - GEN

T1 - A talking and singing robot based on the mechanical construction of human vocal system

AU - Sawada, Hideyuki

AU - Nakamura, Mitsuhiro

PY - 2004

Y1 - 2004

N2 - A talking and singing robot is being developed based on the mechanical model of the human vocal system by using mechatronics and feedback control technologies. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot is able to adaptively learn the relations between motor control parameters and the produced vocal sounds using an auditory feedback with neural networks, by mimicking a human vocalization. This paper presents the construction of the robot and its taking and singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.

AB - A talking and singing robot is being developed based on the mechanical model of the human vocal system by using mechatronics and feedback control technologies. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot is able to adaptively learn the relations between motor control parameters and the produced vocal sounds using an auditory feedback with neural networks, by mimicking a human vocalization. This paper presents the construction of the robot and its taking and singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.

KW - Auditory feedback

KW - Human vocal system

KW - Singing performance

KW - Talking robot

KW - Vocalization skill

UR - http://www.scopus.com/inward/record.url?scp=8844247911&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=8844247911&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:8844247911

SN - 0780387481

SP - 89

EP - 94

BT - Proceedings - 2004 International Conference on Intelligent Mechatronics and Automation

ER -