A talking robot and its singing skill acquisition

Mitsuhiro Nakamura, Hideyuki Sawada

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

A talking and singing robot which has equivalent mechanical organs to human vocal system is being developed based on a mechatronics technology under a feedback control. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot adaptively learns the relations between motor control parameters and the generated vocal sounds using an auditory feedback learning with neural networks, and sings a song by mimicking a human vocalization. This paper presents the construction of the talking robot and its singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.

Original languageEnglish
Title of host publicationKnowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings
Pages898-907
Number of pages10
Volume3683 LNAI
Publication statusPublished - 2005
Externally publishedYes
Event9th International Conference on Knowledge-Based Intelligent Information and Engineering Systems, KES 2005 - Melbourne
Duration: 2005 Sep 142005 Sep 16

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3683 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other9th International Conference on Knowledge-Based Intelligent Information and Engineering Systems, KES 2005
CityMelbourne
Period05/9/1405/9/16

Fingerprint

Robot
Robots
Acoustic waves
Motor Control
Mechatronics
Fluid Dynamics
Fluid dynamics
Mechanical Systems
Adaptive Control
Control Parameter
Feedback Control
Feedback control
Manipulation
Cavity
Neural Networks
Neural networks
Feedback
Skills
Acquisition
Sound

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Nakamura, M., & Sawada, H. (2005). A talking robot and its singing skill acquisition. In Knowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings (Vol. 3683 LNAI, pp. 898-907). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3683 LNAI).

A talking robot and its singing skill acquisition. / Nakamura, Mitsuhiro; Sawada, Hideyuki.

Knowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings. Vol. 3683 LNAI 2005. p. 898-907 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3683 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nakamura, M & Sawada, H 2005, A talking robot and its singing skill acquisition. in Knowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings. vol. 3683 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3683 LNAI, pp. 898-907, 9th International Conference on Knowledge-Based Intelligent Information and Engineering Systems, KES 2005, Melbourne, 05/9/14.
Nakamura M, Sawada H. A talking robot and its singing skill acquisition. In Knowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings. Vol. 3683 LNAI. 2005. p. 898-907. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Nakamura, Mitsuhiro ; Sawada, Hideyuki. / A talking robot and its singing skill acquisition. Knowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings. Vol. 3683 LNAI 2005. pp. 898-907 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{58e6a5e305d44186a265ad7b261f08d2,
title = "A talking robot and its singing skill acquisition",
abstract = "A talking and singing robot which has equivalent mechanical organs to human vocal system is being developed based on a mechatronics technology under a feedback control. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot adaptively learns the relations between motor control parameters and the generated vocal sounds using an auditory feedback learning with neural networks, and sings a song by mimicking a human vocalization. This paper presents the construction of the talking robot and its singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.",
author = "Mitsuhiro Nakamura and Hideyuki Sawada",
year = "2005",
language = "English",
isbn = "3540288961",
volume = "3683 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "898--907",
booktitle = "Knowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings",

}

TY - GEN

T1 - A talking robot and its singing skill acquisition

AU - Nakamura, Mitsuhiro

AU - Sawada, Hideyuki

PY - 2005

Y1 - 2005

N2 - A talking and singing robot which has equivalent mechanical organs to human vocal system is being developed based on a mechatronics technology under a feedback control. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot adaptively learns the relations between motor control parameters and the generated vocal sounds using an auditory feedback learning with neural networks, and sings a song by mimicking a human vocalization. This paper presents the construction of the talking robot and its singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.

AB - A talking and singing robot which has equivalent mechanical organs to human vocal system is being developed based on a mechatronics technology under a feedback control. While various ways of vocal sound production have been actively studied so far, a mechanical construction of the vocal system is considered to advantageously realize natural vocalization with its fluid dynamics. Motors are employed for the manipulation of the mechanical system. The robot adaptively learns the relations between motor control parameters and the generated vocal sounds using an auditory feedback learning with neural networks, and sings a song by mimicking a human vocalization. This paper presents the construction of the talking robot and its singing performance, together with the adaptive control for the pitch and phoneme learning. The robot generates vowel and consonant sounds of different pitches by dynamically controlling the vocal cords, vocal tract and nasal cavity.

UR - http://www.scopus.com/inward/record.url?scp=33745315030&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745315030&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:33745315030

SN - 3540288961

SN - 9783540288961

VL - 3683 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 898

EP - 907

BT - Knowledge-Based Intelligent Information and Engineering Systems - 9th International Conference, KES 2005, Proceedings

ER -