A talking robot and its singing performance by the mimicry of human vocalization

M. Kitani, T. Hara, H. Hanada, Hideyuki Sawada

Research output: Chapter in Book/Report/Conference proceedingChapter

8 Citations (Scopus)

Abstract

A talking and singing robot which adaptively learns the vocalization skill by an auditory feedback learning is being developed. The fundamental frequency and the spectrum envelope determine the principal characteristics of a sound. The former is the characteristics of a source sound generated by a vibrating object, and the latter is operated by the work of the resonance effects. In vocalization, the vibration of vocal cords generates a source sound, and then the sound wave is led to a vocal tract, which works as a resonance filter to determine the spectrum envelope. The paper describes the construction of vocal cords and a vocal tract for the realization of a talking and singing robot, together with the control algorithm for the acquisition of singing performance by mimicking human vocalization and singing voices. Generated voices were evaluated by listening experiments.

Original languageEnglish
Title of host publicationHuman - Computer Systems Interaction
Subtitle of host publicationBackgrounds and Applications 2: Part 2
Pages57-73
Number of pages17
Volume99
DOIs
Publication statusPublished - 2012
Externally publishedYes

Publication series

NameAdvances in Intelligent and Soft Computing
Volume99
ISSN (Print)1867-5662

Fingerprint

Acoustic waves
Robots
Vibrations (mechanical)
Feedback
Experiments

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Kitani, M., Hara, T., Hanada, H., & Sawada, H. (2012). A talking robot and its singing performance by the mimicry of human vocalization. In Human - Computer Systems Interaction: Backgrounds and Applications 2: Part 2 (Vol. 99, pp. 57-73). (Advances in Intelligent and Soft Computing; Vol. 99). https://doi.org/10.1007/978-3-642-23172-8_5

A talking robot and its singing performance by the mimicry of human vocalization. / Kitani, M.; Hara, T.; Hanada, H.; Sawada, Hideyuki.

Human - Computer Systems Interaction: Backgrounds and Applications 2: Part 2. Vol. 99 2012. p. 57-73 (Advances in Intelligent and Soft Computing; Vol. 99).

Research output: Chapter in Book/Report/Conference proceedingChapter

Kitani, M, Hara, T, Hanada, H & Sawada, H 2012, A talking robot and its singing performance by the mimicry of human vocalization. in Human - Computer Systems Interaction: Backgrounds and Applications 2: Part 2. vol. 99, Advances in Intelligent and Soft Computing, vol. 99, pp. 57-73. https://doi.org/10.1007/978-3-642-23172-8_5
Kitani M, Hara T, Hanada H, Sawada H. A talking robot and its singing performance by the mimicry of human vocalization. In Human - Computer Systems Interaction: Backgrounds and Applications 2: Part 2. Vol. 99. 2012. p. 57-73. (Advances in Intelligent and Soft Computing). https://doi.org/10.1007/978-3-642-23172-8_5
Kitani, M. ; Hara, T. ; Hanada, H. ; Sawada, Hideyuki. / A talking robot and its singing performance by the mimicry of human vocalization. Human - Computer Systems Interaction: Backgrounds and Applications 2: Part 2. Vol. 99 2012. pp. 57-73 (Advances in Intelligent and Soft Computing).
@inbook{4ba983d2d7264984bb345d7a52ab31bf,
title = "A talking robot and its singing performance by the mimicry of human vocalization",
abstract = "A talking and singing robot which adaptively learns the vocalization skill by an auditory feedback learning is being developed. The fundamental frequency and the spectrum envelope determine the principal characteristics of a sound. The former is the characteristics of a source sound generated by a vibrating object, and the latter is operated by the work of the resonance effects. In vocalization, the vibration of vocal cords generates a source sound, and then the sound wave is led to a vocal tract, which works as a resonance filter to determine the spectrum envelope. The paper describes the construction of vocal cords and a vocal tract for the realization of a talking and singing robot, together with the control algorithm for the acquisition of singing performance by mimicking human vocalization and singing voices. Generated voices were evaluated by listening experiments.",
author = "M. Kitani and T. Hara and H. Hanada and Hideyuki Sawada",
year = "2012",
doi = "10.1007/978-3-642-23172-8_5",
language = "English",
isbn = "9783642231711",
volume = "99",
series = "Advances in Intelligent and Soft Computing",
pages = "57--73",
booktitle = "Human - Computer Systems Interaction",

}

TY - CHAP

T1 - A talking robot and its singing performance by the mimicry of human vocalization

AU - Kitani, M.

AU - Hara, T.

AU - Hanada, H.

AU - Sawada, Hideyuki

PY - 2012

Y1 - 2012

N2 - A talking and singing robot which adaptively learns the vocalization skill by an auditory feedback learning is being developed. The fundamental frequency and the spectrum envelope determine the principal characteristics of a sound. The former is the characteristics of a source sound generated by a vibrating object, and the latter is operated by the work of the resonance effects. In vocalization, the vibration of vocal cords generates a source sound, and then the sound wave is led to a vocal tract, which works as a resonance filter to determine the spectrum envelope. The paper describes the construction of vocal cords and a vocal tract for the realization of a talking and singing robot, together with the control algorithm for the acquisition of singing performance by mimicking human vocalization and singing voices. Generated voices were evaluated by listening experiments.

AB - A talking and singing robot which adaptively learns the vocalization skill by an auditory feedback learning is being developed. The fundamental frequency and the spectrum envelope determine the principal characteristics of a sound. The former is the characteristics of a source sound generated by a vibrating object, and the latter is operated by the work of the resonance effects. In vocalization, the vibration of vocal cords generates a source sound, and then the sound wave is led to a vocal tract, which works as a resonance filter to determine the spectrum envelope. The paper describes the construction of vocal cords and a vocal tract for the realization of a talking and singing robot, together with the control algorithm for the acquisition of singing performance by mimicking human vocalization and singing voices. Generated voices were evaluated by listening experiments.

UR - http://www.scopus.com/inward/record.url?scp=81855227630&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=81855227630&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-23172-8_5

DO - 10.1007/978-3-642-23172-8_5

M3 - Chapter

AN - SCOPUS:81855227630

SN - 9783642231711

VL - 99

T3 - Advances in Intelligent and Soft Computing

SP - 57

EP - 73

BT - Human - Computer Systems Interaction

ER -