Transferring vocal expression of F0 contour using singing voice synthesizer

Yukara Ikemiya, Katsutoshi Itoyama, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Pages250-259
Number of pages10
Volume8482 LNAI
EditionPART 2
ISBN (Print)9783319074665
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014 - Kaohsiung, Taiwan, Province of China
Duration: 2014 Jun 32014 Jun 6

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume8482 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014
CountryTaiwan, Province of China
CityKaohsiung
Period14/6/314/6/6

Fingerprint

Fundamental Frequency
Subharmonics
Summation
Voice
Fluctuations
Range of data
Experiment
Experiments

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Ikemiya, Y., Itoyama, K., & Okuno, H. G. (2014). Transferring vocal expression of F0 contour using singing voice synthesizer. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 2 ed., Vol. 8482 LNAI, pp. 250-259). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8482 LNAI, No. PART 2). Springer Verlag. https://doi.org/10.1007/978-3-319-07467-2_27

Transferring vocal expression of F0 contour using singing voice synthesizer. / Ikemiya, Yukara; Itoyama, Katsutoshi; Okuno, Hiroshi G.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8482 LNAI PART 2. ed. Springer Verlag, 2014. p. 250-259 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8482 LNAI, No. PART 2).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ikemiya, Y, Itoyama, K & Okuno, HG 2014, Transferring vocal expression of F0 contour using singing voice synthesizer. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 edn, vol. 8482 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 8482 LNAI, Springer Verlag, pp. 250-259, 27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014, Kaohsiung, Taiwan, Province of China, 14/6/3. https://doi.org/10.1007/978-3-319-07467-2_27
Ikemiya Y, Itoyama K, Okuno HG. Transferring vocal expression of F0 contour using singing voice synthesizer. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 ed. Vol. 8482 LNAI. Springer Verlag. 2014. p. 250-259. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). https://doi.org/10.1007/978-3-319-07467-2_27
Ikemiya, Yukara ; Itoyama, Katsutoshi ; Okuno, Hiroshi G. / Transferring vocal expression of F0 contour using singing voice synthesizer. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8482 LNAI PART 2. ed. Springer Verlag, 2014. pp. 250-259 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).
@inproceedings{18539f7b4ffd4b10bf5d6c33efbee2f3,
title = "Transferring vocal expression of F0 contour using singing voice synthesizer",
abstract = "A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.",
author = "Yukara Ikemiya and Katsutoshi Itoyama and Okuno, {Hiroshi G.}",
year = "2014",
doi = "10.1007/978-3-319-07467-2_27",
language = "English",
isbn = "9783319074665",
volume = "8482 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
number = "PART 2",
pages = "250--259",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 2",

}

TY - GEN

T1 - Transferring vocal expression of F0 contour using singing voice synthesizer

AU - Ikemiya, Yukara

AU - Itoyama, Katsutoshi

AU - Okuno, Hiroshi G.

PY - 2014

Y1 - 2014

N2 - A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.

AB - A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.

UR - http://www.scopus.com/inward/record.url?scp=84958521674&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84958521674&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-07467-2_27

DO - 10.1007/978-3-319-07467-2_27

M3 - Conference contribution

SN - 9783319074665

VL - 8482 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 250

EP - 259

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Verlag

ER -