Transferring vocal expression of F0 contour using singing voice synthesizer

Yukara Ikemiya; Katsutoshi Itoyama; Hiroshi G. Okuno

doi:10.1007/978-3-319-07467-2_27

Transferring vocal expression of F0 contour using singing voice synthesizer

Yukara Ikemiya, Katsutoshi Itoyama, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.

Original language	English
Title of host publication	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher	Springer Verlag
Pages	250-259
Number of pages	10
Volume	8482 LNAI
Edition	PART 2
ISBN (Print)	9783319074665
DOIs	https://doi.org/10.1007/978-3-319-07467-2_27
Publication status	Published - 2014
Externally published	Yes
Event	27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014 - Kaohsiung, Taiwan, Province of China Duration: 2014 Jun 3 → 2014 Jun 6

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 2
Volume	8482 LNAI
ISSN (Print)	03029743
ISSN (Electronic)	16113349

Other

Other	27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014
Country	Taiwan, Province of China
City	Kaohsiung
Period	14/6/3 → 14/6/6

Fingerprint

ASJC Scopus subject areas

Computer Science(all)
Theoretical Computer Science

Cite this

Ikemiya, Y., Itoyama, K., & Okuno, H. G. (2014). Transferring vocal expression of F0 contour using singing voice synthesizer. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 2 ed., Vol. 8482 LNAI, pp. 250-259). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8482 LNAI, No. PART 2). Springer Verlag. https://doi.org/10.1007/978-3-319-07467-2_27

Transferring vocal expression of F0 contour using singing voice synthesizer. / Ikemiya, Yukara; Itoyama, Katsutoshi; Okuno, Hiroshi G.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8482 LNAI PART 2. ed. Springer Verlag, 2014. p. 250-259 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8482 LNAI, No. PART 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Ikemiya, Y, Itoyama, K & Okuno, HG 2014, Transferring vocal expression of F0 contour using singing voice synthesizer. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 edn, vol. 8482 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 8482 LNAI, Springer Verlag, pp. 250-259, 27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014, Kaohsiung, Taiwan, Province of China, 14/6/3. https://doi.org/10.1007/978-3-319-07467-2_27

Ikemiya Y, Itoyama K, Okuno HG. Transferring vocal expression of F0 contour using singing voice synthesizer. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 ed. Vol. 8482 LNAI. Springer Verlag. 2014. p. 250-259. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). https://doi.org/10.1007/978-3-319-07467-2_27

Ikemiya, Yukara ; Itoyama, Katsutoshi ; Okuno, Hiroshi G. / Transferring vocal expression of F0 contour using singing voice synthesizer. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8482 LNAI PART 2. ed. Springer Verlag, 2014. pp. 250-259 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).

@inproceedings{18539f7b4ffd4b10bf5d6c33efbee2f3,

title = "Transferring vocal expression of F0 contour using singing voice synthesizer",

abstract = "A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.",

author = "Yukara Ikemiya and Katsutoshi Itoyama and Okuno, {Hiroshi G.}",

year = "2014",

doi = "10.1007/978-3-319-07467-2_27",

language = "English",

isbn = "9783319074665",

volume = "8482 LNAI",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

number = "PART 2",

pages = "250--259",

booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

edition = "PART 2",

note = "27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014 ; Conference date: 03-06-2014 Through 06-06-2014",

}

TY - GEN

T1 - Transferring vocal expression of F0 contour using singing voice synthesizer

AU - Ikemiya, Yukara

AU - Itoyama, Katsutoshi

AU - Okuno, Hiroshi G.

PY - 2014

Y1 - 2014

N2 - A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.

AB - A system for transferring vocal expressions separately from singing voices with accompaniment to singing voice synthesizers is described. The expressions appear as fluctuations in the fundamental frequency contour of the singing voice, such as vibrato, glissando, and kobushi. The fundamental frequency contour of the singing voice is estimated using the subharmonic summation in a limited frequency range and aligned temporally to chromatic pitch sequence. Each expression is transcribed and parameterized in accordance with designed rules. Finally, the expressions are transferred to given scores on the singing voice synthesizer. Experiments demonstrated that the proposed system can transfer the vocal expressions while retaining singer's individuality on two singing voice synthesizers: the Vocaloid and the CeVIO.

UR - http://www.scopus.com/inward/record.url?scp=84958521674&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84958521674&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-07467-2_27

DO - 10.1007/978-3-319-07467-2_27

M3 - Conference contribution

AN - SCOPUS:84958521674

SN - 9783319074665

VL - 8482 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 250

EP - 259

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Verlag

T2 - 27th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2014

Y2 - 3 June 2014 through 6 June 2014

ER -

Access to Document

10.1007/978-3-319-07467-2_27