SpeakBySinging: Converting singing voices to speaking voices while retaining voice timbre

Shimpei Aso, Takeshi Saitou, Masataka Goto, Katsutoshi Itoyama, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper describes a singing-to-speaking synthesis system called "SpeakBySinging" that can synthesize a speaking voice from an input singing voice and the song lyrics. The system controls three acoustic features that determine the difference between speaking and singing voices: the fundamental frequency (F0), phoneme duration, and power (volume). By changing these features of a singing voice, the system synthesizes a speaking voice while retaining the timbre of the singing voice. The system first analyzes the singing voice to extract the F0 contour, the duration of each phoneme of the lyrics, and the power. These features are then converted to target values that are obtained by feeding the lyrics into a traditional text-to-speech (TTS) system. The system finally generates a speaking voice that preserves the timbre of the singing voice but has speech-like features. Experimental results show that SpeakBySinging can convert singing voices into speaking voices whose timbre is almost the same as the original singing voices.

Original languageEnglish
Title of host publication13th International Conference on Digital Audio Effects, DAFx 2010 Proceedings
Publication statusPublished - 2010 Dec 1
Event13th International Conference on Digital Audio Effects, DAFx 2010 - Graz, Austria
Duration: 2010 Sep 62010 Sep 10

Publication series

Name13th International Conference on Digital Audio Effects, DAFx 2010 Proceedings

Conference

Conference13th International Conference on Digital Audio Effects, DAFx 2010
CountryAustria
CityGraz
Period10/9/610/9/10

ASJC Scopus subject areas

  • Signal Processing

Fingerprint Dive into the research topics of 'SpeakBySinging: Converting singing voices to speaking voices while retaining voice timbre'. Together they form a unique fingerprint.

  • Cite this

    Aso, S., Saitou, T., Goto, M., Itoyama, K., Takahashi, T., Komatani, K., Ogata, T., & Okuno, H. G. (2010). SpeakBySinging: Converting singing voices to speaking voices while retaining voice timbre. In 13th International Conference on Digital Audio Effects, DAFx 2010 Proceedings (13th International Conference on Digital Audio Effects, DAFx 2010 Proceedings).