Generation and perception of F0 markedness for communicative speech synthesis

Yoshinori Sagisaka, Takumi Yamashita, Yoko Kokenawa

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

Aiming at natural F0 control for conversational speech synthesis using attributes of constituent output words, F0 characteristics are analyzed from both generation and perception viewpoints. We recorded commonly used two-phrase utterances consisting of Japanese adjective and adverb phrases expressing different degree of markedness under designed conversational situations, and compared their F0 characteristics. The comparison showed the consistent F0 control dependencies not only on adverbs themselves but also on the attribute of following adjective phrases. Strong positive or negative correlation is observed between the markedness of adverbs and F0 height when an adjective phrase showing positiveness or negativeness is followed to the current adverb phrase. These consistencies have been perceptually confirmed by naturalness evaluation tests using the same two-phrase samples with different F0 heights. Finally, a computational model of conversational F0 control is proposed using lexical information of adjectives showing positiveness or negativeness and adverbs expressing markedness. F0 estimation experiments quantitatively showed the possibility of F0 control for natural conversational speech synthesis using the attribute of constituent output words.

Original languageEnglish
Pages (from-to)376-384
Number of pages9
JournalSpeech Communication
Volume46
Issue number3-4
DOIs
Publication statusPublished - 2005 Jul 1

Keywords

  • Computational prosody modeling
  • Conversational speech prosody
  • Corpus-based speech synthesis
  • Fundamental frequency control
  • Perceptual markedness

ASJC Scopus subject areas

  • Software
  • Modelling and Simulation
  • Communication
  • Language and Linguistics
  • Linguistics and Language
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Generation and perception of F<sub>0</sub> markedness for communicative speech synthesis'. Together they form a unique fingerprint.

  • Cite this