Speech spectrum conversion based on speaker interpolation and multi-functional representation with weighting by radial basis function networks

Naoto Iwahashi, Yoshinori Sagisaka

Research output: Contribution to journalArticle

42 Citations (Scopus)

Abstract

This paper describes a speech spectrum transformation method by interpolating multi-speakers' spectral patterns and multi-functional representation with Radial Basis Function networks. The interpolation is carried out using spectral parameters between pre-stored multiple speakers' utterance data to generate new spectrum patterns. Adaptation to a target speaker can be performed by this interpolation, which uses only a small amount of training data to generate new speech spectrum sequences close to those of the target speaker. Moreover, to obtain more precise adaptation by using a larger amount of training data, the transformation is represented by multiple interpolating functions. The multiple functions' outputs are weighted-summed, using weighting values given by RBF networks. The parameters of this multi-functional transformation are adapted by the gradient descent method. Adaptation experiments were carried out using four pre-stored speakers' data. Using only one word spoken by the target speaker for training, the distance between the target speaker's spectrum and the spectrum generated by the single interpolating function was reduced by about 35% compared with the distance between the target speaker's spectrum and the spectrum of the pre-stored speaker closest to the target. Using ten training words, the reduction rate increased to 48% by the multi-functional transformation.

Original languageEnglish
Pages (from-to)139-151
Number of pages13
JournalSpeech Communication
Volume16
Issue number2
DOIs
Publication statusPublished - 1995 Feb
Externally publishedYes

Keywords

  • Multiple functional representation
  • Radial basis function
  • Speaker adaptation
  • Speaker interpolation
  • Speech spectrum conversion
  • Voice conversion

ASJC Scopus subject areas

  • Software
  • Modelling and Simulation
  • Communication
  • Language and Linguistics
  • Linguistics and Language
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Speech spectrum conversion based on speaker interpolation and multi-functional representation with weighting by radial basis function networks'. Together they form a unique fingerprint.

  • Cite this