Automatic recognition of Japanese vowel length accounting for speaking rate and motivated by perception analysis

Greg Short, Keikichi Hirose, Mariko Kondo, Nobuaki Minematsu

Research output: Contribution to journalArticle

Abstract

Automatic recognition of vowel length in Japanese has several applications in speech processing such as for computer assisted language learning (CALL) systems. Standard automatic speech recognition (ASR) systems make use of hidden Markov models (HMMs) to carry out the recognition. However, HMMs are not particularly well-suited for this problem since classification of vowel length is dependent on prosodic information, and since it is a relative feature affected by changes in the durations of surrounding sounds which vary in part due to changes in speaking rates. That being said, it is not obvious how to design an algorithm to account for these contextual dependencies, since there is still not enough known about how humans perceive the contrast. Therefore, in this paper, we conduct perceptual experiments to further understand the mechanism of human vowel length recognition. In our research, we found that the perceptual boundary is largely affected by the vowels two prior, one prior, and following the vowel for which the length is being recognized. Based on these results and the works of others, we propose an algorithm which does post-processing on alignments output by HMMs to automatically recognize vowel length. The method is primarily composed of two levels of processing dealing first with local dependencies and then long-term dependencies. We test several variations of this algorithm. The method we develop is shown to have superior recognition capabilities and be robust against speaking rate differences producing significant improvements. We test this method on three different databases: a speaking rate database, a native database, and a non-native database.

Original languageEnglish
Pages (from-to)47-63
Number of pages17
JournalSpeech Communication
Volume73
DOIs
Publication statusPublished - 2015 Aug 11

    Fingerprint

Keywords

  • Automatic recognition
  • Duration
  • Perception
  • Resynthesis
  • Stimulus continua
  • Vowel length

ASJC Scopus subject areas

  • Modelling and Simulation
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Software
  • Communication
  • Linguistics and Language
  • Language and Linguistics

Cite this