Optimizing the structure of partly-hidden Markov models using weighted likelihood-ratio maximization criterion

Research output: Contribution to conferencePaper

Abstract

A structure of Partly-Hidden Markov Model (PHMM) is optimized. PHMM was proposed in our previous work to deal with the complicated temporal changes of acoustic features. It can realize the observation dependent behaviors in both observations and state transitions. In the formulation of previous PHMM, we used a common structure in all model categories. However, it is well known that the optimal structure which gives best performance differs from category to category. In this paper, we designed a new structure optimization method in which the state-observation dependences in PHMM are optimally defined with respect to each category using Weighted Likelihood-Ratio Maximization (WLRM) criterion. WLRM criterion induces sparse and discriminative structures, and therefore gives the resulting structurally discriminative models. We define the model structure combination which gives maximum weighted likelihood-ratio for any possible structure patterns as the optimal structures, and Genetic Algorithm is applied to an optimal approximation of search. As the results of continuous speech recognition aiming at lecture talks, the effectiveness of the proposed structure optimization is shown: it reduced the word errors compared to HMM and PHMM with common structure for all categories.

Original languageEnglish
Pages3353-3356
Number of pages4
Publication statusPublished - 2005 Dec 1
Event9th European Conference on Speech Communication and Technology - Lisbon, Portugal
Duration: 2005 Sep 42005 Sep 8

Conference

Conference9th European Conference on Speech Communication and Technology
CountryPortugal
CityLisbon
Period05/9/405/9/8

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Optimizing the structure of partly-hidden Markov models using weighted likelihood-ratio maximization criterion'. Together they form a unique fingerprint.

  • Cite this

    Ogawa, T., & Kobayashi, T. (2005). Optimizing the structure of partly-hidden Markov models using weighted likelihood-ratio maximization criterion. 3353-3356. Paper presented at 9th European Conference on Speech Communication and Technology, Lisbon, Portugal.