Combined static and dynamic variance adaptation for efficient interconnection of speech enhancement pre-processor with speech recognizer

Marc Delcroix, Tomohiro Nakatani, Shinji Watanabe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

It is well known that automatic speech recognition performs poorly in presence of noise or reverberation. Much research has been undertaken on model adaptation and speech enhancement to increase the robustness of speech recognizers. Model adaptation is effective to remove static mismatch between speech features and acoustic model parameters, but may not cope well with dynamic mismatch. Speech enhancement approaches can reduce dynamic perturbations, but often do not interconnect well with speech recognizer. There seems to be a lack of optimal way to combine these two approaches. In this paper we propose introducing the dynamic capabilities of speech enhancement into a static adaptation scheme. We focus on variance adaptation, and propose a novel parametric variance model that includes static and dynamic components. The dynamic component is derived from a speech enhancement pre-process, and the parameters of the model are optimized using an adaptive training scheme. An evaluation of the method with a speech dereverberation for preprocessing revealed that a 80 % relative error rate reduction was possible compared with the recognition of dereverberated speech, and the final error rate was 5.4 % which is close to that of clean speech (1.2%).

Original languageEnglish
Title of host publication2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP
Pages4073-4076
Number of pages4
DOIs
Publication statusPublished - 2008
Externally publishedYes
Event2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP - Las Vegas, NV
Duration: 2008 Mar 312008 Apr 4

Other

Other2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP
CityLas Vegas, NV
Period08/3/3108/4/4

    Fingerprint

Keywords

  • Dereverberation
  • Model adaptation
  • Robust ASR
  • Variance compensation

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering
  • Acoustics and Ultrasonics

Cite this

Delcroix, M., Nakatani, T., & Watanabe, S. (2008). Combined static and dynamic variance adaptation for efficient interconnection of speech enhancement pre-processor with speech recognizer. In 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP (pp. 4073-4076). [4518549] https://doi.org/10.1109/ICASSP.2008.4518549