Far-Field Automatic Speech Recognition

Reinhold Haeb-Umbach, Jahn Heymann, Lukas Drude, Shinji Watanabe, Marc Delcroix, Tomohiro Nakatani

Research output: Contribution to journalArticlepeer-review

Abstract

The machine recognition of speech spoken at a distance from the microphones, known as far-field automatic speech recognition (ASR), has received a significant increase in attention in science and industry, which caused or was caused by an equally significant improvement in recognition accuracy. Meanwhile, it has entered the consumer market with digital home assistants with a spoken language interface being its most prominent application. Speech recorded at a distance is affected by various acoustic distortions, and consequently, quite different processing pipelines have emerged compared with ASR for close-Talk speech. A signal enhancement front end for dereverberation, source separation, and acoustic beamforming is employed to clean up the speech, and the back-end ASR engine is robustified by multicondition training and adaptation. We will also describe the so-called end-To-end approach to ASR, which is a new promising architecture that has recently been extended to the far-field scenario. This tutorial article gives an account of the algorithms used to enable accurate speech recognition from a distance, and it will be seen that, although deep learning has a significant share in the technological breakthroughs, a clever combination with traditional signal processing can lead to surprisingly effective solutions.

Original languageEnglish
Article number9189820
Pages (from-to)124-148
Number of pages25
JournalProceedings of the IEEE
Volume109
Issue number2
DOIs
Publication statusPublished - 2021 Feb
Externally publishedYes

Keywords

  • Acoustic beamforming
  • automatic speech recognition (ASR)
  • dereverberation
  • end-To-end speech recognition
  • speech enhancement

ASJC Scopus subject areas

  • Computer Science(all)
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Far-Field Automatic Speech Recognition'. Together they form a unique fingerprint.

Cite this