Non-native speech recognition using audio style transfer

Kacper Radzikowski, Mateusz Forc, Le Wang, Osamu Yoshie, Robert M. Nowak

研究成果: Conference contribution

抜粋

Recently automatic speech recognition (ASR) systems achieve higher and higher accuracy rates. However, the score drops significantly, when the ASR system is being used with a non-native speaker of the language to be recognized, mainly because of specific pronunciation and accent features. A limited volume of labeled datasets containing samples of a non-native speech makes it difficult to train any new ASR systems targeted for non-native speakers. In our research, we tried tackling the problem of a non-native accent and its influence on the accuracy of ASR systems, using the style transfer methodology. We designed a pipeline for modifying the speech produced by a nonnative speaker, so that it resembles the native speech to a higher extent, i.e. a method for accent neutralization. Our methodology can be used as a wrapper for any existing ASR system, which reduces the necessity of training new speech recognizers, adapted for non-native speech. The modification can be thus performed on the fly, before passing the data forward to the speech recognition system itself.

元の言語English
ホスト出版物のタイトルPhotonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2019
編集者Ryszard S. Romaniuk, Maciej Linczuk
出版者SPIE
ISBN(電子版)9781510630659
DOI
出版物ステータスPublished - 2019
外部発表Yes
イベントPhotonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2019 - Wilga, Poland
継続期間: 2019 5 262019 6 2

出版物シリーズ

名前Proceedings of SPIE - The International Society for Optical Engineering
11176
ISSN(印刷物)0277-786X
ISSN(電子版)1996-756X

Conference

ConferencePhotonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2019
Poland
Wilga
期間19/5/2619/6/2

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

フィンガープリント Non-native speech recognition using audio style transfer' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Radzikowski, K., Forc, M., Wang, L., Yoshie, O., & Nowak, R. M. (2019). Non-native speech recognition using audio style transfer. : R. S. Romaniuk, & M. Linczuk (版), Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2019 [111762J] (Proceedings of SPIE - The International Society for Optical Engineering; 巻数 11176). SPIE. https://doi.org/10.1117/12.2536535