A dilemma of ground truth in noisy speech separation and an approach to lessen the impact of imperfect training data

Matthew Maciejewski*, Jing Shi, Shinji Watanabe, Sanjeev Khudanpur

*この研究の対応する著者

研究成果: Article査読

抄録

As the performance of single-channel speech separation systems has improved, there has been a shift in the research community towards tackling more challenging conditions that are more representative of many real-world applications, including the addition of noise and reverberation. The need for ground truth in training state-of-the-art separation systems leads to a requirement of training on artificial mixtures, where single-speaker recordings are summed digitally. However, this leads to two separate approaches for creating noisy mixtures: one in which noise has been artificially added, maintaining perfect ground truth information, and one in which the noise is already present in the single-speaker recordings, allowing for in-domain training. In this work, we document a severe negative impact in both training and evaluation of models in the latter paradigm. We provide an explanation for this – the implicit task of separating noise – and propose an improved training objective that allows errors resulting from failing to separate noise to be minimized.

本文言語English
論文番号101410
ジャーナルComputer Speech and Language
77
DOI
出版ステータスPublished - 2023 1月
外部発表はい

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • ソフトウェア
  • 人間とコンピュータの相互作用

フィンガープリント

「A dilemma of ground truth in noisy speech separation and an approach to lessen the impact of imperfect training data」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル