Lyric synchronizer: Automatic synchronization system between musical audio signals and lyrics

Hiromasa Fujihara*, Masataka Goto, Jun Ogata, Hiroshi G. Okuno

*この研究の対応する著者

研究成果: Article査読

52 被引用数 (Scopus)

抄録

This paper describes a system that can automatically synchronize polyphonic musical audio signals with their corresponding lyrics. Although methods for synchronizing monophonic speech signals and corresponding text transcriptions by using Viterbi alignment techniques have been proposed, these methods cannot be applied to vocals in CD recordings because vocals are often overlapped by accompaniment sounds. In addition to a conventional method for reducing the influence of the accompaniment sounds, we therefore developed four methods to overcome this problem: a method for detecting vocal sections, a method for constructing robust phoneme networks, a method for detecting fricative sounds, and a method for adapting a speech-recognizer phone model to segregated vocal signals. We then report experimental results for each of these methods and also describe our music playback interface that utilizes our system for synchronizing music and lyrics.

本文言語English
論文番号5876296
ページ(範囲)1252-1261
ページ数10
ジャーナルIEEE Journal on Selected Topics in Signal Processing
5
6
DOI
出版ステータスPublished - 2011 10月
外部発表はい

ASJC Scopus subject areas

  • 電子工学および電気工学
  • 信号処理

フィンガープリント

「Lyric synchronizer: Automatic synchronization system between musical audio signals and lyrics」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル