Lyric synchronizer: Automatic synchronization system between musical audio signals and lyrics

Hiromasa Fujihara, Masataka Goto, Jun Ogata, Hiroshi G. Okuno

Research output: Contribution to journalArticle

46 Citations (Scopus)

Abstract

This paper describes a system that can automatically synchronize polyphonic musical audio signals with their corresponding lyrics. Although methods for synchronizing monophonic speech signals and corresponding text transcriptions by using Viterbi alignment techniques have been proposed, these methods cannot be applied to vocals in CD recordings because vocals are often overlapped by accompaniment sounds. In addition to a conventional method for reducing the influence of the accompaniment sounds, we therefore developed four methods to overcome this problem: a method for detecting vocal sections, a method for constructing robust phoneme networks, a method for detecting fricative sounds, and a method for adapting a speech-recognizer phone model to segregated vocal signals. We then report experimental results for each of these methods and also describe our music playback interface that utilizes our system for synchronizing music and lyrics.

Original languageEnglish
Article number5876296
Pages (from-to)1252-1261
Number of pages10
JournalIEEE Journal on Selected Topics in Signal Processing
Volume5
Issue number6
DOIs
Publication statusPublished - 2011 Oct
Externally publishedYes

Keywords

  • Alignment
  • Lyrics
  • Singing voice
  • Viterbi algorithm
  • Vocal

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Signal Processing

Fingerprint Dive into the research topics of 'Lyric synchronizer: Automatic synchronization system between musical audio signals and lyrics'. Together they form a unique fingerprint.

  • Cite this