Automatic synchronization between lyrics and music CD recordings based on Viterbi alignment of segregated vocal signals

Hiromasa Fujihara, Masataka Goto, Jun Ogata, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

50 Citations (Scopus)

Abstract

This paper describes a system that can automatically synchronize between polyphonic musical audio signals and corresponding lyrics. Although there were methods that can synchronize between monophonie speech signals and corresponding text transcriptions by using Viterbi alignment techniques, they cannot be applied to vocals in CD recordings because accompaniment sounds often overlap with vocals. To align lyrics with such vocals, we therefore developed three methods: a method for segregating vocals from polyphonic sound mixtures, a method for detecting vocal sections, and a method for adapting a speech-recognizer phone model to segregated vocal signals. Experimental results for 10 Japanese popular-music songs showed that our system can synchronize between music and lyrics with satisfactory accuracy for 8 songs.

Original languageEnglish
Title of host publicationISM 2006 - 8th IEEE International Symposium on Multimedia
Pages257-264
Number of pages8
DOIs
Publication statusPublished - 2006
Externally publishedYes
EventISM 2006 - 8th IEEE International Symposium on Multimedia - San Diego, CA
Duration: 2006 Dec 112006 Dec 13

Other

OtherISM 2006 - 8th IEEE International Symposium on Multimedia
CitySan Diego, CA
Period06/12/1106/12/13

    Fingerprint

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Fujihara, H., Goto, M., Ogata, J., Komatani, K., Ogata, T., & Okuno, H. G. (2006). Automatic synchronization between lyrics and music CD recordings based on Viterbi alignment of segregated vocal signals. In ISM 2006 - 8th IEEE International Symposium on Multimedia (pp. 257-264). [4061176] https://doi.org/10.1109/ISM.2006.38