Instrument equalizer for query-by-example retrieval: Improving sound source separation based on integrated harmonic and inharmonic models

Katsutoshi Itoyama, Masataka Goto, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

34 Citations (Scopus)

Abstract

This paper describes a music remixing interface, called Instrument Equalizer, that allows users to control the volume of each instrument part within existing audio recordings in real time. Although query-by-example retrieval systems need a user to prepare favorite examples (songs) in general, our interface gives a user to generate examples from existing ones by cutting or boosting some instrument/vocal parts, resulting in a variety of retrieved results. To change the volume, all instrument parts are separated from the input sound mixture using the corresponding standard MIDI file. For the separation, we used an integrated tone (timbre) model consisting of harmonic and inharmonic models that are initialized with template sounds recorded from a MIDI sound generator. The remaining but critical problem here is to deal with various performance styles and instrument bodies that are not given in the template sounds. To solve this problem, we train probabilistic distributions of timbre features by using various sounds. By adding a new constraint of maximizing the likelihood of timbre features extracted from each tone model, we succeeded in estimating model parameters that better express actual timbre.

Original languageEnglish
Title of host publicationISMIR 2008 - 9th International Conference on Music Information Retrieval
Pages133-138
Number of pages6
Publication statusPublished - 2008 Dec 1
Externally publishedYes
Event9th International Conference on Music Information Retrieval, ISMIR 2008 - Philadelphia, PA, United States
Duration: 2008 Sep 142008 Sep 18

Publication series

NameISMIR 2008 - 9th International Conference on Music Information Retrieval

Conference

Conference9th International Conference on Music Information Retrieval, ISMIR 2008
CountryUnited States
CityPhiladelphia, PA
Period08/9/1408/9/18

ASJC Scopus subject areas

  • Music
  • Information Systems

Fingerprint Dive into the research topics of 'Instrument equalizer for query-by-example retrieval: Improving sound source separation based on integrated harmonic and inharmonic models'. Together they form a unique fingerprint.

  • Cite this

    Itoyama, K., Goto, M., Komatani, K., Ogata, T., & Okuno, H. G. (2008). Instrument equalizer for query-by-example retrieval: Improving sound source separation based on integrated harmonic and inharmonic models. In ISMIR 2008 - 9th International Conference on Music Information Retrieval (pp. 133-138). (ISMIR 2008 - 9th International Conference on Music Information Retrieval).