Musical instrument recognizer "instrogram" and its application to music retrieval based on instrumentation similarity

Tetsuro Kitahara, Masataka Goto, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

Instrumentation is an important cue in retrieving musical content. Conventional methods for instrument recognition performing notewise require accurate estimation of the onset time and fundamental frequency (F0) for each note, which is not easy in polyphonic music. This paper presents a non-notewise method for instrument recognition in polyphonic musical audio signals. Instead of such note-wise estimation, our method calculates the temporal trajectory of instrument existence probabilities for every F0 and visualizes it as a spectrogram-like graphical representation, called an instrogram. This method can avoid the influence by errors of onset detection and F0 estimation because it does not use them. We also present methods for MPEG-7-based instrument annotation and music information retrieval based on the similarity between instrograms. Experimental results with realistic music show the average accuracy of 76.2% for the instrument annotation and that the instrogram-based similarity measure represents the actual instrumentation similarity better than an MFCC-based one.

Original languageEnglish
Title of host publicationISM 2006 - 8th IEEE International Symposium on Multimedia
Pages265-272
Number of pages8
DOIs
Publication statusPublished - 2006 Dec 1
Externally publishedYes
EventISM 2006 - 8th IEEE International Symposium on Multimedia - San Diego, CA, United States
Duration: 2006 Dec 112006 Dec 13

Publication series

NameISM 2006 - 8th IEEE International Symposium on Multimedia

Conference

ConferenceISM 2006 - 8th IEEE International Symposium on Multimedia
CountryUnited States
CitySan Diego, CA
Period06/12/1106/12/13

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Musical instrument recognizer "instrogram" and its application to music retrieval based on instrumentation similarity'. Together they form a unique fingerprint.

  • Cite this

    Kitahara, T., Goto, M., Komatani, K., Ogata, T., & Okuno, H. G. (2006). Musical instrument recognizer "instrogram" and its application to music retrieval based on instrumentation similarity. In ISM 2006 - 8th IEEE International Symposium on Multimedia (pp. 265-272). [4061177] (ISM 2006 - 8th IEEE International Symposium on Multimedia). https://doi.org/10.1109/ISM.2006.113