Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume

Katsutoshi Itoyama, Masataka Goto, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We describe a novel Query-by-Example (QBE) approach in Music Information Retrieval, which allows a user to customize query examples by directly modifying the volume of different instrument parts. The underlying hypothesis is that the musical genre shifts (changes) in relation to the volume balance of different instruments. On the basis of this hypothesis, we aim to clarify the relationship between the change of the volume balance of a query and the shift in the musical genre of retrieved similar pieces, and thus help instruct a user in generating alternative queries without choosing other pieces. Our QBE system first separates all instrument parts from the audio signal of a piece with the help of its musical score, and then lets a user remix those parts to change acoustic features that represent musical mood of the piece. The distribution of those features is modeled by the Gaussian Mixture Model for each musical piece, and the Earth Movers Distance between mixtures of different pieces is used as the degree of their mood similarity. Experimental results showed that the shift was actually caused by the volume change of vocal, guitar, and drums.

Original languageEnglish
Title of host publicationProceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009
Pages205-212
Number of pages8
Publication statusPublished - 2009
Externally publishedYes
Event12th International Conference on Digital Audio Effects, DAFx 2009 - Como
Duration: 2009 Sep 12009 Sep 4

Other

Other12th International Conference on Digital Audio Effects, DAFx 2009
CityComo
Period09/9/109/9/4

Fingerprint

Information retrieval
Acoustics
Earth (planet)

ASJC Scopus subject areas

  • Signal Processing

Cite this

Itoyama, K., Goto, M., Komatani, K., Ogata, T., & Okuno, H. G. (2009). Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume. In Proceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009 (pp. 205-212)

Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume. / Itoyama, Katsutoshi; Goto, Masataka; Komatani, Kazunori; Ogata, Tetsuya; Okuno, Hiroshi G.

Proceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009. 2009. p. 205-212.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Itoyama, K, Goto, M, Komatani, K, Ogata, T & Okuno, HG 2009, Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume. in Proceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009. pp. 205-212, 12th International Conference on Digital Audio Effects, DAFx 2009, Como, 09/9/1.
Itoyama K, Goto M, Komatani K, Ogata T, Okuno HG. Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume. In Proceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009. 2009. p. 205-212
Itoyama, Katsutoshi ; Goto, Masataka ; Komatani, Kazunori ; Ogata, Tetsuya ; Okuno, Hiroshi G. / Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume. Proceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009. 2009. pp. 205-212
@inproceedings{bde2af0cec3445d18aff7cc4fced0c86,
title = "Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume",
abstract = "We describe a novel Query-by-Example (QBE) approach in Music Information Retrieval, which allows a user to customize query examples by directly modifying the volume of different instrument parts. The underlying hypothesis is that the musical genre shifts (changes) in relation to the volume balance of different instruments. On the basis of this hypothesis, we aim to clarify the relationship between the change of the volume balance of a query and the shift in the musical genre of retrieved similar pieces, and thus help instruct a user in generating alternative queries without choosing other pieces. Our QBE system first separates all instrument parts from the audio signal of a piece with the help of its musical score, and then lets a user remix those parts to change acoustic features that represent musical mood of the piece. The distribution of those features is modeled by the Gaussian Mixture Model for each musical piece, and the Earth Movers Distance between mixtures of different pieces is used as the degree of their mood similarity. Experimental results showed that the shift was actually caused by the volume change of vocal, guitar, and drums.",
author = "Katsutoshi Itoyama and Masataka Goto and Kazunori Komatani and Tetsuya Ogata and Okuno, {Hiroshi G.}",
year = "2009",
language = "English",
pages = "205--212",
booktitle = "Proceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009",

}

TY - GEN

T1 - Query-by-Example music retrieval approach based on musical genre shift by changing instrument volume

AU - Itoyama, Katsutoshi

AU - Goto, Masataka

AU - Komatani, Kazunori

AU - Ogata, Tetsuya

AU - Okuno, Hiroshi G.

PY - 2009

Y1 - 2009

N2 - We describe a novel Query-by-Example (QBE) approach in Music Information Retrieval, which allows a user to customize query examples by directly modifying the volume of different instrument parts. The underlying hypothesis is that the musical genre shifts (changes) in relation to the volume balance of different instruments. On the basis of this hypothesis, we aim to clarify the relationship between the change of the volume balance of a query and the shift in the musical genre of retrieved similar pieces, and thus help instruct a user in generating alternative queries without choosing other pieces. Our QBE system first separates all instrument parts from the audio signal of a piece with the help of its musical score, and then lets a user remix those parts to change acoustic features that represent musical mood of the piece. The distribution of those features is modeled by the Gaussian Mixture Model for each musical piece, and the Earth Movers Distance between mixtures of different pieces is used as the degree of their mood similarity. Experimental results showed that the shift was actually caused by the volume change of vocal, guitar, and drums.

AB - We describe a novel Query-by-Example (QBE) approach in Music Information Retrieval, which allows a user to customize query examples by directly modifying the volume of different instrument parts. The underlying hypothesis is that the musical genre shifts (changes) in relation to the volume balance of different instruments. On the basis of this hypothesis, we aim to clarify the relationship between the change of the volume balance of a query and the shift in the musical genre of retrieved similar pieces, and thus help instruct a user in generating alternative queries without choosing other pieces. Our QBE system first separates all instrument parts from the audio signal of a piece with the help of its musical score, and then lets a user remix those parts to change acoustic features that represent musical mood of the piece. The distribution of those features is modeled by the Gaussian Mixture Model for each musical piece, and the Earth Movers Distance between mixtures of different pieces is used as the degree of their mood similarity. Experimental results showed that the shift was actually caused by the volume change of vocal, guitar, and drums.

UR - http://www.scopus.com/inward/record.url?scp=84872702150&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872702150&partnerID=8YFLogxK

M3 - Conference contribution

SP - 205

EP - 212

BT - Proceedings of the 12th International Conference on Digital Audio Effects, DAFx 2009

ER -