Query-by-conducting: An interface to retrieve classical-music interpretations by real-time tempo input

Akira Maezawa, Masataka Goto, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper presents an interface for finding interpretations of a user-specified music, Query-by-Conducting. In classical music, there are many interpretations to a particular piece, and finding "the" interpretation that matches the listener's taste allows a listener to further enjoy the piece. The critical issue in finding such an interpretation is the way or interface to allow the listener to listen through different interpretations. Our interface allows a user, by swinging a conducting hardware interface, to conduct the desired global tempo along the playback of a piece, at any time in the piece. The real-time conducting input by the user dynamically switches the interpretation being played back to the one closest to how the user is currently conducting. At the end of the piece, our interface ranks each interpretation according to how close the tempo of each interpretation was to the user input. At the core of our interface is an automated tempo estimation method based on audio-score alignment. We improve tempo estimation by requiring the audio-score alignment of different interpretations to be consistent with each other. We evaluate the tempo estimation method using a solo, chamber, and orchestral repertoire. The proposed tempo estimation decreases the error by as much as 0.94 times the original error.

Original languageEnglish
Title of host publicationProceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010
Pages477-482
Number of pages6
Publication statusPublished - 2010
Externally publishedYes
Event11th International Society for Music Information Retrieval Conference, ISMIR 2010 - Utrecht
Duration: 2010 Aug 92010 Aug 13

Other

Other11th International Society for Music Information Retrieval Conference, ISMIR 2010
CityUtrecht
Period10/8/910/8/13

Fingerprint

Switches
Hardware
Classical music
Conducting
Listeners
Alignment
Solo
Repertoire
Music

ASJC Scopus subject areas

  • Music
  • Information Systems

Cite this

Maezawa, A., Goto, M., & Okuno, H. G. (2010). Query-by-conducting: An interface to retrieve classical-music interpretations by real-time tempo input. In Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010 (pp. 477-482)

Query-by-conducting : An interface to retrieve classical-music interpretations by real-time tempo input. / Maezawa, Akira; Goto, Masataka; Okuno, Hiroshi G.

Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010. 2010. p. 477-482.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Maezawa, A, Goto, M & Okuno, HG 2010, Query-by-conducting: An interface to retrieve classical-music interpretations by real-time tempo input. in Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010. pp. 477-482, 11th International Society for Music Information Retrieval Conference, ISMIR 2010, Utrecht, 10/8/9.
Maezawa A, Goto M, Okuno HG. Query-by-conducting: An interface to retrieve classical-music interpretations by real-time tempo input. In Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010. 2010. p. 477-482
Maezawa, Akira ; Goto, Masataka ; Okuno, Hiroshi G. / Query-by-conducting : An interface to retrieve classical-music interpretations by real-time tempo input. Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010. 2010. pp. 477-482
@inproceedings{7ccd3bac9d2f47f6ae1c93bae5538632,
title = "Query-by-conducting: An interface to retrieve classical-music interpretations by real-time tempo input",
abstract = "This paper presents an interface for finding interpretations of a user-specified music, Query-by-Conducting. In classical music, there are many interpretations to a particular piece, and finding {"}the{"} interpretation that matches the listener's taste allows a listener to further enjoy the piece. The critical issue in finding such an interpretation is the way or interface to allow the listener to listen through different interpretations. Our interface allows a user, by swinging a conducting hardware interface, to conduct the desired global tempo along the playback of a piece, at any time in the piece. The real-time conducting input by the user dynamically switches the interpretation being played back to the one closest to how the user is currently conducting. At the end of the piece, our interface ranks each interpretation according to how close the tempo of each interpretation was to the user input. At the core of our interface is an automated tempo estimation method based on audio-score alignment. We improve tempo estimation by requiring the audio-score alignment of different interpretations to be consistent with each other. We evaluate the tempo estimation method using a solo, chamber, and orchestral repertoire. The proposed tempo estimation decreases the error by as much as 0.94 times the original error.",
author = "Akira Maezawa and Masataka Goto and Okuno, {Hiroshi G.}",
year = "2010",
language = "English",
isbn = "9789039353813",
pages = "477--482",
booktitle = "Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010",

}

TY - GEN

T1 - Query-by-conducting

T2 - An interface to retrieve classical-music interpretations by real-time tempo input

AU - Maezawa, Akira

AU - Goto, Masataka

AU - Okuno, Hiroshi G.

PY - 2010

Y1 - 2010

N2 - This paper presents an interface for finding interpretations of a user-specified music, Query-by-Conducting. In classical music, there are many interpretations to a particular piece, and finding "the" interpretation that matches the listener's taste allows a listener to further enjoy the piece. The critical issue in finding such an interpretation is the way or interface to allow the listener to listen through different interpretations. Our interface allows a user, by swinging a conducting hardware interface, to conduct the desired global tempo along the playback of a piece, at any time in the piece. The real-time conducting input by the user dynamically switches the interpretation being played back to the one closest to how the user is currently conducting. At the end of the piece, our interface ranks each interpretation according to how close the tempo of each interpretation was to the user input. At the core of our interface is an automated tempo estimation method based on audio-score alignment. We improve tempo estimation by requiring the audio-score alignment of different interpretations to be consistent with each other. We evaluate the tempo estimation method using a solo, chamber, and orchestral repertoire. The proposed tempo estimation decreases the error by as much as 0.94 times the original error.

AB - This paper presents an interface for finding interpretations of a user-specified music, Query-by-Conducting. In classical music, there are many interpretations to a particular piece, and finding "the" interpretation that matches the listener's taste allows a listener to further enjoy the piece. The critical issue in finding such an interpretation is the way or interface to allow the listener to listen through different interpretations. Our interface allows a user, by swinging a conducting hardware interface, to conduct the desired global tempo along the playback of a piece, at any time in the piece. The real-time conducting input by the user dynamically switches the interpretation being played back to the one closest to how the user is currently conducting. At the end of the piece, our interface ranks each interpretation according to how close the tempo of each interpretation was to the user input. At the core of our interface is an automated tempo estimation method based on audio-score alignment. We improve tempo estimation by requiring the audio-score alignment of different interpretations to be consistent with each other. We evaluate the tempo estimation method using a solo, chamber, and orchestral repertoire. The proposed tempo estimation decreases the error by as much as 0.94 times the original error.

UR - http://www.scopus.com/inward/record.url?scp=80051631241&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80051631241&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:80051631241

SN - 9789039353813

SP - 477

EP - 482

BT - Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010

ER -