Analysis-and-manipulation approach to pitch and duration of musical instrument sounds without distorting timbral characteristics

Takehiro Abe, Katsutoshi Itoyama, Kazuyoshi Yoshii, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper presents an analysis-manipulation method that can generate musical instrument sounds with arbitrary pitches and durations from the sound of a given musical instrument (called seed) without distorting its timbrai characteristics. Based on psychoacoustical knowledge of the auditory effects of timbres, we defined timbrai features based on the spectrogram of the sound of a musical instrument as (i) the relative amplitudes of the harmonic peaks, (ii) the distribution of the inharmonic component, and (iii) temporal envelopes. First, to analyze the timbrai features of a seed, it was separated into harmonic and inharmonic components using Itoyama's integrated model. For pitch manipulation, we took into account the pitch-dependency of features (i) and (ii). We predicted the values of each feature by using a cubic polynomial that approximated the distribution of these features over pitches. To manipulate duration, we focused on preserving feature (iii) in the attack and decay duration of a seed. Therefore, only steady durations were expanded or shrunk. In addition, we propose a method for reproducing the properties of vibrato. Experimental results demonstrated the quality of the synthesized sounds produced using our method. The spectral and MFCC distances between the synthesized sounds and actual sounds of 32 instruments were reduced by 64.70% and 32.31%, respectively.

Original languageEnglish
Title of host publicationProceedings - 11th International Conference on Digital Audio Effects, DAFx 2008
Pages249-256
Number of pages8
Publication statusPublished - 2008 Dec 1
Event11th International Conference on Digital Audio Effects, DAFx 2008 - Espoo, Finland
Duration: 2008 Sep 12008 Sep 4

Publication series

NameProceedings - 11th International Conference on Digital Audio Effects, DAFx 2008

Conference

Conference11th International Conference on Digital Audio Effects, DAFx 2008
CountryFinland
CityEspoo
Period08/9/108/9/4

ASJC Scopus subject areas

  • Signal Processing

Fingerprint Dive into the research topics of 'Analysis-and-manipulation approach to pitch and duration of musical instrument sounds without distorting timbral characteristics'. Together they form a unique fingerprint.

  • Cite this

    Abe, T., Itoyama, K., Yoshii, K., Komatani, K., Ogata, T., & Okuno, H. G. (2008). Analysis-and-manipulation approach to pitch and duration of musical instrument sounds without distorting timbral characteristics. In Proceedings - 11th International Conference on Digital Audio Effects, DAFx 2008 (pp. 249-256). (Proceedings - 11th International Conference on Digital Audio Effects, DAFx 2008).