A grasping device to sense hand gesture for expressive sound generation

Shuji Hashimoto, Hideyuki Sawada

Research output: Contribution to journalReview article

7 Citations (Scopus)

Abstract

This article introduces a new device driven by emotional human twiddling gestures, and its application as a musical instrument. In traditional musical instruments, the relationship between the action and the generated sound is determined by the physical structures of the instruments. Although various computerized musical instruments have been actively developed and reported, the development of a human-computer interface is not sufficient for the translation of emotional feelings into sounds. We have so far paid attention to emotional feelings presented in gestures and music, and have developed a gesture acquisition device that measures grasping forces caused by user's twiddling actions by using compact pressure sensors and acceleration sensors. For the association of gesture patterns with sound parameters, a SOM algorithm is applied. The approach is considered to provide not only a new sound generation technique in the music scene, but also a flexible human-computer interface.

Original languageEnglish
Pages (from-to)115-123
Number of pages9
JournalJournal of New Music Research
Volume34
Issue number1
DOIs
Publication statusPublished - 2005 Jun 1

    Fingerprint

ASJC Scopus subject areas

  • Visual Arts and Performing Arts
  • Music

Cite this