A grasping device to sense hand gesture for expressive sound generation

Shuji Hashimoto, Hideyuki Sawada

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

This article introduces a new device driven by emotional human twiddling gestures, and its application as a musical instrument. In traditional musical instruments, the relationship between the action and the generated sound is determined by the physical structures of the instruments. Although various computerized musical instruments have been actively developed and reported, the development of a human-computer interface is not sufficient for the translation of emotional feelings into sounds. We have so far paid attention to emotional feelings presented in gestures and music, and have developed a gesture acquisition device that measures grasping forces caused by user's twiddling actions by using compact pressure sensors and acceleration sensors. For the association of gesture patterns with sound parameters, a SOM algorithm is applied. The approach is considered to provide not only a new sound generation technique in the music scene, but also a flexible human-computer interface.

Original languageEnglish
Pages (from-to)115-123
Number of pages9
JournalJournal of New Music Research
Volume34
Issue number1
DOIs
Publication statusPublished - 2005 Jun 1
Externally publishedYes

Fingerprint

Hand Gesture
Sound
Expressive
Gesture
Musical Instruments
Emotion
Human-computer Interface
Sensor
Physical
Music
Music Scene

ASJC Scopus subject areas

  • Visual Arts and Performing Arts
  • Music

Cite this

A grasping device to sense hand gesture for expressive sound generation. / Hashimoto, Shuji; Sawada, Hideyuki.

In: Journal of New Music Research, Vol. 34, No. 1, 01.06.2005, p. 115-123.

Research output: Contribution to journalArticle

@article{2efbab547d9b416689961fcc80c22fe3,
title = "A grasping device to sense hand gesture for expressive sound generation",
abstract = "This article introduces a new device driven by emotional human twiddling gestures, and its application as a musical instrument. In traditional musical instruments, the relationship between the action and the generated sound is determined by the physical structures of the instruments. Although various computerized musical instruments have been actively developed and reported, the development of a human-computer interface is not sufficient for the translation of emotional feelings into sounds. We have so far paid attention to emotional feelings presented in gestures and music, and have developed a gesture acquisition device that measures grasping forces caused by user's twiddling actions by using compact pressure sensors and acceleration sensors. For the association of gesture patterns with sound parameters, a SOM algorithm is applied. The approach is considered to provide not only a new sound generation technique in the music scene, but also a flexible human-computer interface.",
author = "Shuji Hashimoto and Hideyuki Sawada",
year = "2005",
month = "6",
day = "1",
doi = "10.1080/09298210500124232",
language = "English",
volume = "34",
pages = "115--123",
journal = "Journal of New Music Research",
issn = "0929-8215",
publisher = "Taylor and Francis Ltd.",
number = "1",

}

TY - JOUR

T1 - A grasping device to sense hand gesture for expressive sound generation

AU - Hashimoto, Shuji

AU - Sawada, Hideyuki

PY - 2005/6/1

Y1 - 2005/6/1

N2 - This article introduces a new device driven by emotional human twiddling gestures, and its application as a musical instrument. In traditional musical instruments, the relationship between the action and the generated sound is determined by the physical structures of the instruments. Although various computerized musical instruments have been actively developed and reported, the development of a human-computer interface is not sufficient for the translation of emotional feelings into sounds. We have so far paid attention to emotional feelings presented in gestures and music, and have developed a gesture acquisition device that measures grasping forces caused by user's twiddling actions by using compact pressure sensors and acceleration sensors. For the association of gesture patterns with sound parameters, a SOM algorithm is applied. The approach is considered to provide not only a new sound generation technique in the music scene, but also a flexible human-computer interface.

AB - This article introduces a new device driven by emotional human twiddling gestures, and its application as a musical instrument. In traditional musical instruments, the relationship between the action and the generated sound is determined by the physical structures of the instruments. Although various computerized musical instruments have been actively developed and reported, the development of a human-computer interface is not sufficient for the translation of emotional feelings into sounds. We have so far paid attention to emotional feelings presented in gestures and music, and have developed a gesture acquisition device that measures grasping forces caused by user's twiddling actions by using compact pressure sensors and acceleration sensors. For the association of gesture patterns with sound parameters, a SOM algorithm is applied. The approach is considered to provide not only a new sound generation technique in the music scene, but also a flexible human-computer interface.

UR - http://www.scopus.com/inward/record.url?scp=33745750601&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745750601&partnerID=8YFLogxK

U2 - 10.1080/09298210500124232

DO - 10.1080/09298210500124232

M3 - Article

VL - 34

SP - 115

EP - 123

JO - Journal of New Music Research

JF - Journal of New Music Research

SN - 0929-8215

IS - 1

ER -