Gesture recognition using an acceleration sensor and its application to musical performance control

Hideyuki Sawada, Shuji Hashimoto

    Research output: Contribution to journalArticle

    31 Citations (Scopus)

    Abstract

    It is understood that nonverbal means of communication are more important than verbal communication in the transmission of intention or emotion. Gestures using body or hand are typical nonverbal means of communication. Human intention or emotion appears to be expressed to a greater extent by the force applied to the body than by the position of the hand. The authors noted that the force acting during motion can be sensed as an acceleration and therefore attempted recognition of gestures with a three-dimensional acceleration sensor. In the experiments using this system, the changes of the acceleration, the rotational force, and the directional distribution of the acceleration are determined from the sequential three-dimensional acceleration data, as features of the motion. By examining the extent of matching to standard patterns, ten kinds of gestures can be discriminated with a nearly 100 percent recognition rate. A real-time music control system is also constructed by applying the proposed method. Compared to the conventional methods using image processing or the data gloves, in the new system the delay in tempo detection is shorter and the mechanism is simpler. The system gives a clue to the design of flexible and sensitive man-machine interfaces based on gesture.

    Original languageEnglish
    Pages (from-to)9-17
    Number of pages9
    JournalElectronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)
    Volume80
    Issue number5
    Publication statusPublished - 1997 May

    Fingerprint

    Gesture recognition
    Sensors
    Communication
    Image processing
    Control systems
    Experiments

    Keywords

    • Acceleration
    • Gesture
    • Man-machine interface
    • Musical performance control
    • Tempo detection

    ASJC Scopus subject areas

    • Electrical and Electronic Engineering

    Cite this

    @article{12f00260d18546ed8bb77ae1011be5c6,
    title = "Gesture recognition using an acceleration sensor and its application to musical performance control",
    abstract = "It is understood that nonverbal means of communication are more important than verbal communication in the transmission of intention or emotion. Gestures using body or hand are typical nonverbal means of communication. Human intention or emotion appears to be expressed to a greater extent by the force applied to the body than by the position of the hand. The authors noted that the force acting during motion can be sensed as an acceleration and therefore attempted recognition of gestures with a three-dimensional acceleration sensor. In the experiments using this system, the changes of the acceleration, the rotational force, and the directional distribution of the acceleration are determined from the sequential three-dimensional acceleration data, as features of the motion. By examining the extent of matching to standard patterns, ten kinds of gestures can be discriminated with a nearly 100 percent recognition rate. A real-time music control system is also constructed by applying the proposed method. Compared to the conventional methods using image processing or the data gloves, in the new system the delay in tempo detection is shorter and the mechanism is simpler. The system gives a clue to the design of flexible and sensitive man-machine interfaces based on gesture.",
    keywords = "Acceleration, Gesture, Man-machine interface, Musical performance control, Tempo detection",
    author = "Hideyuki Sawada and Shuji Hashimoto",
    year = "1997",
    month = "5",
    language = "English",
    volume = "80",
    pages = "9--17",
    journal = "Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)",
    issn = "1042-0967",
    publisher = "John Wiley and Sons Inc.",
    number = "5",

    }

    TY - JOUR

    T1 - Gesture recognition using an acceleration sensor and its application to musical performance control

    AU - Sawada, Hideyuki

    AU - Hashimoto, Shuji

    PY - 1997/5

    Y1 - 1997/5

    N2 - It is understood that nonverbal means of communication are more important than verbal communication in the transmission of intention or emotion. Gestures using body or hand are typical nonverbal means of communication. Human intention or emotion appears to be expressed to a greater extent by the force applied to the body than by the position of the hand. The authors noted that the force acting during motion can be sensed as an acceleration and therefore attempted recognition of gestures with a three-dimensional acceleration sensor. In the experiments using this system, the changes of the acceleration, the rotational force, and the directional distribution of the acceleration are determined from the sequential three-dimensional acceleration data, as features of the motion. By examining the extent of matching to standard patterns, ten kinds of gestures can be discriminated with a nearly 100 percent recognition rate. A real-time music control system is also constructed by applying the proposed method. Compared to the conventional methods using image processing or the data gloves, in the new system the delay in tempo detection is shorter and the mechanism is simpler. The system gives a clue to the design of flexible and sensitive man-machine interfaces based on gesture.

    AB - It is understood that nonverbal means of communication are more important than verbal communication in the transmission of intention or emotion. Gestures using body or hand are typical nonverbal means of communication. Human intention or emotion appears to be expressed to a greater extent by the force applied to the body than by the position of the hand. The authors noted that the force acting during motion can be sensed as an acceleration and therefore attempted recognition of gestures with a three-dimensional acceleration sensor. In the experiments using this system, the changes of the acceleration, the rotational force, and the directional distribution of the acceleration are determined from the sequential three-dimensional acceleration data, as features of the motion. By examining the extent of matching to standard patterns, ten kinds of gestures can be discriminated with a nearly 100 percent recognition rate. A real-time music control system is also constructed by applying the proposed method. Compared to the conventional methods using image processing or the data gloves, in the new system the delay in tempo detection is shorter and the mechanism is simpler. The system gives a clue to the design of flexible and sensitive man-machine interfaces based on gesture.

    KW - Acceleration

    KW - Gesture

    KW - Man-machine interface

    KW - Musical performance control

    KW - Tempo detection

    UR - http://www.scopus.com/inward/record.url?scp=0031140935&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=0031140935&partnerID=8YFLogxK

    M3 - Article

    VL - 80

    SP - 9

    EP - 17

    JO - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

    JF - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

    SN - 1042-0967

    IS - 5

    ER -