Automatic sign dance synthesis from gesture-based sign language

Naoya Iwamoto, Hubert P.H. Shum, Wakana Asahina, Shigeo Morishima

研究成果: Conference contribution

1 引用 (Scopus)

抜粋

Automatic dance synthesis has become more and more popular due to the increasing demand in computer games and animations. Existing research generates dance motions without much consideration for the context of the music. In reality, professional dancers make choreography according to the lyrics and music features. In this research, we focus on a particular genre of dance known as sign dance, which combines gesture-based sign language with full body dance motion. We propose a system to automatically generate sign dance from a piece of music and its corresponding sign gesture. The core of the system is a Sign Dance Model trained by multiple regression analysis to represent the correlations between sign dance and sign gesture/music, as well as a set of objective functions to evaluate the quality of the sign dance. Our system can be applied to music visualization, allowing people with hearing difficulties to understand and enjoy music.

元の言語English
ホスト出版物のタイトルProceedings - MIG 2019
ホスト出版物のサブタイトルACM Conference on Motion, Interaction, and Games
編集者Stephen N. Spencer
出版者Association for Computing Machinery, Inc
ISBN(電子版)9781450369947
DOI
出版物ステータスPublished - 2019 10 28
イベント2019 ACM Conference on Motion, Interaction, and Games, MIG 2019 - Newcastle upon Tyne, United Kingdom
継続期間: 2019 10 282019 10 30

出版物シリーズ

名前Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games

Conference

Conference2019 ACM Conference on Motion, Interaction, and Games, MIG 2019
United Kingdom
Newcastle upon Tyne
期間19/10/2819/10/30

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction
  • Education

フィンガープリント Automatic sign dance synthesis from gesture-based sign language' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Iwamoto, N., Shum, H. P. H., Asahina, W., & Morishima, S. (2019). Automatic sign dance synthesis from gesture-based sign language. : S. N. Spencer (版), Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games [a18] (Proceedings - MIG 2019: ACM Conference on Motion, Interaction, and Games). Association for Computing Machinery, Inc. https://doi.org/10.1145/3359566.3360069