DanceDJ: A 3D dance animation authoring system for live performance

Naoya Iwamoto, Takuya Kato, Hubert P.H. Shum, Ryo Kakitsuka, Kenta Hara, Shigeo Morishima

研究成果: Conference contribution

1 引用 (Scopus)

抜粋

Dance is an important component of live performance for expressing emotion and presenting visual context. Human dance performances typically require expert knowledge of dance choreography and professional rehearsal, which are too costly for casual entertainment venues and clubs. Recent advancements in character animation and motion synthesis have made it possible to synthesize virtual 3D dance characters in real-time. The major problem in existing systems is a lack of an intuitive interfaces to control the animation for real-time dance controls. We propose a new system called the DanceDJ to solve this problem. Our system consists of two parts. The first part is an underlying motion analysis system that evaluates motion features including dance features such as the postures and movement tempo, as well as audio features such as the music tempo and structure. As a pre-process, given a dancing motion database, our system evaluates the quality of possible timings to connect and switch different dancing motions. During run-time, we propose a control interface that provides visual guidance. We observe that disk jockeys (DJs) effectively control the mixing of music using the DJ controller, and therefore propose a DJ controller for controlling dancing characters. This allows DJs to transfer their skills from music control to dance control using a similar hardware setup. We map different motion control functions onto the DJ controller, and visualize the timing of natural connection points, such that the DJ can effectively govern the synthesized dance motion. We conducted two user experiments to evaluate the user experience and the quality of the dance character. Quantitative analysis shows that our system performs well in both motion control and simulation quality.

元の言語English
ホスト出版物のタイトルAdvances in Computer Entertainment Technology - 14th International Conference, ACE 2017, Proceedings
編集者Masahiko Inami, Teresa Romao, Adrian David Cheok, Adrian David Cheok
出版者Springer Verlag
ページ653-670
ページ数18
ISBN(印刷物)9783319762692
DOI
出版物ステータスPublished - 2018 1 1
イベント14th International Conference on Advances in Computer Entertainment Technology, ACE 2017 - London, United Kingdom
継続期間: 2017 12 142017 12 16

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
10714 LNCS
ISSN(印刷物)0302-9743
ISSN(電子版)1611-3349

Other

Other14th International Conference on Advances in Computer Entertainment Technology, ACE 2017
United Kingdom
London
期間17/12/1417/12/16

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント DanceDJ: A 3D dance animation authoring system for live performance' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Iwamoto, N., Kato, T., Shum, H. P. H., Kakitsuka, R., Hara, K., & Morishima, S. (2018). DanceDJ: A 3D dance animation authoring system for live performance. : M. Inami, T. Romao, A. D. Cheok, & A. D. Cheok (版), Advances in Computer Entertainment Technology - 14th International Conference, ACE 2017, Proceedings (pp. 653-670). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 10714 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-76270-8_46