Automatic facial animation generation system of dancing characters considering emotion in dance and music

Wakana Asahina, Narumi Okada, Naoya Iwamoto, Taro Masuda, Tsukasa Fukusato, Shigeo Morishima

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

In recent years, a lot of 3D character dance animation movies are created by amateur users using 3DCG animation editing tools (e.g. MikuMikuDance). Whereas, most of them are created manually. Then automatic facial animation system for dancing character will be useful to create dance movies and visualize impressions effec- tively. Therefore, we address the challenging theme to estimate dancing character's emotions (we call "dance emotion"). In previ- ous work considering music features, DiPaola et al. [2006] pro- posed music-driven emotionally expressive face system. To de- tect the mood of the input music, they used a hierarchical frame- work (Thayer model), and achieved to generate facial animation that matches music emotion. However, their model can't express subtleties of emotion between two emotions because input music divided into few moods sharply using Gaussian mixture model. In addition, they decide more detailed moods based on the psychologi- cal rules that uses score information, so they requires MIDI data. In this paper, we propose "dance emotion model" to visualize danc- ing character's emotion as facial expression. Our model is built by the coordinate information frame by frame on the emotional space through perceptional experiment using music and dance mo- tion database without MIDI data. Moreover, by considering the displacement on the emotional space, we can express not only a certain emotion but also subtleties of emotions. As the result, our system got a higher accuracy comparing with the previous work. We can create the facial expression result soon by inputting audio data and synchronized motion. It is shown the utility through the comparison with previous work in Figure 1.

本文言語English
ホスト出版物のタイトルSIGGRAPH Asia 2015 Posters, SA 2015
出版社Association for Computing Machinery, Inc
ISBN(電子版)9781450339261
DOI
出版ステータスPublished - 2015 11 2
イベントSIGGRAPH Asia, SA 2015 - Kobe, Japan
継続期間: 2015 11 22015 11 6

出版物シリーズ

名前SIGGRAPH Asia 2015 Posters, SA 2015

Other

OtherSIGGRAPH Asia, SA 2015
国/地域Japan
CityKobe
Period15/11/215/11/6

ASJC Scopus subject areas

  • 人間とコンピュータの相互作用
  • コンピュータ グラフィックスおよびコンピュータ支援設計
  • コンピュータ ビジョンおよびパターン認識

フィンガープリント

「Automatic facial animation generation system of dancing characters considering emotion in dance and music」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル