Choreographing amateur performers based on motion transfer between videos

Kenta Mizui, Makoto Okabe, Rikio Onai

研究成果: Conference contribution

抄録

We propose a technique for quickly and easily choreographing a video of an amateur performer by comparing it with a video of a corresponding professional performance. Our method allows the user to interactively edit the amateur performance in order to synchronize it with the professional performance in terms of timings and poses. In our system, the user first extracts the amateur and professional poses from every frame via semi-automatic video tracking. The system synchronizes the timings by computing dynamic time warping (DTW) between the two sets of video-tracking data, and then synchronizes the poses by applying image deformation to every frame. To eliminate unnatural vibrations, which often result from inaccurate video tracking, we apply an automatic motion-smoothing algorithm to the synthesized animation. We demonstrate that our method allows the user to successfully edit an amateur's performance into a more polished one, utilizing the Japanese sumo wrestling squat, the karate kick, and the moonwalk as examples.

本文言語English
ホスト出版物のタイトルAdvances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings
ページ502-512
ページ数11
7732 LNCS
PART 1
DOI
出版ステータスPublished - 2013
外部発表はい
イベント19th International Conference on Advances in Multimedia Modeling, MMM 2013 - Huangshan
継続期間: 2013 1 72013 1 9

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
番号PART 1
7732 LNCS
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

Other

Other19th International Conference on Advances in Multimedia Modeling, MMM 2013
CityHuangshan
Period13/1/713/1/9

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)

フィンガープリント

「Choreographing amateur performers based on motion transfer between videos」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル