Choreographing amateur performers based on motion transfer between videos

Kenta Mizui, Makoto Okabe, Rikio Onai

Research output: Chapter in Book/Report/Conference proceedingConference contribution


We propose a technique for quickly and easily choreographing a video of an amateur performer by comparing it with a video of a corresponding professional performance. Our method allows the user to interactively edit the amateur performance in order to synchronize it with the professional performance in terms of timings and poses. In our system, the user first extracts the amateur and professional poses from every frame via semi-automatic video tracking. The system synchronizes the timings by computing dynamic time warping (DTW) between the two sets of video-tracking data, and then synchronizes the poses by applying image deformation to every frame. To eliminate unnatural vibrations, which often result from inaccurate video tracking, we apply an automatic motion-smoothing algorithm to the synthesized animation. We demonstrate that our method allows the user to successfully edit an amateur's performance into a more polished one, utilizing the Japanese sumo wrestling squat, the karate kick, and the moonwalk as examples.

Original languageEnglish
Title of host publicationAdvances in Multimedia Modeling - 19th International Conference, MMM 2013, Proceedings
Number of pages11
Volume7732 LNCS
EditionPART 1
Publication statusPublished - 2013
Externally publishedYes
Event19th International Conference on Advances in Multimedia Modeling, MMM 2013 - Huangshan
Duration: 2013 Jan 72013 Jan 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume7732 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other19th International Conference on Advances in Multimedia Modeling, MMM 2013


  • Shape deformation
  • Video editing

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Choreographing amateur performers based on motion transfer between videos'. Together they form a unique fingerprint.

Cite this