Voice animator: Automatic lip-synching in limited animation by audio

Shoichi Furukawa, Tsukasa Fukusato, Shugo Yamaguchi, Shigeo Morishima

研究成果: Conference contribution

1 引用 (Scopus)

抜粋

Limited animation is one of the traditional techniques for producing cartoon animations. Owing to its expressive style, it has been enjoyed around the world. However, producing high quality animations using this limited style is time-consuming and costly for animators. Furthermore, proper synchronization between the voice-actor’s voice and the character’s mouth and lip motion requires well-experienced animators. This is essential because viewers are very sensitive to audio-lip discrepancies. In this paper, we propose a method that automatically creates high-quality limited-style lip-synched animations using audio tracks. Our system can be applied for creating not only the original animations but also dubbed ones independently of languages. Because our approach follows the standard workflow employed in cartoon animation production, our system can successfully assist animators. In addition, users can implement our system as a plug-in of a standard tool for creating animations (Adobe After Effects) and can easily arrange character lip motion to suit their own style. We visually evaluate our results both absolutely and relatively by comparing them with those of previous works. From the user evaluations, we confirm that our algorithms is able to successfully generate more natural audio-mouth synchronizations in limited-style lip-synched animations than previous algorithms.

元の言語English
ホスト出版物のタイトルAdvances in Computer Entertainment Technology - 14th International Conference, ACE 2017, Proceedings
編集者Masahiko Inami, Teresa Romao, Adrian David Cheok, Adrian David Cheok
出版者Springer Verlag
ページ153-171
ページ数19
ISBN(印刷物)9783319762692
DOI
出版物ステータスPublished - 2018
イベント14th International Conference on Advances in Computer Entertainment Technology, ACE 2017 - London, United Kingdom
継続期間: 2017 12 142017 12 16

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
10714 LNCS
ISSN(印刷物)0302-9743
ISSN(電子版)1611-3349

Other

Other14th International Conference on Advances in Computer Entertainment Technology, ACE 2017
United Kingdom
London
期間17/12/1417/12/16

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント Voice animator: Automatic lip-synching in limited animation by audio' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Furukawa, S., Fukusato, T., Yamaguchi, S., & Morishima, S. (2018). Voice animator: Automatic lip-synching in limited animation by audio. : M. Inami, T. Romao, A. D. Cheok, & A. D. Cheok (版), Advances in Computer Entertainment Technology - 14th International Conference, ACE 2017, Proceedings (pp. 153-171). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 10714 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-76270-8_12