Post-recording tool for instant casting movie system

Shin Ichi Kawamoto, Shigeo Morishima, Tatsuo Yotsukura, Satoshi Nakamura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a universal user-friendly post-recording tool for an Instant Casting Movie System (ICS) that enables anyone to be a movie star using his or her own voice and faces. A personal CG character is automatically generated by scanning one's face geometry and image in ICS. Voice is as essential to identify a person as face. However, a character's voice is only based on gender in ICS. We proposed a novel voice recording tool for participants of all ages in a short time. Post-recording tasks are very difficult because speakers should speak in synchronization with the mouth movements of the CG characters. Therefore this task is generally recorded by professional voice actors. Our proposed tool has the following four features: 1) various supporting information for synchronization with voice and mouth movement timing for users; 2) automatic post-processing of recorded voices for compositing mixed audio; 3) intuitively displays operation for people of all ages; and 4) handles multiple users in parallel for quick recording. We developed a prototype speech synchronization system using a post-recording tool and conducted subjective evaluation experiments of it. Over 60% of the subjects responded that the tool's interface can be operated easily.

Original languageEnglish
Title of host publicationMM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops
Pages893-896
Number of pages4
DOIs
Publication statusPublished - 2008 Dec 1
Event16th ACM International Conference on Multimedia, MM '08 - Vancouver, BC, Canada
Duration: 2008 Oct 262008 Oct 31

Publication series

NameMM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops

Conference

Conference16th ACM International Conference on Multimedia, MM '08
CountryCanada
CityVancouver, BC
Period08/10/2608/10/31

    Fingerprint

Keywords

  • Instant casting movie system
  • Voice post-recording

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Kawamoto, S. I., Morishima, S., Yotsukura, T., & Nakamura, S. (2008). Post-recording tool for instant casting movie system. In MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops (pp. 893-896). (MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops). https://doi.org/10.1145/1459359.1459515