Post-recording tool for instant casting movie system

Shin Ichi Kawamoto, Shigeo Morishima, Tatsuo Yotsukura, Satoshi Nakamura

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    This paper proposes a universal user-friendly post-recording tool for an Instant Casting Movie System (ICS) that enables anyone to be a movie star using his or her own voice and faces. A personal CG character is automatically generated by scanning one's face geometry and image in ICS. Voice is as essential to identify a person as face. However, a character's voice is only based on gender in ICS. We proposed a novel voice recording tool for participants of all ages in a short time. Post-recording tasks are very difficult because speakers should speak in synchronization with the mouth movements of the CG characters. Therefore this task is generally recorded by professional voice actors. Our proposed tool has the following four features: 1) various supporting information for synchronization with voice and mouth movement timing for users; 2) automatic post-processing of recorded voices for compositing mixed audio; 3) intuitively displays operation for people of all ages; and 4) handles multiple users in parallel for quick recording. We developed a prototype speech synchronization system using a post-recording tool and conducted subjective evaluation experiments of it. Over 60% of the subjects responded that the tool's interface can be operated easily.

    Original languageEnglish
    Title of host publicationMM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops
    Pages893-896
    Number of pages4
    DOIs
    Publication statusPublished - 2008
    Event16th ACM International Conference on Multimedia, MM '08 - Vancouver, BC
    Duration: 2008 Oct 262008 Oct 31

    Other

    Other16th ACM International Conference on Multimedia, MM '08
    CityVancouver, BC
    Period08/10/2608/10/31

    Fingerprint

    Casting
    Synchronization
    Stars
    Scanning
    Geometry
    Processing
    Experiments

    Keywords

    • Instant casting movie system
    • Voice post-recording

    ASJC Scopus subject areas

    • Computer Graphics and Computer-Aided Design
    • Computer Vision and Pattern Recognition
    • Software

    Cite this

    Kawamoto, S. I., Morishima, S., Yotsukura, T., & Nakamura, S. (2008). Post-recording tool for instant casting movie system. In MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops (pp. 893-896) https://doi.org/10.1145/1459359.1459515

    Post-recording tool for instant casting movie system. / Kawamoto, Shin Ichi; Morishima, Shigeo; Yotsukura, Tatsuo; Nakamura, Satoshi.

    MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops. 2008. p. 893-896.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Kawamoto, SI, Morishima, S, Yotsukura, T & Nakamura, S 2008, Post-recording tool for instant casting movie system. in MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops. pp. 893-896, 16th ACM International Conference on Multimedia, MM '08, Vancouver, BC, 08/10/26. https://doi.org/10.1145/1459359.1459515
    Kawamoto SI, Morishima S, Yotsukura T, Nakamura S. Post-recording tool for instant casting movie system. In MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops. 2008. p. 893-896 https://doi.org/10.1145/1459359.1459515
    Kawamoto, Shin Ichi ; Morishima, Shigeo ; Yotsukura, Tatsuo ; Nakamura, Satoshi. / Post-recording tool for instant casting movie system. MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops. 2008. pp. 893-896
    @inproceedings{589e4f7771f64192bdbac2a2d223d101,
    title = "Post-recording tool for instant casting movie system",
    abstract = "This paper proposes a universal user-friendly post-recording tool for an Instant Casting Movie System (ICS) that enables anyone to be a movie star using his or her own voice and faces. A personal CG character is automatically generated by scanning one's face geometry and image in ICS. Voice is as essential to identify a person as face. However, a character's voice is only based on gender in ICS. We proposed a novel voice recording tool for participants of all ages in a short time. Post-recording tasks are very difficult because speakers should speak in synchronization with the mouth movements of the CG characters. Therefore this task is generally recorded by professional voice actors. Our proposed tool has the following four features: 1) various supporting information for synchronization with voice and mouth movement timing for users; 2) automatic post-processing of recorded voices for compositing mixed audio; 3) intuitively displays operation for people of all ages; and 4) handles multiple users in parallel for quick recording. We developed a prototype speech synchronization system using a post-recording tool and conducted subjective evaluation experiments of it. Over 60{\%} of the subjects responded that the tool's interface can be operated easily.",
    keywords = "Instant casting movie system, Voice post-recording",
    author = "Kawamoto, {Shin Ichi} and Shigeo Morishima and Tatsuo Yotsukura and Satoshi Nakamura",
    year = "2008",
    doi = "10.1145/1459359.1459515",
    language = "English",
    isbn = "9781605583037",
    pages = "893--896",
    booktitle = "MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops",

    }

    TY - GEN

    T1 - Post-recording tool for instant casting movie system

    AU - Kawamoto, Shin Ichi

    AU - Morishima, Shigeo

    AU - Yotsukura, Tatsuo

    AU - Nakamura, Satoshi

    PY - 2008

    Y1 - 2008

    N2 - This paper proposes a universal user-friendly post-recording tool for an Instant Casting Movie System (ICS) that enables anyone to be a movie star using his or her own voice and faces. A personal CG character is automatically generated by scanning one's face geometry and image in ICS. Voice is as essential to identify a person as face. However, a character's voice is only based on gender in ICS. We proposed a novel voice recording tool for participants of all ages in a short time. Post-recording tasks are very difficult because speakers should speak in synchronization with the mouth movements of the CG characters. Therefore this task is generally recorded by professional voice actors. Our proposed tool has the following four features: 1) various supporting information for synchronization with voice and mouth movement timing for users; 2) automatic post-processing of recorded voices for compositing mixed audio; 3) intuitively displays operation for people of all ages; and 4) handles multiple users in parallel for quick recording. We developed a prototype speech synchronization system using a post-recording tool and conducted subjective evaluation experiments of it. Over 60% of the subjects responded that the tool's interface can be operated easily.

    AB - This paper proposes a universal user-friendly post-recording tool for an Instant Casting Movie System (ICS) that enables anyone to be a movie star using his or her own voice and faces. A personal CG character is automatically generated by scanning one's face geometry and image in ICS. Voice is as essential to identify a person as face. However, a character's voice is only based on gender in ICS. We proposed a novel voice recording tool for participants of all ages in a short time. Post-recording tasks are very difficult because speakers should speak in synchronization with the mouth movements of the CG characters. Therefore this task is generally recorded by professional voice actors. Our proposed tool has the following four features: 1) various supporting information for synchronization with voice and mouth movement timing for users; 2) automatic post-processing of recorded voices for compositing mixed audio; 3) intuitively displays operation for people of all ages; and 4) handles multiple users in parallel for quick recording. We developed a prototype speech synchronization system using a post-recording tool and conducted subjective evaluation experiments of it. Over 60% of the subjects responded that the tool's interface can be operated easily.

    KW - Instant casting movie system

    KW - Voice post-recording

    UR - http://www.scopus.com/inward/record.url?scp=70350666491&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=70350666491&partnerID=8YFLogxK

    U2 - 10.1145/1459359.1459515

    DO - 10.1145/1459359.1459515

    M3 - Conference contribution

    AN - SCOPUS:70350666491

    SN - 9781605583037

    SP - 893

    EP - 896

    BT - MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops

    ER -