Realistic facial animation by automatic individual head modeling and facial muscle adjustment

Akinobu Maejima, Hiroyuki Kubo, Shigeo Morishima

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    We propose a technique for automatically generating a realistic facial animation with precise individual facial geometry and characteristic facial expressions. Our method is divided into two key methods: the head modeling process automatically generates a whole head model only from facial range scan data, the facial animation setup process automatically generates key shapes which represent individual facial expressions based on physics-based facial muscle simulation with an individual muscle layout estimated from facial expression videos. Facial animations considering individual characteristics can be synthesized using the generated head model and key shapes. Experimental results show that the proposed method can generate facial animations where 84% of subjects can identify themselves. Therefore, we conclude that our head modeling techniques are effective to entertainment system like a Future Cast.

    Original languageEnglish
    Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Pages260-269
    Number of pages10
    Volume6774 LNCS
    EditionPART 2
    DOIs
    Publication statusPublished - 2011
    Event4th International Conference on Virtual and Mixed Reality, Held as Part of HCI International 2011 - Orlando, FL
    Duration: 2011 Jul 92011 Jul 14

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    NumberPART 2
    Volume6774 LNCS
    ISSN (Print)03029743
    ISSN (Electronic)16113349

    Other

    Other4th International Conference on Virtual and Mixed Reality, Held as Part of HCI International 2011
    CityOrlando, FL
    Period11/7/911/7/14

    Fingerprint

    Facial Animation
    Animation
    Muscle
    Facial Expression
    Adjustment
    Modeling
    Process Modeling
    Layout
    Physics
    Geometry
    Experimental Results
    Model
    Range of data
    Simulation

    Keywords

    • Automatic Mesh Completion
    • Facial Animation Synthesis
    • Facial Muscle Layout Estimation
    • Individual Head Model
    • Key Shape Generation

    ASJC Scopus subject areas

    • Computer Science(all)
    • Theoretical Computer Science

    Cite this

    Maejima, A., Kubo, H., & Morishima, S. (2011). Realistic facial animation by automatic individual head modeling and facial muscle adjustment. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 2 ed., Vol. 6774 LNCS, pp. 260-269). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6774 LNCS, No. PART 2). https://doi.org/10.1007/978-3-642-22024-1_29

    Realistic facial animation by automatic individual head modeling and facial muscle adjustment. / Maejima, Akinobu; Kubo, Hiroyuki; Morishima, Shigeo.

    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6774 LNCS PART 2. ed. 2011. p. 260-269 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6774 LNCS, No. PART 2).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Maejima, A, Kubo, H & Morishima, S 2011, Realistic facial animation by automatic individual head modeling and facial muscle adjustment. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 edn, vol. 6774 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 6774 LNCS, pp. 260-269, 4th International Conference on Virtual and Mixed Reality, Held as Part of HCI International 2011, Orlando, FL, 11/7/9. https://doi.org/10.1007/978-3-642-22024-1_29
    Maejima A, Kubo H, Morishima S. Realistic facial animation by automatic individual head modeling and facial muscle adjustment. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 ed. Vol. 6774 LNCS. 2011. p. 260-269. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). https://doi.org/10.1007/978-3-642-22024-1_29
    Maejima, Akinobu ; Kubo, Hiroyuki ; Morishima, Shigeo. / Realistic facial animation by automatic individual head modeling and facial muscle adjustment. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6774 LNCS PART 2. ed. 2011. pp. 260-269 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).
    @inproceedings{18d8e5796edb4896bdc4593f4e32abe6,
    title = "Realistic facial animation by automatic individual head modeling and facial muscle adjustment",
    abstract = "We propose a technique for automatically generating a realistic facial animation with precise individual facial geometry and characteristic facial expressions. Our method is divided into two key methods: the head modeling process automatically generates a whole head model only from facial range scan data, the facial animation setup process automatically generates key shapes which represent individual facial expressions based on physics-based facial muscle simulation with an individual muscle layout estimated from facial expression videos. Facial animations considering individual characteristics can be synthesized using the generated head model and key shapes. Experimental results show that the proposed method can generate facial animations where 84{\%} of subjects can identify themselves. Therefore, we conclude that our head modeling techniques are effective to entertainment system like a Future Cast.",
    keywords = "Automatic Mesh Completion, Facial Animation Synthesis, Facial Muscle Layout Estimation, Individual Head Model, Key Shape Generation",
    author = "Akinobu Maejima and Hiroyuki Kubo and Shigeo Morishima",
    year = "2011",
    doi = "10.1007/978-3-642-22024-1_29",
    language = "English",
    isbn = "9783642220234",
    volume = "6774 LNCS",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    number = "PART 2",
    pages = "260--269",
    booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    edition = "PART 2",

    }

    TY - GEN

    T1 - Realistic facial animation by automatic individual head modeling and facial muscle adjustment

    AU - Maejima, Akinobu

    AU - Kubo, Hiroyuki

    AU - Morishima, Shigeo

    PY - 2011

    Y1 - 2011

    N2 - We propose a technique for automatically generating a realistic facial animation with precise individual facial geometry and characteristic facial expressions. Our method is divided into two key methods: the head modeling process automatically generates a whole head model only from facial range scan data, the facial animation setup process automatically generates key shapes which represent individual facial expressions based on physics-based facial muscle simulation with an individual muscle layout estimated from facial expression videos. Facial animations considering individual characteristics can be synthesized using the generated head model and key shapes. Experimental results show that the proposed method can generate facial animations where 84% of subjects can identify themselves. Therefore, we conclude that our head modeling techniques are effective to entertainment system like a Future Cast.

    AB - We propose a technique for automatically generating a realistic facial animation with precise individual facial geometry and characteristic facial expressions. Our method is divided into two key methods: the head modeling process automatically generates a whole head model only from facial range scan data, the facial animation setup process automatically generates key shapes which represent individual facial expressions based on physics-based facial muscle simulation with an individual muscle layout estimated from facial expression videos. Facial animations considering individual characteristics can be synthesized using the generated head model and key shapes. Experimental results show that the proposed method can generate facial animations where 84% of subjects can identify themselves. Therefore, we conclude that our head modeling techniques are effective to entertainment system like a Future Cast.

    KW - Automatic Mesh Completion

    KW - Facial Animation Synthesis

    KW - Facial Muscle Layout Estimation

    KW - Individual Head Model

    KW - Key Shape Generation

    UR - http://www.scopus.com/inward/record.url?scp=79960424959&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=79960424959&partnerID=8YFLogxK

    U2 - 10.1007/978-3-642-22024-1_29

    DO - 10.1007/978-3-642-22024-1_29

    M3 - Conference contribution

    AN - SCOPUS:79960424959

    SN - 9783642220234

    VL - 6774 LNCS

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 260

    EP - 269

    BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    ER -