Automatic face replacement for a humanoid robot with 3D face shape display

Akinobu Maejima, Takaaki Kuratate, Brennand Pierce, Shigeo Morishima, Gordon Cheng

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    4 Citations (Scopus)

    Abstract

    In this paper, we propose a method to apply any new face to a retro-projected 3D face system, the Mask-bot, which we have developed as a human-robot interface. The robot face using facial animation projected onto a 3D face mask can be quickly replaced by a new face based on a single frontal image of any person. Our contribution is to apply an automatic face replacement technique with the modified texture morphable model fitting to the 3D face mask. Using our technique, a face model displayed on Mask-bot can be automatically replaced within approximately 3 seconds, which makes Mask-bot widely suitable to applications such as video conferencing and cognitive experiments.

    Original languageEnglish
    Title of host publicationIEEE-RAS International Conference on Humanoid Robots
    Pages469-474
    Number of pages6
    DOIs
    Publication statusPublished - 2012
    Event2012 12th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2012 - Osaka
    Duration: 2012 Nov 292012 Dec 1

    Other

    Other2012 12th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2012
    CityOsaka
    Period12/11/2912/12/1

    Fingerprint

    Masks
    Display devices
    Robots
    Video conferencing
    Animation
    Textures
    Experiments

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Vision and Pattern Recognition
    • Hardware and Architecture
    • Human-Computer Interaction
    • Electrical and Electronic Engineering

    Cite this

    Maejima, A., Kuratate, T., Pierce, B., Morishima, S., & Cheng, G. (2012). Automatic face replacement for a humanoid robot with 3D face shape display. In IEEE-RAS International Conference on Humanoid Robots (pp. 469-474). [6651561] https://doi.org/10.1109/HUMANOIDS.2012.6651561

    Automatic face replacement for a humanoid robot with 3D face shape display. / Maejima, Akinobu; Kuratate, Takaaki; Pierce, Brennand; Morishima, Shigeo; Cheng, Gordon.

    IEEE-RAS International Conference on Humanoid Robots. 2012. p. 469-474 6651561.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Maejima, A, Kuratate, T, Pierce, B, Morishima, S & Cheng, G 2012, Automatic face replacement for a humanoid robot with 3D face shape display. in IEEE-RAS International Conference on Humanoid Robots., 6651561, pp. 469-474, 2012 12th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2012, Osaka, 12/11/29. https://doi.org/10.1109/HUMANOIDS.2012.6651561
    Maejima A, Kuratate T, Pierce B, Morishima S, Cheng G. Automatic face replacement for a humanoid robot with 3D face shape display. In IEEE-RAS International Conference on Humanoid Robots. 2012. p. 469-474. 6651561 https://doi.org/10.1109/HUMANOIDS.2012.6651561
    Maejima, Akinobu ; Kuratate, Takaaki ; Pierce, Brennand ; Morishima, Shigeo ; Cheng, Gordon. / Automatic face replacement for a humanoid robot with 3D face shape display. IEEE-RAS International Conference on Humanoid Robots. 2012. pp. 469-474
    @inproceedings{a47e60a9793b4592950b71f60fa1f696,
    title = "Automatic face replacement for a humanoid robot with 3D face shape display",
    abstract = "In this paper, we propose a method to apply any new face to a retro-projected 3D face system, the Mask-bot, which we have developed as a human-robot interface. The robot face using facial animation projected onto a 3D face mask can be quickly replaced by a new face based on a single frontal image of any person. Our contribution is to apply an automatic face replacement technique with the modified texture morphable model fitting to the 3D face mask. Using our technique, a face model displayed on Mask-bot can be automatically replaced within approximately 3 seconds, which makes Mask-bot widely suitable to applications such as video conferencing and cognitive experiments.",
    author = "Akinobu Maejima and Takaaki Kuratate and Brennand Pierce and Shigeo Morishima and Gordon Cheng",
    year = "2012",
    doi = "10.1109/HUMANOIDS.2012.6651561",
    language = "English",
    isbn = "9781467313698",
    pages = "469--474",
    booktitle = "IEEE-RAS International Conference on Humanoid Robots",

    }

    TY - GEN

    T1 - Automatic face replacement for a humanoid robot with 3D face shape display

    AU - Maejima, Akinobu

    AU - Kuratate, Takaaki

    AU - Pierce, Brennand

    AU - Morishima, Shigeo

    AU - Cheng, Gordon

    PY - 2012

    Y1 - 2012

    N2 - In this paper, we propose a method to apply any new face to a retro-projected 3D face system, the Mask-bot, which we have developed as a human-robot interface. The robot face using facial animation projected onto a 3D face mask can be quickly replaced by a new face based on a single frontal image of any person. Our contribution is to apply an automatic face replacement technique with the modified texture morphable model fitting to the 3D face mask. Using our technique, a face model displayed on Mask-bot can be automatically replaced within approximately 3 seconds, which makes Mask-bot widely suitable to applications such as video conferencing and cognitive experiments.

    AB - In this paper, we propose a method to apply any new face to a retro-projected 3D face system, the Mask-bot, which we have developed as a human-robot interface. The robot face using facial animation projected onto a 3D face mask can be quickly replaced by a new face based on a single frontal image of any person. Our contribution is to apply an automatic face replacement technique with the modified texture morphable model fitting to the 3D face mask. Using our technique, a face model displayed on Mask-bot can be automatically replaced within approximately 3 seconds, which makes Mask-bot widely suitable to applications such as video conferencing and cognitive experiments.

    UR - http://www.scopus.com/inward/record.url?scp=84886778921&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84886778921&partnerID=8YFLogxK

    U2 - 10.1109/HUMANOIDS.2012.6651561

    DO - 10.1109/HUMANOIDS.2012.6651561

    M3 - Conference contribution

    SN - 9781467313698

    SP - 469

    EP - 474

    BT - IEEE-RAS International Conference on Humanoid Robots

    ER -