Understanding fake faces

Ryota Natsume, Kazuki Inoue, Yoshihiro Fukuhara, Shintaro Yamamoto, Shigeo Morishima, Hirokatsu Kataoka

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Face recognition research is one of the most active topics in computer vision (CV), and deep neural networks (DNN) are now filling the gap between human-level and computer-driven performance levels in face verification algorithms. However, although the performance gap appears to be narrowing in terms of accuracy-based expectations, a curious question has arisen; specifically, Face understanding of AI is really close to that of human? In the present study, in an effort to confirm the brain-driven concept, we conduct image-based detection, classification, and generation using an in-house created fake face database. This database has two configurations: (i) false positive face detections produced using both the Viola Jones (VJ) method and convolutional neural networks (CNN), and (ii) simulacra that have fundamental characteristics that resemble faces but are completely artificial. The results show a level of suggestive knowledge that indicates the continuing existence of a gap between the capabilities of recent vision-based face recognition algorithms and human-level performance. On a positive note, however, we have obtained knowledge that will advance the progress of face-understanding models.

    Original languageEnglish
    Title of host publicationComputer Vision – ECCV 2018 Workshops, Proceedings
    EditorsLaura Leal-Taixé, Stefan Roth
    PublisherSpringer-Verlag
    Pages566-576
    Number of pages11
    ISBN (Print)9783030110147
    DOIs
    Publication statusPublished - 2019 Jan 1
    Event15th European Conference on Computer Vision, ECCV 2018 - Munich, Germany
    Duration: 2018 Sep 82018 Sep 14

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume11131 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference15th European Conference on Computer Vision, ECCV 2018
    CountryGermany
    CityMunich
    Period18/9/818/9/14

    Fingerprint

    Face recognition
    Face
    Face Recognition
    Computer vision
    Neural Networks
    Brain
    Face Detection
    Neural networks
    Recognition Algorithm
    False Positive
    Computer Vision
    Configuration
    Human
    Knowledge

    Keywords

    • Face recognition
    • False positives
    • Simulacra

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • Computer Science(all)

    Cite this

    Natsume, R., Inoue, K., Fukuhara, Y., Yamamoto, S., Morishima, S., & Kataoka, H. (2019). Understanding fake faces. In L. Leal-Taixé, & S. Roth (Eds.), Computer Vision – ECCV 2018 Workshops, Proceedings (pp. 566-576). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11131 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-030-11015-4_42

    Understanding fake faces. / Natsume, Ryota; Inoue, Kazuki; Fukuhara, Yoshihiro; Yamamoto, Shintaro; Morishima, Shigeo; Kataoka, Hirokatsu.

    Computer Vision – ECCV 2018 Workshops, Proceedings. ed. / Laura Leal-Taixé; Stefan Roth. Springer-Verlag, 2019. p. 566-576 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11131 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Natsume, R, Inoue, K, Fukuhara, Y, Yamamoto, S, Morishima, S & Kataoka, H 2019, Understanding fake faces. in L Leal-Taixé & S Roth (eds), Computer Vision – ECCV 2018 Workshops, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11131 LNCS, Springer-Verlag, pp. 566-576, 15th European Conference on Computer Vision, ECCV 2018, Munich, Germany, 18/9/8. https://doi.org/10.1007/978-3-030-11015-4_42
    Natsume R, Inoue K, Fukuhara Y, Yamamoto S, Morishima S, Kataoka H. Understanding fake faces. In Leal-Taixé L, Roth S, editors, Computer Vision – ECCV 2018 Workshops, Proceedings. Springer-Verlag. 2019. p. 566-576. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-11015-4_42
    Natsume, Ryota ; Inoue, Kazuki ; Fukuhara, Yoshihiro ; Yamamoto, Shintaro ; Morishima, Shigeo ; Kataoka, Hirokatsu. / Understanding fake faces. Computer Vision – ECCV 2018 Workshops, Proceedings. editor / Laura Leal-Taixé ; Stefan Roth. Springer-Verlag, 2019. pp. 566-576 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{6b431d915bd74b2db916d7e773727f94,
    title = "Understanding fake faces",
    abstract = "Face recognition research is one of the most active topics in computer vision (CV), and deep neural networks (DNN) are now filling the gap between human-level and computer-driven performance levels in face verification algorithms. However, although the performance gap appears to be narrowing in terms of accuracy-based expectations, a curious question has arisen; specifically, Face understanding of AI is really close to that of human? In the present study, in an effort to confirm the brain-driven concept, we conduct image-based detection, classification, and generation using an in-house created fake face database. This database has two configurations: (i) false positive face detections produced using both the Viola Jones (VJ) method and convolutional neural networks (CNN), and (ii) simulacra that have fundamental characteristics that resemble faces but are completely artificial. The results show a level of suggestive knowledge that indicates the continuing existence of a gap between the capabilities of recent vision-based face recognition algorithms and human-level performance. On a positive note, however, we have obtained knowledge that will advance the progress of face-understanding models.",
    keywords = "Face recognition, False positives, Simulacra",
    author = "Ryota Natsume and Kazuki Inoue and Yoshihiro Fukuhara and Shintaro Yamamoto and Shigeo Morishima and Hirokatsu Kataoka",
    year = "2019",
    month = "1",
    day = "1",
    doi = "10.1007/978-3-030-11015-4_42",
    language = "English",
    isbn = "9783030110147",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    publisher = "Springer-Verlag",
    pages = "566--576",
    editor = "Laura Leal-Taix{\'e} and Stefan Roth",
    booktitle = "Computer Vision – ECCV 2018 Workshops, Proceedings",

    }

    TY - GEN

    T1 - Understanding fake faces

    AU - Natsume, Ryota

    AU - Inoue, Kazuki

    AU - Fukuhara, Yoshihiro

    AU - Yamamoto, Shintaro

    AU - Morishima, Shigeo

    AU - Kataoka, Hirokatsu

    PY - 2019/1/1

    Y1 - 2019/1/1

    N2 - Face recognition research is one of the most active topics in computer vision (CV), and deep neural networks (DNN) are now filling the gap between human-level and computer-driven performance levels in face verification algorithms. However, although the performance gap appears to be narrowing in terms of accuracy-based expectations, a curious question has arisen; specifically, Face understanding of AI is really close to that of human? In the present study, in an effort to confirm the brain-driven concept, we conduct image-based detection, classification, and generation using an in-house created fake face database. This database has two configurations: (i) false positive face detections produced using both the Viola Jones (VJ) method and convolutional neural networks (CNN), and (ii) simulacra that have fundamental characteristics that resemble faces but are completely artificial. The results show a level of suggestive knowledge that indicates the continuing existence of a gap between the capabilities of recent vision-based face recognition algorithms and human-level performance. On a positive note, however, we have obtained knowledge that will advance the progress of face-understanding models.

    AB - Face recognition research is one of the most active topics in computer vision (CV), and deep neural networks (DNN) are now filling the gap between human-level and computer-driven performance levels in face verification algorithms. However, although the performance gap appears to be narrowing in terms of accuracy-based expectations, a curious question has arisen; specifically, Face understanding of AI is really close to that of human? In the present study, in an effort to confirm the brain-driven concept, we conduct image-based detection, classification, and generation using an in-house created fake face database. This database has two configurations: (i) false positive face detections produced using both the Viola Jones (VJ) method and convolutional neural networks (CNN), and (ii) simulacra that have fundamental characteristics that resemble faces but are completely artificial. The results show a level of suggestive knowledge that indicates the continuing existence of a gap between the capabilities of recent vision-based face recognition algorithms and human-level performance. On a positive note, however, we have obtained knowledge that will advance the progress of face-understanding models.

    KW - Face recognition

    KW - False positives

    KW - Simulacra

    UR - http://www.scopus.com/inward/record.url?scp=85061694140&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85061694140&partnerID=8YFLogxK

    U2 - 10.1007/978-3-030-11015-4_42

    DO - 10.1007/978-3-030-11015-4_42

    M3 - Conference contribution

    AN - SCOPUS:85061694140

    SN - 9783030110147

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 566

    EP - 576

    BT - Computer Vision – ECCV 2018 Workshops, Proceedings

    A2 - Leal-Taixé, Laura

    A2 - Roth, Stefan

    PB - Springer-Verlag

    ER -