FSNet: An Identity-Aware Generative Model for Image-Based Face Swapping

Ryota Natsume, Tatsuya Yatagawa, Shigeo Morishima

研究成果: Conference contribution

1 引用 (Scopus)

抜粋

This paper presents FSNet, a deep generative model for image-based face swapping. Traditionally, face-swapping methods are based on three-dimensional morphable models (3DMMs), and facial textures are replaced between the estimated three-dimensional (3D) geometries in two images of different individuals. However, the estimation of 3D geometries along with different lighting conditions using 3DMMs is still a difficult task. We herein represent the face region with a latent variable that is assigned with the proposed deep neural network (DNN) instead of facial textures. The proposed DNN synthesizes a face-swapped image using the latent variable of the face region and another image of the non-face region. The proposed method is not required to fit to the 3DMM; additionally, it performs face swapping only by feeding two face images to the proposed network. Consequently, our DNN-based face swapping performs better than previous approaches for challenging inputs with different face orientations and lighting conditions. Through several experiments, we demonstrated that the proposed method performs face swapping in a more stable manner than the state-of-the-art method, and that its results are compatible with the method thereof.

元の言語English
ホスト出版物のタイトルComputer Vision – ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers
編集者Greg Mori, Hongdong Li, C.V. Jawahar, Konrad Schindler
出版者Springer-Verlag
ページ117-132
ページ数16
ISBN(印刷物)9783030208752
DOI
出版物ステータスPublished - 2019 1 1
イベント14th Asian Conference on Computer Vision, ACCV 2018 - Perth, Australia
継続期間: 2018 12 22018 12 6

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11366 LNCS
ISSN(印刷物)0302-9743
ISSN(電子版)1611-3349

Conference

Conference14th Asian Conference on Computer Vision, ACCV 2018
Australia
Perth
期間18/12/218/12/6

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント FSNet: An Identity-Aware Generative Model for Image-Based Face Swapping' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Natsume, R., Yatagawa, T., & Morishima, S. (2019). FSNet: An Identity-Aware Generative Model for Image-Based Face Swapping. : G. Mori, H. Li, C. V. Jawahar, & K. Schindler (版), Computer Vision – ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers (pp. 117-132). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 11366 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-030-20876-9_8