PIFu: Pixel-aligned implicit function for high-resolution clothed human digitization

Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Hao Li, Angjoo Kanazawa

研究成果: Conference contribution

2 引用 (Scopus)

抜粋

We introduce Pixel-aligned Implicit Function (PIFu), an implicit representation that locally aligns pixels of 2D images with the global context of their corresponding 3D object. Using PIFu, we propose an end-to-end deep learning method for digitizing highly detailed clothed humans that can infer both 3D surface and texture from a single image, and optionally, multiple input images. Highly intricate shapes, such as hairstyles, clothing, as well as their variations and deformations can be digitized in a unified way. Compared to existing representations used for 3D deep learning, PIFu produces high-resolution surfaces including largely unseen regions such as the back of a person. In particular, it is memory efficient unlike the voxel representation, can handle arbitrary topology, and the resulting surface is spatially aligned with the input image. Furthermore, while previous techniques are designed to process either a single image or multiple views, PIFu extends naturally to arbitrary number of views. We demonstrate high-resolution and robust reconstructions on real world images from the DeepFashion dataset, which contains a variety of challenging clothing types. Our method achieves state-of-the-art performance on a public benchmark and outperforms the prior work for clothed human digitization from a single image.

元の言語English
ホスト出版物のタイトルProceedings - 2019 International Conference on Computer Vision, ICCV 2019
出版者Institute of Electrical and Electronics Engineers Inc.
ページ2304-2314
ページ数11
ISBN(電子版)9781728148038
DOI
出版物ステータスPublished - 2019 10
イベント17th IEEE/CVF International Conference on Computer Vision, ICCV 2019 - Seoul, Korea, Republic of
継続期間: 2019 10 272019 11 2

出版物シリーズ

名前Proceedings of the IEEE International Conference on Computer Vision
2019-October
ISSN(印刷物)1550-5499

Conference

Conference17th IEEE/CVF International Conference on Computer Vision, ICCV 2019
Korea, Republic of
Seoul
期間19/10/2719/11/2

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition

フィンガープリント PIFu: Pixel-aligned implicit function for high-resolution clothed human digitization' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Saito, S., Huang, Z., Natsume, R., Morishima, S., Li, H., & Kanazawa, A. (2019). PIFu: Pixel-aligned implicit function for high-resolution clothed human digitization. : Proceedings - 2019 International Conference on Computer Vision, ICCV 2019 (pp. 2304-2314). [9010814] (Proceedings of the IEEE International Conference on Computer Vision; 巻数 2019-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCV.2019.00239