Cosmetic features extraction by a single image makeup decomposition

Kanami Yamagishi, Shintaro Yamamoto, Takuya Kato, Shigeo Morishima

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    In recent years, a large number of makeup images have been shared on social media. Most of these images lack information about the cosmetics used, such as color, glitter or etc., while they are difficult to infer due to the diversity of skin color or lighting conditions. In this paper, our goal is to estimate cosmetic features only from a single makeup image. Previous work has measured the material parameters of cosmetic products from pairs of images showing the face with and without makeup, but such comparison images are not always available. Furthermore, this method cannot represent local effects such as pearl or glitter since they adapted physically-based reflectance models. We propose a novel image-based method to extract cosmetic features considering both color and local effects by decomposing the target image into makeup and skin color using Difference of Gaussian (DoG). Our method can be applied for single, standalone makeup images, and considers both local effects and color. In addition, our method is robust to the skin color difference due to the decomposition separating makeup from skin. The experimental results demonstrate that our method is more robust to skin color difference and captures characteristics of each cosmetic product.

    Original languageEnglish
    Title of host publicationProceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018
    PublisherIEEE Computer Society
    Pages1965-1967
    Number of pages3
    Volume2018-June
    ISBN (Electronic)9781538661000
    DOIs
    Publication statusPublished - 2018 Dec 13
    Event31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018 - Salt Lake City, United States
    Duration: 2018 Jun 182018 Jun 22

    Other

    Other31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018
    CountryUnited States
    CitySalt Lake City
    Period18/6/1818/6/22

    Fingerprint

    Feature extraction
    Color
    Decomposition
    Skin
    Cosmetics
    Lighting

    ASJC Scopus subject areas

    • Computer Vision and Pattern Recognition
    • Electrical and Electronic Engineering

    Cite this

    Yamagishi, K., Yamamoto, S., Kato, T., & Morishima, S. (2018). Cosmetic features extraction by a single image makeup decomposition. In Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018 (Vol. 2018-June, pp. 1965-1967). [8575413] IEEE Computer Society. https://doi.org/10.1109/CVPRW.2018.00248

    Cosmetic features extraction by a single image makeup decomposition. / Yamagishi, Kanami; Yamamoto, Shintaro; Kato, Takuya; Morishima, Shigeo.

    Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018. Vol. 2018-June IEEE Computer Society, 2018. p. 1965-1967 8575413.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Yamagishi, K, Yamamoto, S, Kato, T & Morishima, S 2018, Cosmetic features extraction by a single image makeup decomposition. in Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018. vol. 2018-June, 8575413, IEEE Computer Society, pp. 1965-1967, 31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018, Salt Lake City, United States, 18/6/18. https://doi.org/10.1109/CVPRW.2018.00248
    Yamagishi K, Yamamoto S, Kato T, Morishima S. Cosmetic features extraction by a single image makeup decomposition. In Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018. Vol. 2018-June. IEEE Computer Society. 2018. p. 1965-1967. 8575413 https://doi.org/10.1109/CVPRW.2018.00248
    Yamagishi, Kanami ; Yamamoto, Shintaro ; Kato, Takuya ; Morishima, Shigeo. / Cosmetic features extraction by a single image makeup decomposition. Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018. Vol. 2018-June IEEE Computer Society, 2018. pp. 1965-1967
    @inproceedings{3a35e595e55a46c6a85c0f3efc2b6e80,
    title = "Cosmetic features extraction by a single image makeup decomposition",
    abstract = "In recent years, a large number of makeup images have been shared on social media. Most of these images lack information about the cosmetics used, such as color, glitter or etc., while they are difficult to infer due to the diversity of skin color or lighting conditions. In this paper, our goal is to estimate cosmetic features only from a single makeup image. Previous work has measured the material parameters of cosmetic products from pairs of images showing the face with and without makeup, but such comparison images are not always available. Furthermore, this method cannot represent local effects such as pearl or glitter since they adapted physically-based reflectance models. We propose a novel image-based method to extract cosmetic features considering both color and local effects by decomposing the target image into makeup and skin color using Difference of Gaussian (DoG). Our method can be applied for single, standalone makeup images, and considers both local effects and color. In addition, our method is robust to the skin color difference due to the decomposition separating makeup from skin. The experimental results demonstrate that our method is more robust to skin color difference and captures characteristics of each cosmetic product.",
    author = "Kanami Yamagishi and Shintaro Yamamoto and Takuya Kato and Shigeo Morishima",
    year = "2018",
    month = "12",
    day = "13",
    doi = "10.1109/CVPRW.2018.00248",
    language = "English",
    volume = "2018-June",
    pages = "1965--1967",
    booktitle = "Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018",
    publisher = "IEEE Computer Society",

    }

    TY - GEN

    T1 - Cosmetic features extraction by a single image makeup decomposition

    AU - Yamagishi, Kanami

    AU - Yamamoto, Shintaro

    AU - Kato, Takuya

    AU - Morishima, Shigeo

    PY - 2018/12/13

    Y1 - 2018/12/13

    N2 - In recent years, a large number of makeup images have been shared on social media. Most of these images lack information about the cosmetics used, such as color, glitter or etc., while they are difficult to infer due to the diversity of skin color or lighting conditions. In this paper, our goal is to estimate cosmetic features only from a single makeup image. Previous work has measured the material parameters of cosmetic products from pairs of images showing the face with and without makeup, but such comparison images are not always available. Furthermore, this method cannot represent local effects such as pearl or glitter since they adapted physically-based reflectance models. We propose a novel image-based method to extract cosmetic features considering both color and local effects by decomposing the target image into makeup and skin color using Difference of Gaussian (DoG). Our method can be applied for single, standalone makeup images, and considers both local effects and color. In addition, our method is robust to the skin color difference due to the decomposition separating makeup from skin. The experimental results demonstrate that our method is more robust to skin color difference and captures characteristics of each cosmetic product.

    AB - In recent years, a large number of makeup images have been shared on social media. Most of these images lack information about the cosmetics used, such as color, glitter or etc., while they are difficult to infer due to the diversity of skin color or lighting conditions. In this paper, our goal is to estimate cosmetic features only from a single makeup image. Previous work has measured the material parameters of cosmetic products from pairs of images showing the face with and without makeup, but such comparison images are not always available. Furthermore, this method cannot represent local effects such as pearl or glitter since they adapted physically-based reflectance models. We propose a novel image-based method to extract cosmetic features considering both color and local effects by decomposing the target image into makeup and skin color using Difference of Gaussian (DoG). Our method can be applied for single, standalone makeup images, and considers both local effects and color. In addition, our method is robust to the skin color difference due to the decomposition separating makeup from skin. The experimental results demonstrate that our method is more robust to skin color difference and captures characteristics of each cosmetic product.

    UR - http://www.scopus.com/inward/record.url?scp=85060842073&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85060842073&partnerID=8YFLogxK

    U2 - 10.1109/CVPRW.2018.00248

    DO - 10.1109/CVPRW.2018.00248

    M3 - Conference contribution

    VL - 2018-June

    SP - 1965

    EP - 1967

    BT - Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018

    PB - IEEE Computer Society

    ER -