Neuroaesthetics in fashion

Modeling the perception of fashionability

Edgar Simo Serra, Sanja Fidler, Francesc Moreno-Noguer, Raquel Urtasun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

86 Citations (Scopus)

Abstract

In this paper, we analyze the fashion of clothing of a large social website. Our goal is to learn and predict how fashionable a person looks on a photograph and suggest subtle improvements the user could make to improve her/his appeal. We propose a Conditional Random Field model that jointly reasons about several fashionability factors such as the type of outfit and garments the user is wearing, the type of the user, the photograph's setting (e.g., the scenery behind the user), and the fashionability score. Importantly, our model is able to give rich feedback back to the user, conveying which garments or even scenery she/he should change in order to improve fashionability. We demonstrate that our joint approach significantly outperforms a variety of intelligent baselines. We additionally collected a novel heterogeneous dataset with 144,169 user posts containing diverse image, textual and meta information which can be exploited for our task. We also provide a detailed analysis of the data, showing different outfit trends and fashionability scores across the globe and across a span of 6 years.

Original languageEnglish
Title of host publicationIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
PublisherIEEE Computer Society
Pages869-877
Number of pages9
Volume07-12-June-2015
ISBN (Electronic)9781467369640
DOIs
Publication statusPublished - 2015 Oct 14
Externally publishedYes
EventIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 - Boston, United States
Duration: 2015 Jun 72015 Jun 12

Other

OtherIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
CountryUnited States
CityBoston
Period15/6/715/6/12

Fingerprint

Conveying
Websites
Feedback

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Simo Serra, E., Fidler, S., Moreno-Noguer, F., & Urtasun, R. (2015). Neuroaesthetics in fashion: Modeling the perception of fashionability. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 (Vol. 07-12-June-2015, pp. 869-877). [7298688] IEEE Computer Society. https://doi.org/10.1109/CVPR.2015.7298688

Neuroaesthetics in fashion : Modeling the perception of fashionability. / Simo Serra, Edgar; Fidler, Sanja; Moreno-Noguer, Francesc; Urtasun, Raquel.

IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. Vol. 07-12-June-2015 IEEE Computer Society, 2015. p. 869-877 7298688.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Simo Serra, E, Fidler, S, Moreno-Noguer, F & Urtasun, R 2015, Neuroaesthetics in fashion: Modeling the perception of fashionability. in IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. vol. 07-12-June-2015, 7298688, IEEE Computer Society, pp. 869-877, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, United States, 15/6/7. https://doi.org/10.1109/CVPR.2015.7298688
Simo Serra E, Fidler S, Moreno-Noguer F, Urtasun R. Neuroaesthetics in fashion: Modeling the perception of fashionability. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. Vol. 07-12-June-2015. IEEE Computer Society. 2015. p. 869-877. 7298688 https://doi.org/10.1109/CVPR.2015.7298688
Simo Serra, Edgar ; Fidler, Sanja ; Moreno-Noguer, Francesc ; Urtasun, Raquel. / Neuroaesthetics in fashion : Modeling the perception of fashionability. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. Vol. 07-12-June-2015 IEEE Computer Society, 2015. pp. 869-877
@inproceedings{5dc3fd022f6949f6bbf616c146e5a3cd,
title = "Neuroaesthetics in fashion: Modeling the perception of fashionability",
abstract = "In this paper, we analyze the fashion of clothing of a large social website. Our goal is to learn and predict how fashionable a person looks on a photograph and suggest subtle improvements the user could make to improve her/his appeal. We propose a Conditional Random Field model that jointly reasons about several fashionability factors such as the type of outfit and garments the user is wearing, the type of the user, the photograph's setting (e.g., the scenery behind the user), and the fashionability score. Importantly, our model is able to give rich feedback back to the user, conveying which garments or even scenery she/he should change in order to improve fashionability. We demonstrate that our joint approach significantly outperforms a variety of intelligent baselines. We additionally collected a novel heterogeneous dataset with 144,169 user posts containing diverse image, textual and meta information which can be exploited for our task. We also provide a detailed analysis of the data, showing different outfit trends and fashionability scores across the globe and across a span of 6 years.",
author = "{Simo Serra}, Edgar and Sanja Fidler and Francesc Moreno-Noguer and Raquel Urtasun",
year = "2015",
month = "10",
day = "14",
doi = "10.1109/CVPR.2015.7298688",
language = "English",
volume = "07-12-June-2015",
pages = "869--877",
booktitle = "IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015",
publisher = "IEEE Computer Society",
address = "United States",

}

TY - GEN

T1 - Neuroaesthetics in fashion

T2 - Modeling the perception of fashionability

AU - Simo Serra, Edgar

AU - Fidler, Sanja

AU - Moreno-Noguer, Francesc

AU - Urtasun, Raquel

PY - 2015/10/14

Y1 - 2015/10/14

N2 - In this paper, we analyze the fashion of clothing of a large social website. Our goal is to learn and predict how fashionable a person looks on a photograph and suggest subtle improvements the user could make to improve her/his appeal. We propose a Conditional Random Field model that jointly reasons about several fashionability factors such as the type of outfit and garments the user is wearing, the type of the user, the photograph's setting (e.g., the scenery behind the user), and the fashionability score. Importantly, our model is able to give rich feedback back to the user, conveying which garments or even scenery she/he should change in order to improve fashionability. We demonstrate that our joint approach significantly outperforms a variety of intelligent baselines. We additionally collected a novel heterogeneous dataset with 144,169 user posts containing diverse image, textual and meta information which can be exploited for our task. We also provide a detailed analysis of the data, showing different outfit trends and fashionability scores across the globe and across a span of 6 years.

AB - In this paper, we analyze the fashion of clothing of a large social website. Our goal is to learn and predict how fashionable a person looks on a photograph and suggest subtle improvements the user could make to improve her/his appeal. We propose a Conditional Random Field model that jointly reasons about several fashionability factors such as the type of outfit and garments the user is wearing, the type of the user, the photograph's setting (e.g., the scenery behind the user), and the fashionability score. Importantly, our model is able to give rich feedback back to the user, conveying which garments or even scenery she/he should change in order to improve fashionability. We demonstrate that our joint approach significantly outperforms a variety of intelligent baselines. We additionally collected a novel heterogeneous dataset with 144,169 user posts containing diverse image, textual and meta information which can be exploited for our task. We also provide a detailed analysis of the data, showing different outfit trends and fashionability scores across the globe and across a span of 6 years.

UR - http://www.scopus.com/inward/record.url?scp=84959252973&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84959252973&partnerID=8YFLogxK

U2 - 10.1109/CVPR.2015.7298688

DO - 10.1109/CVPR.2015.7298688

M3 - Conference contribution

VL - 07-12-June-2015

SP - 869

EP - 877

BT - IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015

PB - IEEE Computer Society

ER -