Fashion intelligence system: An outfit interpretation utilizing images and rich abstract tags

Ryotaro Shimizu*, Yuki Saito, Megumi Matsutani, Masayuki Goto

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In recent years, it has become common for consumers to familiarize themselves with the latest fashion trends through the internet and engage in their own fashion-inspired shopping activities. Therefore, making fashion-inspired shopping and browsing activities (internet surfing in the fashion domain) comfortable is essential because it leads to interactions in the fashion industry. However, fashion is a fuzzy and complex domain that contains many abstract elements, and this ambiguity and complexity can hinder users’ deep interest in the fashion industry. Therefore, we define a novel technology and domain called “fashion intelligence” and propose a system based on a visual-semantic embedding method for automatically learning and interpreting fashion and obtaining answers to users’ questions. Our proposed method can embed the abundant abstract tag information in the same projective space as outfit images. Mapping of images and tags in a projective space helps search for outfit images using fashion-specific abstract words. In addition, visually estimating the degree of relevance between images and tags helps interpret abstract words. As a result, this research helps decrease fashion-specific ambiguity and complexity and supports the marketing activities and fashion choices of both experts and non-experts.

Original languageEnglish
Article number119167
JournalExpert Systems with Applications
Volume213
DOIs
Publication statusPublished - 2023 Mar 1

Keywords

  • Attribute activation map
  • Fashion intelligence
  • Fashion interpretation
  • Image retrieval
  • Outfit image
  • Visual-semantic embedding

ASJC Scopus subject areas

  • Engineering(all)
  • Computer Science Applications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Fashion intelligence system: An outfit interpretation utilizing images and rich abstract tags'. Together they form a unique fingerprint.

Cite this