Learning Type-Aware Embeddings for Fashion Compatibility
Not on the map. Why?
Abstract (arXiv)
Outfits in online fashion data are composed of items of many different types (e.g. top, bottom, shoes) that share some stylistic relationship with one another. A representation for building outfits requires a method that can learn both notions of similarity (for example, when two tops are interchangeable) and compatibility (items of possibly different type that can go together in an outfit). This paper presents an approach to learning an image embedding that respects item type, and jointly learns notions of item similarity and compatibility in an end-to-end model. To evaluate the learned representation, we crawled 68,306 outfits created by users on the Polyvore website. Our approach obtains 3-5% improvement over the state-of-the-art on outfit compatibility prediction and fill-in-the-blank tasks using our dataset, as well as an established smaller dataset, while supporting a variety of useful queries.
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 13; 2022: 18; 2023: 8; 2024: 4; 2025: 12; 2026: 5.
61 papers.
Sort:
By area:
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 46
- 2022FashionViL: Fashion-Focused Vision-and-Language Representation Learningcited by 32
- 2023S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captionscited by 29
- 2022OutfitTransformer: Learning Outfit Representations for Fashion Recommendationcited by 24
- 2022Masked Vision-Language Transformer in Fashioncited by 14
- 2023FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-trainingcited by 14
- 2021Fine-Grained Fashion Similarity Prediction by Attribute-Specific Embedding Learningcited by 12
- 2021Effectively Leveraging Attributes for Visual Similaritycited by 9
- 2021Semi-Supervised Visual Representation Learning for Fashion Compatibilitycited by 8
- 2021From Culture to Clothing: Discovering the World Events Behind A Century of Fashion Imagescited by 7
- 2022UIGR: Unified Interactive Garment Retrievalcited by 6
38 more
- 2021Exploring AI in Fashion: A Review of Aesthetics, Personalization, Virtual Try-On, and Forecastingcited by 4
- 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industrycited by 4
- 2022Identifying Ambiguous Similarity Conditions via Semantic Matchingcited by 4
- 2025Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Frameworkcited by 4
- 2018Give me a hint! Navigating Image Databases using Human-in-the-loop Feedbackcited by 3
- 2021Hierarchical Similarity Learning for Language-based Product Image Retrievalcited by 3
- 2022SAT: Self-adaptive training for fashion compatibility predictioncited by 3
- 2022Fashion Recommendation Based on Style and Social Eventscited by 3
- 2023Transformer-based Graph Neural Networks for Outfit Generationcited by 3
- 2023Data-Side Efficiencies for Lightweight Convolutional Neural Networkscited by 3
- 2023Multi-modal Extreme Classificationcited by 3
- 2021Attribute-aware Explainable Complementary Clothing Recommendationcited by 2
- 2021SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shiftscited by 2
- 2021Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddingscited by 2
- 2022Active metric learning and classification using similarity queriescited by 2
- 2022Deep Compatible Learning for Partially-Supervised Medical Image Segmentationcited by 2
- 2024Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tagscited by 2
- 2025COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Stylescited by 2
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applicationscited by 2
- 2025FashionM3: Multimodal, Multitask, and Multiround Fashion Assistant based on Unified Vision-Language Modelcited by 2
- 2025Hybrid-Hierarchical Fashion Graph Attention Network for Compatibility-Oriented and Personalized Outfit Recommendationcited by 2
- 2025TATTOO: Training-free AesTheTic-aware Outfit recOmmendationcited by 2
- 2021fAshIon after fashion: A Report of AI in Fashioncited by 1
- 2022Unimodal vs. Multimodal Siamese Networks for Outfit Completioncited by 1
- 2022VICTOR: Visual Incompatibility Detection with Transformers and Fashion-specific contrastive pre-trainingcited by 1
- 2023Lost Your Style? Navigating with Semantic-Level Approach for Text-to-Outfit Retrievalcited by 1
- 2024Character-based Outfit Generation with Vision-augmented Style Extraction via LLMscited by 1
- 2024FashionFail: Addressing Failure Cases in Fashion Object Detection and Segmentationcited by 1
- 2025Integrating Domain Knowledge into Large Language Models for Enhanced Fashion Recommendationscited by 1
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Modelscited by 1
- 2026Topology-Aware Representation Alignment for Semi-Supervised Vision-Language Learningcited by 1
- 2021Inductive learning for product assortment graph completioncited by 0
- 2022Main Product Detection with Graph Networks for Fashioncited by 0
- 2022Recommendation of Compatible Outfits Conditioned on Stylecited by 0
- 2022An Application to Generate Style Guided Compatible Outfitcited by 0
- 2022Learning Fashion Compatibility from In-the-wild Imagescited by 0
- 2022Partial Visual-Semantic Embedding: Fashion Intelligence System with Sensitive Part-by-Part Learningcited by 0
- 2022Outfit Generation and Recommendation -- An Experimental Studycited by 0
50 most cited of 61 All 61 (JSON)
- 2026Autonomous Fashion Outfit Composition via Unified Aesthetic Foresight Model14 Aug 2026
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric20 Jul 2026
- 2026Loom: Hybrid Retrieval-Scoring Outfit Recommendation with Semantic Material Compatibility and Occasion-Aware Embedding Priors11 May 2026
- 2026Topology-Aware Representation Alignment for Semi-Supervised Vision-Language Learning29 Apr 2026
- 2026Recommending Composite Items Using Multi-Level Preference Information: A Joint Interaction Modeling Approach26 Jan 2026
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Models26 Dec 2025
- 2025A Hybrid Multimodal Deep Learning Framework for Intelligent Fashion Recommendation10 Nov 2025
- 2025TATTOO: Training-free AesTheTic-aware Outfit recOmmendation27 Sep 2025
- 2025Hybrid-Hierarchical Fashion Graph Attention Network for Compatibility-Oriented and Personalized Outfit Recommendation14 Aug 2025
- 2025KiseKloset for Fashion Retrieval and Recommendation30 Jun 2025
- 2025FashionM3: Multimodal, Multitask, and Multiround Fashion Assistant based on Unified Vision-Language Model24 Apr 2025
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applications3 Mar 2025
38 more
- 2025COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Styles12 Feb 2025
- 2025Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework5 Feb 2025
- 2025BC-GAN: A Generative Adversarial Network for Synthesizing a Batch of Collocated Clothing3 Feb 2025
- 2025FCBoost-Net: A Generative Network for Synthesizing Multiple Collocated Outfits via Fashion Compatibility Boosting3 Feb 2025
- 2025Integrating Domain Knowledge into Large Language Models for Enhanced Fashion Recommendations3 Jan 2025
- 2024Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags16 Jun 2024
- 2024FashionFail: Addressing Failure Cases in Fashion Object Detection and Segmentation12 Apr 2024
- 2024Interactive Garment Recommendation with User in the Loop18 Feb 2024
- 2024Character-based Outfit Generation with Vision-augmented Style Extraction via LLMs2 Feb 2024
- 2023Lost Your Style? Navigating with Semantic-Level Approach for Text-to-Outfit Retrieval3 Nov 2023
- 2023Multi-modal Extreme Classification10 Sep 2023
- 2023Data-Side Efficiencies for Lightweight Convolutional Neural Networks24 Aug 2023
- 2023ICAR: Image-based Complementary Auto Reasoning17 Aug 2023
- 2023GeneCIS: A Benchmark for General Conditional Image Similarity13 Jun 2023
- 2023S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions23 May 2023
- 2023Transformer-based Graph Neural Networks for Outfit Generation17 Apr 2023
- 2023FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-training11 Apr 2023
- 2022Semi-supervised Fashion Compatibility Prediction by Color Distortion Prediction27 Dec 2022
- 2022Outfit Generation and Recommendation -- An Experimental Study29 Nov 2022
- 2022Partial Visual-Semantic Embedding: Fashion Intelligence System with Sensitive Part-by-Part Learning12 Nov 2022
- 2022Masked Vision-Language Transformer in Fashion27 Oct 2022
- 2022Fashion Recommendation Based on Style and Social Events1 Aug 2022
- 2022VICTOR: Visual Incompatibility Detection with Transformers and Fashion-specific contrastive pre-training27 Jul 2022
- 2022Unimodal vs. Multimodal Siamese Networks for Outfit Completion21 Jul 2022
- 2022FashionViL: Fashion-Focused Vision-and-Language Representation Learning17 Jul 2022
- 2022SAT: Self-adaptive training for fashion compatibility prediction25 Jun 2022
- 2022Deep Compatible Learning for Partially-Supervised Medical Image Segmentation18 Jun 2022
- 2022Learning Fashion Compatibility from In-the-wild Images13 Jun 2022
- 2022An Application to Generate Style Guided Compatible Outfit2 May 2022
- 2022OutfitTransformer: Learning Outfit Representations for Fashion Recommendation11 Apr 2022
- 2022Identifying Ambiguous Similarity Conditions via Semantic Matching8 Apr 2022
- 2022UIGR: Unified Interactive Garment Retrieval6 Apr 2022
- 2022Recommendation of Compatible Outfits Conditioned on Style30 Mar 2022
- 2022Active metric learning and classification using similarity queries4 Feb 2022
- 2022Main Product Detection with Graph Networks for Fashion25 Jan 2022
- 2021Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddings6 Dec 2021
- 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industry28 Oct 2021
- 2021Inductive learning for product assortment graph completion4 Oct 2021
50 newest of 61 All 61 (JSON)
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
- 2023S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captionscited by 29
- 2023FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-trainingcited by 14
- 2024Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tagscited by 2
- 2025FashionM3: Multimodal, Multitask, and Multiround Fashion Assistant based on Unified Vision-Language Modelcited by 2
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Modelscited by 1
- 2026Topology-Aware Representation Alignment for Semi-Supervised Vision-Language Learningcited by 1
- 2026Topology-Aware Representation Alignment for Semi-Supervised Vision-Language Learning29 Apr 2026
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Models26 Dec 2025
- 2025FashionM3: Multimodal, Multitask, and Multiround Fashion Assistant based on Unified Vision-Language Model24 Apr 2025
- 2024Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags16 Jun 2024
- 2023S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions23 May 2023
- 2023FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-training11 Apr 2023
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domain30 Mar 2021
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 46
- 2022FashionViL: Fashion-Focused Vision-and-Language Representation Learningcited by 32
- 2022OutfitTransformer: Learning Outfit Representations for Fashion Recommendationcited by 24
- 2022Masked Vision-Language Transformer in Fashioncited by 14
- 2021Fine-Grained Fashion Similarity Prediction by Attribute-Specific Embedding Learningcited by 12
- 2021Effectively Leveraging Attributes for Visual Similaritycited by 9
- 2021Semi-Supervised Visual Representation Learning for Fashion Compatibilitycited by 8
- 2021From Culture to Clothing: Discovering the World Events Behind A Century of Fashion Imagescited by 7
- 2022UIGR: Unified Interactive Garment Retrievalcited by 6
- 2021Exploring AI in Fashion: A Review of Aesthetics, Personalization, Virtual Try-On, and Forecastingcited by 4
- 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industrycited by 4
- 2022Identifying Ambiguous Similarity Conditions via Semantic Matchingcited by 4
12 most cited of 52 All 52 (JSON)
- 2026Autonomous Fashion Outfit Composition via Unified Aesthetic Foresight Model14 Aug 2026
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric20 Jul 2026
- 2026Loom: Hybrid Retrieval-Scoring Outfit Recommendation with Semantic Material Compatibility and Occasion-Aware Embedding Priors11 May 2026
- 2026Recommending Composite Items Using Multi-Level Preference Information: A Joint Interaction Modeling Approach26 Jan 2026
- 2025A Hybrid Multimodal Deep Learning Framework for Intelligent Fashion Recommendation10 Nov 2025
- 2025TATTOO: Training-free AesTheTic-aware Outfit recOmmendation27 Sep 2025
- 2025Hybrid-Hierarchical Fashion Graph Attention Network for Compatibility-Oriented and Personalized Outfit Recommendation14 Aug 2025
- 2025KiseKloset for Fashion Retrieval and Recommendation30 Jun 2025
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applications3 Mar 2025
- 2025COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Styles12 Feb 2025
- 2025Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework5 Feb 2025
- 2025BC-GAN: A Generative Adversarial Network for Synthesizing a Batch of Collocated Clothing3 Feb 2025
12 newest of 52 All 52 (JSON)