# Context-Aware Visual Compatibility Prediction

arXiv: https://arxiv.org/abs/1902.03646 · HTML: https://mlsanity.com/paper/1902.03646/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Feb 2019.

## Built on by (most cited first, 26 of 26)

- [LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On](https://mlsanity.com/paper/2305.13501/) (2023)
- [Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing](https://mlsanity.com/paper/2304.02051/) (2023)
- [OutfitTransformer: Learning Outfit Representations for Fashion Recommendation](https://mlsanity.com/paper/2204.04812/) (2022)
- [GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting](https://mlsanity.com/paper/2405.07472/) (2024)
- [Effectively Leveraging Attributes for Visual Similarity](https://mlsanity.com/paper/2105.01695/) (2021)
- [OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Data](https://mlsanity.com/paper/2309.05551/) (2023)
- [Semi-Supervised Visual Representation Learning for Fashion Compatibility](https://mlsanity.com/paper/2109.08052/) (2021)
- [UIGR: Unified Interactive Garment Retrieval](https://mlsanity.com/paper/2204.03111/) (2022)
- [Contextualizing Meta-Learning via Learning to Decompose](https://mlsanity.com/paper/2106.08112/) (2021)
- [Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing](https://mlsanity.com/paper/2403.14828/) (2024)
- [Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industry](https://mlsanity.com/paper/2111.00905/) (2021)
- [Fashion Recommendation Based on Style and Social Events](https://mlsanity.com/paper/2208.00725/) (2022)
- [Transformer-based Graph Neural Networks for Outfit Generation](https://mlsanity.com/paper/2304.08098/) (2023)
- [Estimating Fund-Raising Performance for Start-up Projects from a Market Graph Perspective](https://mlsanity.com/paper/2105.12918/) (2021)
- [SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shifts](https://mlsanity.com/paper/2108.12992/) (2021)
- [Hybrid-Hierarchical Fashion Graph Attention Network for Compatibility-Oriented and Personalized Outfit Recommendation](https://mlsanity.com/paper/2508.11105/) (2025)
- [fAshIon after fashion: A Report of AI in Fashion](https://mlsanity.com/paper/2105.03050/) (2021)
- [Unimodal vs. Multimodal Siamese Networks for Outfit Completion](https://mlsanity.com/paper/2207.10355/) (2022)
- [VICTOR: Visual Incompatibility Detection with Transformers and Fashion-specific contrastive pre-training](https://mlsanity.com/paper/2207.13458/) (2022)
- [Lost Your Style? Navigating with Semantic-Level Approach for Text-to-Outfit Retrieval](https://mlsanity.com/paper/2311.02122/) (2023)
- [Character-based Outfit Generation with Vision-augmented Style Extraction via LLMs](https://mlsanity.com/paper/2402.05941/) (2024)
- [Inductive learning for product assortment graph completion](https://mlsanity.com/paper/2110.01677/) (2021)
- [Main Product Detection with Graph Networks for Fashion](https://mlsanity.com/paper/2201.10431/) (2022)
- [Learning Fashion Compatibility from In-the-wild Images](https://mlsanity.com/paper/2206.05982/) (2022)
- [Outfit Completion via Conditional Set Transformation](https://mlsanity.com/paper/2311.16630/) (2023)
- [DPDEdit: Detail-Preserved Diffusion Models for Multimodal Fashion Image Editing](https://mlsanity.com/paper/2409.01086/) (2024)

## Abstract (arXiv)

How do we determine whether two or more clothing items are compatible or visually appealing? Part of the answer lies in understanding of visual aesthetics, and is biased by personal preferences shaped by social attitudes, time, and place. In this work we propose a method that predicts compatibility between two items based on their visual features, as well as their context. We define context as the products that are known to be compatible with each of these item. Our model is in contrast to other metric learning approaches that rely on pairwise comparisons between item features alone. We address the compatibility prediction problem using a graph neural network that learns to generate product embeddings conditioned on their context. We present results for two prediction tasks (fill in the blank and outfit compatibility) tested on two fashion datasets Polyvore and Fashion-Gen, and on a subset of the Amazon dataset; we achieve state of the art results when using context information and show how test performance improves as more context is used.
