mlsanityData to 14 Oct 2026

Contrastive language and vision learning of general fashion concepts

arXiv 2204.03972 ↗First posted 8 Apr 2022cs.IR cs.CLcited by 42

Not on the map. Why?

Abstract (arXiv)

The steady rise of online shopping goes hand in hand with the development of increasingly complex ML and NLP models. While most use cases are cast as specialized supervised learning problems, we argue that practitioners would greatly benefit from more transferable representations of products. In this work, we build on recent developments in contrastive learning to train FashionCLIP, a CLIP-like model for the fashion industry. We showcase its capabilities for retrieval, classification and grounding, and release our model and code to the community.

Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). Builds on 45 of its 109 references that are in the map. First posted on arXiv 8 Apr 2022.

Builds on

45 of 109 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  6. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  7. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  8. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
  9. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
  10. 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
  11. 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 436
  12. 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 372
33 more
  1. 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 244
  2. 2022A Contrastive Framework for Neural Text Generationcited by 225
  3. 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
  4. 2021Salient ImageNet: How to discover spurious features in Deep Learning?cited by 114
  5. 2022Learning Audio-Video Modalities from Image Captionscited by 80
  6. 2021Everything at Once -- Multi-modal Fusion Transformer for Video Retrievalcited by 79
  7. 2020Out of Order: How Important Is The Sequential Order of Words in a Sentence in Natural Language Understanding Tasks?cited by 73
  8. 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognitioncited by 68
  9. 2021Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?cited by 55
  10. 2020Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Modelscited by 50
  11. 2018End-to-End Retrieval in Continuous Spacecited by 46
  12. 2021Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of otherscited by 39
  13. 2018Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Applicationcited by 34
  14. 2018ModaNet: A Large-Scale Street Fashion Dataset with Polygon Annotationscited by 33
  15. 2016Meta-Prod2Vec - Product Embeddings Using Side-Information for Recommendationcited by 30
  16. 2020Fashion Meets Computer Vision: A Surveycited by 30
  17. 2021Reading Isn't Believing: Adversarial Attacks On Multi-Modal Neuronscited by 29
  18. 2018Interactive Grounded Language Acquisition and Generalization in a 2D Worldcited by 21
  19. 2018Word2Vec applied to Recommendation: Hyperparameters Mattercited by 20
  20. 2021Contrastive Language-Image Pre-training for the Italian Languagecited by 19
  21. 2020Fantastic Embeddings and How to Align Them: Zero-Shot Inference in a Multi-Shop Scenariocited by 16
  22. 2021CMA-CLIP: Cross-Modality Attention CLIP for Image-Text Classificationcited by 16
  23. 2020Investigating Vulnerability to Adversarial Examples on Multimodal Data Fusion in Deep Learningcited by 11
  24. 2016Product Classification in E-Commerce using Distributional Semanticscited by 9
  25. 2021Query2Prod2Vec Grounded Word Embeddings for eCommercecited by 8
  26. 2021Model-agnostic vs. Model-intrinsic Interpretability for Explainable Product Searchcited by 7
  27. 2020Shopping in the Multiverse: A Counterfactual Approach to In-Session Attributioncited by 5
  28. 2021Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine Interactioncited by 5
  29. 2021You Do Not Need a Bigger Boat: Recommendations at Reasonable Scale in a (Mostly) Serverless and Open Stackcited by 5
  30. 2020"An Image is Worth a Thousand Features": Scalable Product Representations for In-Session Type-Ahead Personalizationcited by 4
  31. 2022"Does it come in black?" CLIP-like models are zero-shot recommenderscited by 4
  32. 2019On the Importance of News Content Representation in Hybrid Neural Session-based Recommender Systemscited by 3
  33. 2021Deep Learning-based Online Alternative Product Recommendations at Scalecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 9; 2024: 10; 2025: 13; 2026: 10.

42 papers.

Sort:

By area:

  1. 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
  2. 2024Garment3DGen: 3D Garment Stylization and Texture Generationcited by 26
  3. 2024BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversitycited by 24
  4. 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Detailscited by 19
  5. 2025A Comprehensive Survey on Composed Image Retrievalcited by 17
  6. 2023ViLLA: Fine-Grained Vision-Language Representation Learning from Real-World Datacited by 9
  7. 2023OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Datacited by 9
  8. 2025MOON: Generative MLLM-based Multimodal Representation Learning for E-commerce Product Understandingcited by 7
  9. 2024Captions Speak Louder than Images: Generalizing Foundation Models for E-commerce from High-quality Multimodal Instruction Datacited by 6
  10. 2023Reasonable Scale Machine Learning with Open-Source Metaflowcited by 5
  11. 2024Lightweight Unsupervised Federated Learning with Pretrained Vision Language Modelcited by 5
  12. 2025Open-Vocabulary Semantic Part Segmentation of 3D Humancited by 5
30 more
  1. 2025EcomMMMU: Strategic Utilization of Visuals for Robust Multimodal E-commerce Modelscited by 5
  2. 2025MOON2.0: Dynamic Modality-balanced Multimodal Representation Learning for E-commerce Product Understandingcited by 5
  3. 2025Seeing the Abstract: Translating the Abstract Language for Vision Language Modelscited by 4
  4. 2025Can GPT-4o mini and Gemini 2.0 Flash Predict Fine-Grained Fashion Product Attributes? A Zero-Shot Analysiscited by 3
  5. 2023Delving into E-Commerce Product Retrieval with Vision-Language Pre-trainingcited by 2
  6. 2024TriplePlay: Enhancing Federated Learning with CLIP for Non-IID Data and Resource Efficiencycited by 2
  7. 2025A Text-to-3D Framework for Joint Generation of CG-Ready Humans and Compatible Garmentscited by 2
  8. 2025TATTOO: Training-free AesTheTic-aware Outfit recOmmendationcited by 2
  9. 2023CorrEmbed: Evaluating Pre-trained Model Image Similarity Efficacy with a Novel Metriccited by 1
  10. 2023AI Recommendation System for Enhanced Customer Experience: A Novel Image-to-Text Methodcited by 1
  11. 2024Assessing Graphical Perception of Image Embedding Models using Channel Effectivenesscited by 1
  12. 2026Zero-Shot Product Attribute Labeling with Vision-Language Models: A Three-Tier Evaluation Frameworkcited by 1
  13. 2026ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrievalcited by 1
  14. 2023(Vector) Space is Not the Final Frontier: Product Search as Program Synthesiscited by 0
  15. 2023Dataset Factory: A Toolchain For Generative Computer Vision Datasetscited by 0
  16. 2024Fashion Style Editing with Generative Human Priorcited by 0
  17. 2024Reflective Human-Machine Co-adaptation for Enhanced Text-to-Image Generation Dialogue Systemcited by 0
  18. 2024ENCLIP: Ensembling and Clustering-Based Contrastive Language-Image Pretraining for Fashion Multimodal Search with Limited Data and Low-Quality Imagescited by 0
  19. 2025Agentic Personalized Fashion Recommendation in the Age of Generative AI: Challenges, Opportunities, and Evaluationcited by 0
  20. 2025Performance-Efficiency Trade-off for Fashion Image Retrievalcited by 0
  21. 2025Embedding the Teacher: Distilling vLLM Preferences for Scalable Image Retrievalcited by 0
  22. 2025LookSync: Large-Scale Visual Product Search System for AI-Generated Fashion Lookscited by 0
  23. 2026OmniFashion: Towards Generalist Fashion Intelligence via Multi-Task Vision-Language Learningcited by 0
  24. 2026VCG: A Multimodal Retrieval Framework for E-Commerce Video Feeds under Extreme Cold-Start Conditionscited by 0
  25. 2026Diverse-Intent Multi-Turn Fashion Image Retrievalcited by 0
  26. 2026Autonomous Fashion Outfit Composition via Unified Aesthetic Foresight Modelcited by 0
  27. 2026HMGCLIP: Heterogeneous Multi-Granularity Contrastive Learning for E-commerce Representation Learningcited by 0
  28. 2026CVE-SAI: Counterfactual Visual Evidence-Guided Selective Attribute Indexing for Risk-Controlled E-commerce Searchcited by 0
  29. 2026The MODA General Attribute Suite: A Four-Track Evaluation Benchmark for Fashion Attribute Extractioncited by 0
  30. 2026FASHION-RQ: Mining Hierarchical Semantic Structure for Automated Evaluation of Fashion Retrievalcited by 0