mlsanityData to 14 Oct 2026

LRVS-Fashion: Extending Visual Search with Referring Instructions

arXiv 2306.02928 ↗First posted 5 Jun 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper introduces a new challenge for image similarity search in the context of fashion, addressing the inherent ambiguity in this domain stemming from complex images. We present Referred Visual Search (RVS), a task allowing users to define more precisely the desired similarity, following recent interest in the industry. We release a new large public dataset, LRVS-Fashion, consisting of 272k fashion products with 842k images extracted from fashion catalogs, designed explicitly for this task. However, unlike traditional visual search methods in the industry, we demonstrate that superior performance can be achieved by bypassing explicit object detection and adopting weakly-supervised conditional contrastive learning on image tuples. Our method is lightweight and demonstrates robustness, reaching Recall at one superior to strong detection-based baselines against 2M distractors. The dataset is available at https://huggingface.co/datasets/Slep/LAION-RVS-Fashion .

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 39 of its 78 references that are in the map. First posted on arXiv 5 Jun 2023.

Builds on

39 of 78 references.

References · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  7. 2017Billion-scale similarity search with GPUscited by 2,497
  8. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  9. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  10. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
  11. 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
  12. 2021Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Conceptscited by 256
27 more
  1. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
  2. 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
  3. 2020Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentationcited by 204
  4. 2022Language as Queries for Referring Video Object Segmentationcited by 182
  5. 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
  6. 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 134
  7. 2020Referring Image Segmentation via Cross-Modal Progressive Comprehensioncited by 131
  8. 2022Task-aware Retrieval with Instructionscited by 107
  9. 2018Dialog-based Interactive Image Retrievalcited by 84
  10. 2020A Decade Survey of Content Based Image Retrieval using Deep Learningcited by 72
  11. 2015Cross-domain Image Retrieval with a Dual Attribute-aware Ranking Networkcited by 53
  12. 2022Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularizationcited by 45
  13. 2021Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-modal Pretrainingcited by 42
  14. 2021Conversational Fashion Image Retrieval via Multiturn Natural Language Feedbackcited by 29
  15. 2021Visual Search at Alibabacited by 27
  16. 2017Visual Search at eBaycited by 25
  17. 2019Learning a Unified Embedding for Visual Search at Pinterestcited by 25
  18. 2022CommerceMM: Large-Scale Commerce MultiModal Representation Learning with Omni Retrievalcited by 25
  19. 2015Visual Search at Pinterestcited by 19
  20. 2017Discriminative Bimodal Networks for Visual Localization and Detection with Natural Language Queriescited by 17
  21. 2020Fine-Grained Fashion Similarity Learning by Attribute-Specific Embedding Networkcited by 17
  22. 2018Web-Scale Responsive Visual Search at Bingcited by 13
  23. 2020Shop The Look: Building a Large Scale Visual Shopping System at Pinterestcited by 12
  24. 2021Fine-Grained Fashion Similarity Prediction by Attribute-Specific Embedding Learningcited by 12
  25. 2023MAKE: Vision-Language Pre-training based Product Retrieval in Taobao Searchcited by 9
  26. 2022UIGR: Unified Interactive Garment Retrievalcited by 6
  27. 2018Studio2Shop: from studio photo shoots to fashion articlescited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

  1. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  2. 2024Controllable Human Image Generation with Personalized Multi-Garmentscited by 5
  3. 2025You Only Forward Once: An Efficient Compositional Judging Paradigmcited by 1
  4. 2026Dress-ED: Instruction-Guided Editing for Virtual Try-On and Try-Offcited by 0