mlsanityData to 7 Oct 2026

LookBench: A Live and Holistic Open Benchmark for Fashion Image Retrieval

arXiv 2601.14706 ↗First posted 21 Jan 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

In this paper, we present LookBench (We use the term "look" to reflect retrieval that mirrors how people shop -- finding the exact item, a close substitute, or a visually consistent alternative.), a live, holistic and challenging benchmark for fashion image retrieval in real e-commerce settings. LookBench includes both recent product images sourced from live websites and AI-generated fashion images, reflecting contemporary trends and use cases. Each test sample is time-stamped and we intend to update the benchmark periodically, enabling contamination-aware evaluation aligned with declared training cutoffs. Grounded in our fine-grained attribute taxonomy, LookBench covers single-item and outfit-level retrieval across. Our experiments reveal that LookBench poses a significant challenge on strong baselines, with many models achieving below 60% Recall@1. Our proprietary model achieves the best performance on LookBench, and we release an open-source counterpart that ranks second, with both models attaining state-of-the-art results on legacy Fashion200K evaluations. LookBench is designed to be updated semi-annually with new test samples and progressively harder task variants, providing a durable measure of progress. We publicly release our leaderboard, dataset, evaluation code, and trained models.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

37 of 49 references.

References · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  6. 2022A ConvNet for the 2020scited by 3,545
  7. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  9. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  10. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  11. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  12. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
25 more
  1. 2025Qwen-Image Technical Reportcited by 973
  2. 2018AutoAugment: Learning Augmentation Policies from Datacited by 728
  3. 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
  4. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
  5. 2020A Metric Learning Reality Checkcited by 317
  6. 2017Automatic Spatially-aware Fashion Concept Discoverycited by 132
  7. 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 132
  8. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
  9. 2021Embedding-based Product Retrieval in Taobao Searchcited by 50
  10. 2020Products-10K: A Large-scale Product Recognition Datasetcited by 42
  11. 2023Leveraging Large Language Models for Pre-trained Recommender Systemscited by 42
  12. 2023Text encoders bottleneck compositionality in contrastive vision-language modelscited by 34
  13. 2024Diffusion Models for Generative Outfit Recommendationcited by 29
  14. 2023DB-GPT: Empowering Database Interactions with Private Large Language Modelscited by 27
  15. 2024FAMMA: A Benchmark for Financial Domain Multilingual Multimodal Question Answeringcited by 19
  16. 2023Collaborative Group: Composed Image Retrieval via Consensus Learning from Noisy Annotationscited by 14
  17. 2025Multimodal LLMs Can Reason about Aesthetics in Zero-Shotcited by 14
  18. 2024Demonstration of DB-GPT: Next Generation Data Interaction System Empowered by Large Language Modelscited by 9
  19. 2023Introspective Deep Metric Learningcited by 7
  20. 2024Generalized Contrastive Learning for Multi-Modal Retrieval and Rankingcited by 6
  21. 2024DB-GPT-Hub: Towards Open Benchmarking Text-to-SQL Empowered by Large Language Modelscited by 6
  22. 2021PP-ShiTu: A Practical Lightweight Image Recognition Systemcited by 2
  23. 2023Methods and advancement of content-based fashion image retrieval: A Reviewcited by 2
  24. 2025Improving Visual Recommendation on E-commerce Platforms Using Vision-Language Modelscited by 2
  25. 2025DORAEMON: A Unified Library for Visual Object Modeling and Representation Learning at Scalecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

  1. 2026Beyond Retrieval: A Multitask Benchmark and Model for Code Searchcited by 1
  2. 2026ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrievalcited by 1
  3. 2026TIGER-FG: Text-Guided Implicit Fine-Grained Grounding for E-commerce Retrievalcited by 0
  4. 2026Robust and Generalizable Safety Steering for Text-to-Image Diffusion Transformerscited by 0
  5. 2026The MODA General Attribute Suite: A Four-Track Evaluation Benchmark for Fashion Attribute Extractioncited by 0
  6. 2026ZooWork-ShopRanker: An Open, Preference-Aligned E-Commerce Rerankercited by 0