Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback
Not on the map. Why?
Abstract (arXiv)
Conversational interfaces for the detail-oriented retail fashion domain are more natural, expressive, and user friendly than classical keyword-based search interfaces. In this paper, we introduce the Fashion IQ dataset to support and advance research on interactive fashion image retrieval. Fashion IQ is the first fashion dataset to provide human-generated captions that distinguish similar pairs of garment images together with side-information consisting of real-world product descriptions and derived visual attribute labels for these images. We provide a detailed analysis of the characteristics of the Fashion IQ data, and present a transformer-based user simulator and interactive image retriever that can seamlessly integrate visual attributes with image features, user feedback, and dialog history, leading to improved performance over the state of the art in dialog-based image retrieval. We believe that our dataset will encourage further work on developing more natural and real-world applicable conversational shopping assistants.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 10; 2024: 7; 2025: 8; 2026: 8.
43 papers.
Sort:
By area:
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMscited by 161
- 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 47
- 2022Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularizationcited by 45
- 2023Bi-directional Training for Composed Image Retrieval via Text Prompt Learningcited by 43
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
- 2023Candidate Set Re-ranking for Composed Image Retrieval with Dual Multi-modal Encodercited by 35
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
- 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Rerankingcited by 23
- 2024CaLa: Complementary Association Learning for Augmenting Composed Image Retrievalcited by 21
- 2024EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrievalcited by 21
31 more
- 2025CoLLM: A Large Language Model for Composed Image Retrievalcited by 21
- 2024Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Modelscited by 19
- 2024Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxycited by 18
- 2021Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-trainingcited by 10
- 2024HyCIR: Boosting Zero-Shot Composed Image Retrieval with Synthetic Labelscited by 8
- 2026CoVR-R:Reason-Aware Composed Video Retrievalcited by 8
- 2022Image Search with Text Feedback by Additive Attention Compositional Learningcited by 7
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrievalcited by 7
- 2025Generalized Contrastive Learning for Universal Multimodal Retrievalcited by 7
- 2022Training and challenging models for text-guided fashion image retrievalcited by 5
- 2023Ranking-aware Uncertainty for Text-guided Image Retrievalcited by 5
- 2023Dual Relation Alignment for Composed Image Retrievalcited by 5
- 2021I Want This Product but Different : Multimodal Retrieval with Synthetic Query Expansioncited by 4
- 2021Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothingcited by 4
- 2021SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shiftscited by 2
- 2023Benchmarking Robustness of Text-Image Composed Retrievalcited by 2
- 2026PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrievalcited by 2
- 2021Cycled Compositional Learning between Images and Textcited by 1
- 2025SETR: A Two-Stage Semantic-Enhanced Framework for Zero-Shot Composed Image Retrievalcited by 1
- 2025FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Textcited by 1
- 2026X-Aligner: Composed Visual Retrieval without the Bells and Whistlescited by 1
- 2026OSCAR: Optimization-Steered Agentic Planning for Composed Image Retrievalcited by 1
- 2026CLAY: Conditional Visual Similarity Modulation in Vision-Language Embedding Spacecited by 1
- 2023Click-Feedback Retrievalcited by 0
- 2023Fashion CUT: Unsupervised domain adaptation for visual pattern classification in clothes using synthetic data and pseudo-labelscited by 0
- 2024Let's Go Shopping (LGS) -- Web-Scale Image-Text Dataset for Visual Concept Understandingcited by 0
- 2025OMR-Diffusion:Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Intent Understandingcited by 0
- 2025UNION: A Lightweight Target Representation for Efficient Zero-Shot Image-Guided Retrieval with Optional Textual Queriescited by 0
- 2026Resolving Ambiguity in Composed Image Retrieval via Calibrated Interactioncited by 0
- 2026CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domainscited by 0
- 2026Mixed-Modality Dual Face-Hair Retrievalcited by 0
- 2026Mixed-Modality Dual Face-Hair Retrieval2 Jun 2026
- 2026CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains26 May 2026
- 2026Resolving Ambiguity in Composed Image Retrieval via Calibrated Interaction23 May 2026
- 2026CLAY: Conditional Visual Similarity Modulation in Vision-Language Embedding Space13 Apr 2026
- 2026CoVR-R:Reason-Aware Composed Video Retrieval20 Mar 2026
- 2026PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval2 Mar 2026
- 2026OSCAR: Optimization-Steered Agentic Planning for Composed Image Retrieval9 Feb 2026
- 2026X-Aligner: Composed Visual Retrieval without the Bells and Whistles23 Jan 2026
- 2025UNION: A Lightweight Target Representation for Efficient Zero-Shot Image-Guided Retrieval with Optional Textual Queries27 Nov 2025
- 2025FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Text27 Nov 2025
- 2025SETR: A Two-Stage Semantic-Enhanced Framework for Zero-Shot Composed Image Retrieval30 Sep 2025
- 2025Generalized Contrastive Learning for Universal Multimodal Retrieval30 Sep 2025
31 more
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrieval27 May 2025
- 2025CoLLM: A Large Language Model for Composed Image Retrieval25 Mar 2025
- 2025OMR-Diffusion:Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Intent Understanding22 Mar 2025
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation12 Feb 2025
- 2024Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy24 Nov 2024
- 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMs4 Nov 2024
- 2024EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval23 Jul 2024
- 2024HyCIR: Boosting Zero-Shot Composed Image Retrieval with Synthetic Labels8 Jul 2024
- 2024CaLa: Complementary Association Learning for Augmenting Composed Image Retrieval29 May 2024
- 2024Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Models29 Apr 2024
- 2024Let's Go Shopping (LGS) -- Web-Scale Image-Text Dataset for Visual Concept Understanding9 Jan 2024
- 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Reranking14 Dec 2023
- 2023Benchmarking Robustness of Text-Image Composed Retrieval24 Nov 2023
- 2023Vision-by-Language for Training-Free Compositional Image Retrieval13 Oct 2023
- 2023Dual Relation Alignment for Composed Image Retrieval5 Sep 2023
- 2023Ranking-aware Uncertainty for Text-guided Image Retrieval16 Aug 2023
- 2023GeneCIS: A Benchmark for General Conditional Image Similarity13 Jun 2023
- 2023Candidate Set Re-ranking for Composed Image Retrieval with Dual Multi-modal Encoder25 May 2023
- 2023Fashion CUT: Unsupervised domain adaptation for visual pattern classification in clothes using synthetic data and pseudo-labels9 May 2023
- 2023Click-Feedback Retrieval28 Apr 2023
- 2023Bi-directional Training for Composed Image Retrieval via Text Prompt Learning29 Mar 2023
- 2022Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularization14 Nov 2022
- 2022Training and challenging models for text-guided fashion image retrieval23 Apr 2022
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrieval12 Apr 2022
- 2022Image Search with Text Feedback by Additive Attention Compositional Learning8 Mar 2022
- 2021Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing24 Nov 2021
- 2021SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shifts30 Aug 2021
- 2021Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training25 Aug 2021
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models9 Aug 2021
- 2021Cycled Compositional Learning between Images and Text24 Jul 2021
- 2021I Want This Product but Different : Multimodal Retrieval with Synthetic Query Expansion17 Feb 2021
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 47
- 2022Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularizationcited by 45
- 2023Bi-directional Training for Composed Image Retrieval via Text Prompt Learningcited by 43
- 2023Candidate Set Re-ranking for Composed Image Retrieval with Dual Multi-modal Encodercited by 35
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
- 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Rerankingcited by 23
- 2024CaLa: Complementary Association Learning for Augmenting Composed Image Retrievalcited by 21
- 2024EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrievalcited by 21
- 2025CoLLM: A Large Language Model for Composed Image Retrievalcited by 21
- 2024Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxycited by 18
12 most cited of 38 All 38 (JSON)
- 2026Mixed-Modality Dual Face-Hair Retrieval2 Jun 2026
- 2026CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains26 May 2026
- 2026Resolving Ambiguity in Composed Image Retrieval via Calibrated Interaction23 May 2026
- 2026CLAY: Conditional Visual Similarity Modulation in Vision-Language Embedding Space13 Apr 2026
- 2026CoVR-R:Reason-Aware Composed Video Retrieval20 Mar 2026
- 2026PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval2 Mar 2026
- 2026X-Aligner: Composed Visual Retrieval without the Bells and Whistles23 Jan 2026
- 2025UNION: A Lightweight Target Representation for Efficient Zero-Shot Image-Guided Retrieval with Optional Textual Queries27 Nov 2025
- 2025FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Text27 Nov 2025
- 2025SETR: A Two-Stage Semantic-Enhanced Framework for Zero-Shot Composed Image Retrieval30 Sep 2025
- 2025Generalized Contrastive Learning for Universal Multimodal Retrieval30 Sep 2025
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrieval27 May 2025
12 newest of 38 All 38 (JSON)