good4cir: Generating Detailed Synthetic Captions for Composed Image Retrieval
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
Abstract (arXiv)
Composed image retrieval (CIR) enables users to search images using a reference image combined with textual modifications. Recent advances in vision-language models have improved CIR, but dataset limitations remain a barrier. Existing datasets often rely on simplistic, ambiguous, or insufficient manual annotations, hindering fine-grained retrieval. We introduce good4cir, a structured pipeline leveraging vision-language models to generate high-quality synthetic annotations. Our method involves: (1) extracting fine-grained object descriptions from query images, (2) generating comparable descriptions for target images, and (3) synthesizing textual instructions capturing meaningful transformations between images. This reduces hallucination, enhances modification diversity, and ensures object-level consistency. Applying our method improves existing datasets and enables creating new datasets across diverse domains. Results demonstrate improved retrieval accuracy for CIR models trained on our pipeline-generated datasets. We release our dataset construction framework to support further research in CIR and multi-modal retrieval.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 39 references that are in the map. First posted on arXiv 22 Mar 2025.
Builds on
25 of 39 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023Visual Instruction Tuningcited by 7,792
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 244
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 234
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
- 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 155
13 more
- 2024MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructionscited by 119
- 2023CompoDiff: Versatile Composed Image Retrieval With Latent Diffusioncited by 84
- 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 82
- 2019Improved Embeddings with Easy Positive Triplet Miningcited by 66
- 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
- 2023CoVR-2: Automatic Data Construction for Composed Video Retrievalcited by 52
- 2023Data Roaming and Quality Assessment for Composed Image Retrievalcited by 45
- 2024Spherical Linear Interpolation and Text-Anchoring for Zero-shot Composed Image Retrievalcited by 44
- 2019Neural Naturalist: Generating Fine-Grained Image Comparisonscited by 36
- 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Rerankingcited by 23
- 2024Composed Image Retrieval for Remote Sensingcited by 14
- 2019Hotels-50K: A Global Hotel Recognition Datasetcited by 13
- 2024SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretrainingcited by 8
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025Chat-Driven Text Generation and Interaction for Person Retrievalcited by 34
- 2025CaptionQA: Is Your Caption as Useful as the Image Itself?cited by 14
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrievalcited by 7
- 2025Composed Object Retrieval: Object-level Retrieval via Composed Expressionscited by 0
- 2025CaptionQA: Is Your Caption as Useful as the Image Itself?26 Nov 2025
- 2025Chat-Driven Text Generation and Interaction for Person Retrieval16 Sep 2025
- 2025Composed Object Retrieval: Object-level Retrieval via Composed Expressions6 Aug 2025
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrieval27 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026A Sanity Check on Composed Image Retrieval
- 2026Generating a Paracosm for Training-Free Zero-Shot Composed Image Retrieval
- 2025CoLLM: A Large Language Model for Composed Image Retrieval
- 2025Instance-Level Composed Image Retrieval
- 2024Visual Delta Generator with Large Multi-modal Models for Semi-supervised Composed Image Retrieval
- 2024HyCIR: Boosting Zero-Shot Composed Image Retrieval with Synthetic Labels
- 2026InfoCIR: Multimedia Analysis for Composed Image Retrieval ↗
- 2024Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives