mlsanityData to 7 Oct 2026

good4cir: Generating Detailed Synthetic Captions for Composed Image Retrieval

arXiv 2503.17871 ↗First posted 22 Mar 2025cs.CV cs.AIcited by 4

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Composed image retrieval (CIR) enables users to search images using a reference image combined with textual modifications. Recent advances in vision-language models have improved CIR, but dataset limitations remain a barrier. Existing datasets often rely on simplistic, ambiguous, or insufficient manual annotations, hindering fine-grained retrieval. We introduce good4cir, a structured pipeline leveraging vision-language models to generate high-quality synthetic annotations. Our method involves: (1) extracting fine-grained object descriptions from query images, (2) generating comparable descriptions for target images, and (3) synthesizing textual instructions capturing meaningful transformations between images. This reduces hallucination, enhances modification diversity, and ensures object-level consistency. Applying our method improves existing datasets and enables creating new datasets across diverse domains. Results demonstrate improved retrieval accuracy for CIR models trained on our pipeline-generated datasets. We release our dataset construction framework to support further research in CIR and multi-modal retrieval.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 39 references that are in the map. First posted on arXiv 22 Mar 2025.

Builds on

25 of 39 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  7. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  8. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  9. 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 244
  10. 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 234
  11. 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
  12. 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 155
13 more
  1. 2024MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructionscited by 119
  2. 2023CompoDiff: Versatile Composed Image Retrieval With Latent Diffusioncited by 84
  3. 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 82
  4. 2019Improved Embeddings with Easy Positive Triplet Miningcited by 66
  5. 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
  6. 2023CoVR-2: Automatic Data Construction for Composed Video Retrievalcited by 52
  7. 2023Data Roaming and Quality Assessment for Composed Image Retrievalcited by 45
  8. 2024Spherical Linear Interpolation and Text-Anchoring for Zero-shot Composed Image Retrievalcited by 44
  9. 2019Neural Naturalist: Generating Fine-Grained Image Comparisonscited by 36
  10. 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Rerankingcited by 23
  11. 2024Composed Image Retrieval for Remote Sensingcited by 14
  12. 2019Hotels-50K: A Global Hotel Recognition Datasetcited by 13
  13. 2024SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretrainingcited by 8

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Sanity Check on Composed Image Retrieval
  2. 2026Generating a Paracosm for Training-Free Zero-Shot Composed Image Retrieval
  3. 2025CoLLM: A Large Language Model for Composed Image Retrieval
  4. 2025Instance-Level Composed Image Retrieval
  5. 2024Visual Delta Generator with Large Multi-modal Models for Semi-supervised Composed Image Retrieval
  6. 2024HyCIR: Boosting Zero-Shot Composed Image Retrieval with Synthetic Labels
  7. 2026InfoCIR: Multimedia Analysis for Composed Image Retrieval ↗
  8. 2024Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives