mlsanityData to 14 Oct 2026

Thinking Before Retrieving: Robust Zero-Shot Composed Image Retrieval via Strategic Planning and Self-Criticism

arXiv 2606.31222 ↗First posted 30 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Composed image retrieval requires identifying a target image from a gallery by integrating a reference image with a textual modification instruction. In a training-free zero-shot setting, this task relies on constructing a retrieval-oriented textual query within a frozen vision--language embedding space at inference time. Existing approaches predominantly rely on a single-pass generation strategy that fuses the reference context and modification text into a unified description. This strategy makes it difficult to detect or correct semantic distortions and omissions during generation. Consequently, the preservation of reference attributes and the integration of textual requirements interfere with each other, which degrades retrieval precision. To address these challenges, we introduce PEC-CIR, a training-free framework that structures query construction as a multi-stage reasoning pipeline. The framework operates through a Planner--Executor--Critic architecture where the Planner extracts explicit constraints, the Executor generates multiple candidate target descriptions, and the Critic evaluates these candidates based on constraint compliance. By reframing query construction as a staged inference process instead of a single-pass output, PEC-CIR reduces the propagation of generative errors by explicitly evaluating candidate queries before retrieval, thereby improving retrieval stability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 56 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

32 of 56 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  5. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  6. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  7. 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
  8. 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
  9. 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 176
  10. 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
  11. 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
  12. 2024MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructionscited by 119
20 more
  1. 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
  2. 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
  3. 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 83
  4. 2023Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrievalcited by 52
  5. 2024Spherical Linear Interpolation and Text-Anchoring for Zero-shot Composed Image Retrievalcited by 44
  6. 2024Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrievalcited by 36
  7. 2024Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrievalcited by 32
  8. 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrievalcited by 24
  9. 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Rerankingcited by 23
  10. 2023Self-Training Boosted Multi-Factor Matching Network for Composed Image Retrievalcited by 22
  11. 2025Fine-grained Textual Inversion Network for Zero-Shot Composed Image Retrievalcited by 18
  12. 2024Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similaritycited by 12
  13. 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrievalcited by 7
  14. 2024MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal Retrievalcited by 3
  15. 2025FAR-Net: Multi-Stage Fusion Network with Enhanced Semantic Alignment and Adaptive Reconciliation for Composed Image Retrievalcited by 3
  16. 2025Data-Efficient Generalization for Zero-shot Composed Image Retrievalcited by 2
  17. 2025From Mapping to Composing: A Two-Stage Framework for Zero-shot Composed Image Retrievalcited by 2
  18. 2025MCoT-RE: Multi-Faceted Chain-of-Thought and Re-Ranking for Training-Free Zero-Shot Composed Image Retrievalcited by 2
  19. 2024Relation-Aware Meta-Learning for Zero-shot Sketch-Based Image Retrievalcited by 1
  20. 2025Enhancing Spatio-Temporal Zero-shot Action Recognition with Language-driven Description Attributescited by 1

Built on by

Not cited yet.