SQUARE: Semantic Query-Augmented Fusion and Efficient Batch Reranking for Training-free Zero-Shot Composed Image Retrieval
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
Abstract (arXiv)
Composed Image Retrieval (CIR) aims to retrieve target images that preserve the visual content of a reference image while incorporating user-specified textual modifications. Training-free zero-shot CIR (ZS-CIR) approaches, which require no task-specific training or labeled data, are highly desirable, yet accurately capturing user intent remains challenging. In this paper, we present SQUARE, a novel two-stage training-free framework that leverages Multimodal Large Language Models (MLLMs) to enhance ZS-CIR. In the Semantic Query-Augmented Fusion (SQAF) stage, we enrich the query embedding derived from a vision-language model (VLM) such as CLIP with MLLM-generated captions of the target image. These captions provide high-level semantic guidance, enabling the query to better capture the user's intent and improve global retrieval quality. In the Efficient Batch Reranking (EBR) stage, top-ranked candidates are presented as an image grid with visual marks to the MLLM, which performs joint visual-semantic reasoning across all candidates. Our reranking strategy operates in a single pass and yields more accurate rankings. Experiments show that SQUARE, with its simplicity and effectiveness, delivers strong performance on four standard CIR benchmarks. Notably, it maintains high performance even with lightweight pre-trained, demonstrating its potential applicability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 34 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
24 of 34 references.
Closest ancestors · 2
Same direction, newest first
- 2025ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning13 Mar
- 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMs4 Nov
Other references · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 459
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 299
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 176
- 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
- 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
- 2021Learning to Predict Visual Attributes in the Wildcited by 96
- 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
10 more
- 2023Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrievalcited by 52
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 47
- 2024Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrievalcited by 36
- 2024Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrievalcited by 32
- 2023Language-only Efficient Training of Zero-shot Composed Image Retrievalcited by 27
- 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Rerankingcited by 23
- 2022Where Does the Performance Improvement Come From? -- A Reproducibility Concern about Image-Text Retrievalcited by 19
- 2024Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similaritycited by 12
- 2020Where to Look and How to Describe: Fashion Image Retrieval with an Attentional Heterogeneous Bilinear Networkcited by 3
- 2025MCoT-RE: Multi-Faceted Chain-of-Thought and Re-Ranking for Training-Free Zero-Shot Composed Image Retrievalcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Soft Filtering: Guiding Zero-shot Composed Image Retrieval with Prescriptive and Proscriptive Constraints
- 2026From Transformation to Target State: Rethinking Query Representation for Zero-Shot Composed Image Retrieval
- 2026UniCVR: From Alignment to Reranking for Unified Zero-Shot Composed Visual Retrieval
- 2025Data-Efficient Generalization for Zero-shot Composed Image Retrieval
- 2025SETR: A Two-Stage Semantic-Enhanced Framework for Zero-Shot Composed Image Retrieval
- 2025CoTMR: Chain-of-Thought Multi-Scale Reasoning for Training-Free Zero-Shot Composed Image Retrieval
- 2024Simple but Effective Raw-Data Level Multimodal Fusion for Composed Image Retrieval
- 2026SDR-CIR: Semantic Debias Retrieval Framework for Training-Free Zero-Shot Composed Image Retrieval