AutoConcept: Training-Free Concept-Guided Reranking for Metadata-Available Composed Image Retrieval
Not on the map. Why?
Abstract (arXiv)
Composed image retrieval (CIR) retrieves a target image from a reference image and a text modification. This paper studies metadata-available CIR reranking, where a fixed CIR model first returns a candidate pool and gallery metadata is then used for second-stage concept-guided scoring. We introduce AutoConcept, a training-free reranker that converts concept evidence into an interpretable memory. AutoConcept filters noisy concepts, activates query-relevant positive constraints with an auxiliary negative penalty, and combines base retrieval scores with metadata-based concept-candidate alignment through inference-time calibration. On FashionIQ, AutoConcept yields significant early-rank improvements over WeiMoCIR and consistent plug-in gains on LinCIR candidate pools. Metadata-aware controls show that structured concept memory adds signal beyond direct query-text and extracted-attribute matching, while a query-only variant further supports the effectiveness of concept-level reranking. A supplementary real-human concept-label study indicates that the same memory interface can consume participant-provided evidence. These results position AutoConcept as an interpretable concept-memory reranker for product-style CIR galleries with available metadata.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
21 of 29 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2017Neural Collaborative Filteringcited by 1,111
- 2020Concept Bottleneck Modelscited by 1,032
- 2014Memory Networkscited by 363
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
9 more
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 176
- 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
- 2017Automatic Spatially-aware Fashion Concept Discoverycited by 134
- 2024MyVLM: Personalizing VLMs for User-Specific Queriescited by 58
- 2023Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrievalcited by 52
- 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrievalcited by 24
- 2024RAP: Retrieval-Augmented Personalization for Multimodal Large Language Modelscited by 24
- 2024Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similaritycited by 12
- 2025Soft Filtering: Guiding Zero-shot Composed Image Retrieval with Prescriptive and Proscriptive Constraintscited by 3
Built on by
Not cited yet.