mlsanityData to 7 Oct 2026

ReCALL: Recalibrating Capability Degradation for MLLM-based Composed Image Retrieval

arXiv 2602.01639 ↗First posted 2 Feb 2026cs.CVcited by 3

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Composed Image Retrieval (CIR) aims to retrieve target images based on a hybrid query comprising a reference image and a modification text. Early dual-tower Vision-Language Models (VLMs) struggle with cross-modality compositional reasoning required for this task. While adapting generative Multimodal Large Language Models (MLLMs) for retrieval offers a promising direction, we identify that this strategy overlooks a fundamental issue: compressing a generative MLLM into a single-embedding discriminative retriever triggers a paradigm conflict, which leads to Capability Degradation - the deterioration of native fine-grained reasoning after retrieval adaptation. To address this challenge, we propose ReCALL, a model-agnostic framework that follows a diagnose-generate-refine pipeline: First, we diagnose cognitive blind spots of the retriever via self-guided informative instance mining. Next, we generate corrective instructions and triplets by prompting the foundation MLLM and conduct quality control with VQA-based consistency filtering. Finally, we refine the retriever through continual training on these triplets with a grouped contrastive scheme, thereby internalizing fine-grained visual-semantic distinctions and realigning the discriminative embedding space of retriever with intrinsic compositional reasoning within the MLLM. Extensive experiments on CIRR and FashionIQ show that ReCALL consistently recalibrates degraded capabilities and achieves state-of-the-art performance. Code is available at https://github.com/RemRico/Recall.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 52 of its 77 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

52 of 77 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Leveraging Large Vision-Language Model as User Intent-aware Encoder for Composed Image Retrieval15 Dec
  2. 2024LamRA: Large Multimodal Model as Your Advanced Retrieval Assistant2 Dec
  3. 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMs4 Nov
  4. 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks7 Oct
  5. 2024TIGeR: Unifying Text-to-Image Generation and Retrieval with Large Multimodal Models9 Jun
  6. 2023FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-training11 Apr
  7. 2023FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks4 Mar

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  10. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  11. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  12. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
33 more
  1. 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
  2. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
  3. 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 244
  4. 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
  5. 2023SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionalitycited by 238
  6. 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 234
  7. 2022Vision-Language Pre-Training with Triple Contrastive Learningcited by 212
  8. 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
  9. 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 155
  10. 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
  11. 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
  12. 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 82
  13. 2023Sentence-level Prompts Benefit Composed Image Retrievalcited by 59
  14. 2020Compositional Learning of Image-Text Query for Image Retrievalcited by 57
  15. 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
  16. 2023CoVR-2: Automatic Data Construction for Composed Video Retrievalcited by 52
  17. 2023Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrievalcited by 52
  18. 2022Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularizationcited by 45
  19. 2023Data Roaming and Quality Assessment for Composed Image Retrievalcited by 45
  20. 2023Target-Guided Composed Image Retrievalcited by 36
  21. 2023Candidate Set Re-ranking for Composed Image Retrieval with Dual Multi-modal Encodercited by 35
  22. 2025Unlocking General Long Chain-of-Thought Reasoning Capabilities of Large Language Models via Representation Engineeringcited by 34
  23. 2023Self-Training Boosted Multi-Factor Matching Network for Composed Image Retrievalcited by 22
  24. 2024CaLa: Complementary Association Learning for Augmenting Composed Image Retrievalcited by 21
  25. 2025Improving Reasoning Performance in Large Language Models via Representation Engineeringcited by 21
  26. 2025VINCIE: Unlocking In-context Image Editing from Videocited by 17
  27. 2025CoTMR: Chain-of-Thought Multi-Scale Reasoning for Training-Free Zero-Shot Composed Image Retrievalcited by 15
  28. 2024Composing Object Relations and Attributes for Image-Text Matchingcited by 11
  29. 2024SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretrainingcited by 8
  30. 2025QuRe: Query-Relevant Retrieval through Hard Negative Sampling in Composed Image Retrievalcited by 8
  31. 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrievalcited by 7
  32. 2025Referring Expression Instance Retrieval and A Strong End-to-End Baselinecited by 6
  33. 2023The Role of Linguistic Priors in Measuring Compositional Generalization of Vision-Language Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025CIR-CoT: Towards Interpretable Composed Image Retrieval via End-to-End Chain-of-Thought Reasoning
  2. 2025CoLLM: A Large Language Model for Composed Image Retrieval
  3. 2026Indexing Multimodal Language Models for Large-scale Image Retrieval
  4. 2025Enhancing Supervised Composed Image Retrieval via Reasoning-Augmented Representation Engineering
  5. 2026Training-Free Pseudo-Fusion for Composed Image Retrieval with Diffusion Models and Multimodal Large Language Models
  6. 2024Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyond
  7. 2024Compositional Image Retrieval via Instruction-Aware Contrastive Learning
  8. 2026MCoT-MVS: Multi-level Vision Selection by Multi-modal Chain-of-Thought Reasoning for Composed Image Retrieval