mlsanityData to 7 Oct 2026

DAFM: Dynamic Adaptive Fusion for Multi-Model Collaboration in Composed Image Retrieval

arXiv 2511.05020 ↗First posted 7 Nov 2025cs.GR cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Composed Image Retrieval (CIR) is a cross-modal task that aims to retrieve target images from large-scale databases using a reference image and a modification text. Most existing methods rely on a single model to perform feature fusion and similarity matching. However, this paradigm faces two major challenges. First, one model alone can't see the whole picture and the tiny details at the same time; it has to handle different tasks with the same weights, so it often misses the small but important links between image and text. Second, the absence of dynamic weight allocation prevents adaptive leveraging of complementary model strengths, so the resulting embedding drifts away from the target and misleads the nearest-neighbor search in CIR. To address these limitations, we propose Dynamic Adaptive Fusion (DAFM) for multi-model collaboration in CIR. Rather than optimizing a single method in isolation, DAFM exploits the complementary strengths of heterogeneous models and adaptively rebalances their contributions. This not only maximizes retrieval accuracy but also ensures that the performance gains are independent of the fusion order, highlighting the robustness of our approach. Experiments on the CIRR and FashionIQ benchmarks demonstrate consistent improvements. Our method achieves a Recall@10 of 93.21 and an Rmean of 84.43 on CIRR, and an average Rmean of 67.48 on FashionIQ, surpassing recent strong baselines by up to 4.5%. These results confirm that dynamic multi-model collaboration provides an effective and general solution for CIR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 7 Nov 2025.

Builds on

11 of 23 references.

References · 11

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 234
  3. 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 155
  4. 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 82
  5. 2017DeepSF: deep convolutional neural network for mapping protein sequences to foldscited by 46
  6. 2023FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Taskscited by 37
  7. 2024Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negativescited by 20
  8. 2023VQA4CIR: Boosting Composed Image Retrieval with Visual Question Answeringcited by 11
  9. 2023Unifying Two-Stream Encoders with Transformers for Cross-Modal Retrievalcited by 8
  10. 2025FAR-Net: Multi-Stage Fusion Network with Enhanced Semantic Alignment and Adaptive Reconciliation for Composed Image Retrievalcited by 3
  11. 2025EL4NER: Ensemble Learning for Named Entity Recognition via Multiple Small-Parameter Large Language Modelscited by 2

Built on by

Not cited yet.