DetailFusion: A Dual-branch Framework with Detail Enhancement for Composed Image Retrieval
Not on the map. Why?
Abstract (arXiv)
Composed Image Retrieval (CIR) aims to retrieve target images from a gallery based on a reference image and modification text as a combined query. Recent approaches focus on balancing global information from two modalities and encode the query into a unified feature for retrieval. However, due to insufficient attention to fine-grained details, these coarse fusion methods often struggle with handling subtle visual alterations or intricate textual instructions. In this work, we propose DetailFusion, a novel dual-branch framework that effectively coordinates information across global and detailed granularities, thereby enabling detail-enhanced CIR. Our approach leverages atomic detail variation priors derived from an image editing dataset, supplemented by a detail-oriented optimization strategy to develop a Detail-oriented Inference Branch. Furthermore, we design an Adaptive Feature Compositor that dynamically fuses global and detailed features based on fine-grained information of each unique multimodal query. Extensive experiments and ablation analyses not only demonstrate that our method achieves state-of-the-art performance on both CIRR and FashionIQ datasets but also validate the effectiveness and cross-domain adaptability of detail enhancement for CIR.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 46 of its 63 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
46 of 63 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 459
34 more
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 176
- 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
- 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
- 2024MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructionscited by 119
- 2019CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrievalcited by 110
- 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
- 2023CompoDiff: Versatile Composed Image Retrieval With Latent Diffusioncited by 85
- 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 83
- 2023Sentence-level Prompts Benefit Composed Image Retrievalcited by 59
- 2020Compositional Learning of Image-Text Query for Image Retrievalcited by 57
- 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
- 2020Modality-Agnostic Attention Fusion for visual search with text feedbackcited by 51
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 47
- 2023Data Roaming and Quality Assessment for Composed Image Retrievalcited by 46
- 2022Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularizationcited by 45
- 2023Bi-directional Training for Composed Image Retrieval via Text Prompt Learningcited by 43
- 2025FineCIR: Explicit Parsing of Fine-Grained Modification Semantics for Composed Image Retrievalcited by 42
- 2023FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Taskscited by 38
- 2023Target-Guided Composed Image Retrievalcited by 36
- 2024Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrievalcited by 36
- 2023Candidate Set Re-ranking for Composed Image Retrieval with Dual Multi-modal Encodercited by 35
- 2024Simple but Effective Raw-Data Level Multimodal Fusion for Composed Image Retrievalcited by 24
- 2024CaLa: Complementary Association Learning for Augmenting Composed Image Retrievalcited by 21
- 2024Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negativescited by 20
- 2025Missing Target-Relevant Information Prediction with World Model for Accurate Zero-Shot Composed Image Retrievalcited by 18
- 2025A Comprehensive Survey on Composed Image Retrievalcited by 17
- 2023Collaborative Group: Composed Image Retrieval via Consensus Learning from Noisy Annotationscited by 14
- 2024Leveraging Large Vision-Language Model as User Intent-aware Encoder for Composed Image Retrievalcited by 13
- 2023VQA4CIR: Boosting Composed Image Retrieval with Visual Question Answeringcited by 11
- 2024Pseudo-triplet Guided Few-shot Composed Image Retrievalcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Learning to Compose: Revisiting Proxy Task Design for Zero-Shot Composed Image Retrievalcited by 1
- 2026Beyond Semantic Search: Towards Referential Anchoring in Composed Image Retrievalcited by 0
- 2026FIRE-CIR: Fine-grained Reasoning for Composed Fashion Image Retrievalcited by 0
- 2026Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoningcited by 0
- 2026Learning to Compose: Revisiting Proxy Task Design for Zero-Shot Composed Image Retrieval1 Jul 2026
- 2026Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoning29 Jun 2026
- 2026FIRE-CIR: Fine-grained Reasoning for Composed Fashion Image Retrieval10 Apr 2026
- 2026Beyond Semantic Search: Towards Referential Anchoring in Composed Image Retrieval7 Apr 2026