IT-TextFusion: Iterative Text-Image Interaction with Text-Guided Residual Refinement for Degradation-Aware Image Fusion
Not on the map. Why?
Abstract (arXiv)
Text-guided image fusion has recently emerged as an effective paradigm for integrating multi-modal information while enabling flexible and task-oriented fusion control. However, existing text-guided fusion methods often rely on shallow semantic-visual interaction and limited attention mechanisms, which restrict their ability to robustly handle complex degradations and fully exploit textual guidance. In this paper, we propose an iterative text-guided image fusion framework that incorporates text-conditioned feature interaction across multiple fusion and refinement stages. The proposed method integrates deepest-level Cross-Attention, multi-scale Cross-Gate Fusion, and stage-specific text-conditioned modulation, allowing the global text embedding to condition hierarchical feature fusion and residual refinement. By repeatedly injecting the pooled text embedding across hierarchical decoder and refinement stages, the proposed framework provides degradation-aware global semantic conditioning while preserving complementary information from the visible and infrared modalities. Experiments on several benchmark datasets show that the proposed method improves several information-preservation and perceptual-quality metrics, while exhibiting metric-dependent trade-offs on some datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
25 of 52 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 530
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
13 more
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 83
- 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
- 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
- 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 67
- 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
- 2024Embracing Events and Frames with Hierarchical Feature Refinement Network for Object Detectioncited by 27
- 2023TextFusion: Unveiling the Power of Textual Semantics for Controllable Image Fusioncited by 26
- 2024E2E-MFD: Towards End-to-End Synchronous Multimodal Fusion Detectioncited by 21
- 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimationcited by 4
Built on by
Not cited yet.