mlsanityData to 7 Oct 2026

Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion

arXiv 2403.16387 ↗First posted 25 Mar 2024cs.CVcited by 83

Not on the map. Why?

Abstract (arXiv)

Image fusion aims to combine information from different source images to create a comprehensively representative image. Existing fusion methods are typically helpless in dealing with degradations in low-quality source images and non-interactive to multiple subjective and objective needs. To solve them, we introduce a novel approach that leverages semantic text guidance image fusion model for degradation-aware and interactive image fusion task, termed as Text-IF. It innovatively extends the classical image fusion to the text guided image fusion along with the ability to harmoniously address the degradation and interaction issues during fusion. Through the text semantic encoder and semantic interaction fusion decoder, Text-IF is accessible to the all-in-one infrared and visible image degradation-aware processing and the interactive flexible fusion outcomes. In this way, Text-IF achieves not only multi-modal image fusion, but also multi-modal information fusion. Extensive experiments prove that our proposed text guided image fusion strategy has obvious advantages over SOTA methods in the image fusion performance and degradation treatment. The code is available at https://github.com/XunpengYi/Text-IF.

Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). Builds on 18 of its 43 references that are in the map. First posted on arXiv 25 Mar 2024.

Builds on

18 of 43 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  5. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  6. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  7. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  8. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  9. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  10. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  11. 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
  12. 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 161
6 more
  1. 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
  2. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
  3. 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
  4. 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
  5. 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
  6. 2021Text to Image Generation with Semantic-Spatial Aware GANcited by 53

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 42; 2026: 33.

83 papers.

Sort:

By area:

  1. 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 45
  2. 2025DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusioncited by 34
  3. 2025One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusioncited by 32
  4. 2025VLM-E2E: Enhancing End-to-End Autonomous Driving with Multimodal Driver Attention Fusioncited by 20
  5. 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
  6. 2025Efficient Rectified Flow for Image Fusioncited by 14
  7. 2024Conditional Controllable Image Fusioncited by 13
  8. 2024Rethinking Early-Fusion Strategies for Improved Multispectral Object Detectioncited by 9
  9. 2025MMAIF: Multi-task and Multi-degradation All-in-One for Image Fusion with Language Guidancecited by 9
  10. 2025LUT-Fuse: Towards Extremely Fast Infrared and Visible Image Fusion via Distillation to Learnable Look-Up Tablescited by 9
  11. 2025ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Promptscited by 8
  12. 2025Deep Unfolding Multi-modal Image Fusion Network via Attribution Analysiscited by 7
38 more
  1. 2025VideoFusion: A Spatio-Temporal Collaborative Network for Multi-modal Video Fusioncited by 7
  2. 2024PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptationcited by 6
  3. 2025Spatial-Frequency Enhanced Mamba for Multi-Modal Image Fusioncited by 5
  4. 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 5
  5. 2025Residual Prior-driven Frequency-aware Network for Image Fusioncited by 4
  6. 2025FlexiD-Fuse: Flexible number of inputs multi-modal medical image fusion based on diffusion modelcited by 4
  7. 2025Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approachcited by 4
  8. 2024LINK: Adaptive Modality Interaction for Audio-Visual Video Parsingcited by 3
  9. 2025Language-Depth Navigated Thermal and Visible Image Fusioncited by 3
  10. 2025MUG: Pseudo Labeling Augmented Audio-Visual Mamba Network for Audio-Visual Video Parsingcited by 3
  11. 2025AWM-Fuse: Multi-Modality Image Fusion for Adverse Weather via Global and Local Text Perceptioncited by 3
  12. 2025FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolutioncited by 3
  13. 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Lawscited by 3
  14. 2025Enhancing 3D Semantic Scene Completion with a Refinement Modulecited by 3
  15. 2026Bridging Human Evaluation to Infrared and Visible Image Fusioncited by 3
  16. 2026EvaNet: Towards More Efficient and Consistent Infrared and Visible Image Fusion Assessmentcited by 2
  17. 2024A Semantic-Aware and Multi-Guided Network for Infrared-Visible Image Fusioncited by 1
  18. 2024textrmA^textrm2RNet: Adversarial Attack Resilient Network for Robust Infrared and Visible Image Fusioncited by 1
  19. 2025Dream-IF: Dynamic Relative EnhAnceMent for Image Fusioncited by 1
  20. 2025Distilling Textual Priors from LLM to Efficient Image Fusioncited by 1
  21. 2025DDFusion:Degradation-Decoupled Fusion Framework for Robust Infrared and Visible Images Fusioncited by 1
  22. 2025SMFusion: Semantic-Preserving Fusion of Multimodal Medical Images for Enhanced Clinical Diagnosiscited by 1
  23. 2025Coupled Degradation Modeling and Fusion: A VLM-Guided Degradation-Coupled Network for Degradation-Aware Infrared and Visible Image Fusioncited by 1
  24. 2025Text-Guided Channel Perturbation and Pretrained Knowledge Integration for Unified Multi-Modality Image Fusioncited by 1
  25. 2026Modality Dominance-Aware Optimization for Embodied RGB-Infrared Perceptioncited by 1
  26. 2026A Text-Guided Vision Model for Enhanced Recognition of Small Instancescited by 1
  27. 2026Multi-Modal Image Fusion via Intervention-Stable Feature Learningcited by 1
  28. 2026Customized Fusion: A Closed-Loop Dynamic Network for Adaptive Multi-Task-Aware Infrared-Visible Image Fusioncited by 1
  29. 2026Bridging the RGB-IR Gap: Consensus and Discrepancy Modeling for Text-Guided Multispectral Detectioncited by 1
  30. 2026Adding Thermal Awareness to Visual Systems in Real-Time via Distilled Diffusion Modelscited by 1
  31. 2026From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusioncited by 1
  32. 2024Rethinking the Evaluation of Visible and Infrared Image Fusioncited by 0
  33. 2024Infrared-Assisted Single-Stage Framework for Joint Restoration and Fusion of Visible and Infrared Images under Hazy Conditionscited by 0
  34. 2025One Latent Space to Rule All Degradations: Unifying Restoration Knowledge for Image Fusioncited by 0
  35. 2025Dig2DIG: Dig into Diffusion Information Gains for Image Fusioncited by 0
  36. 2025RLBayes: a Bayesian Network Structure Learning Algorithm via Reinforcement Learning-Based Search Strategycited by 0
  37. 2025Robust Fusion Controller: Degradation-aware Image Fusion with Fine-grained Language Instructionscited by 0
  38. 2025MultiTaskVIF: Segmentation-oriented visible and infrared image fusion via multi-task learningcited by 0

50 most cited of 83 All 83 (JSON)