Unleashing the Power of Text: Text-Guided Flow Matching for Image Fusion under Complex Degradations
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Infrared-visible image fusion under realistic degradation scenarios is a challenging task, as degradations not only cause a loss of reliable modality-specific information in observed images but also hinder the fusion process. Recent studies indicate that text can provide prior information about degradation characteristics, complementing the limited evidence available from corrupted input images and facilitating fusion. However, existing methods typically inject fixed global text representations into visual features, making it difficult for textual guidance to adapt to spatially varying degradations, local structures, and thermal saliency. To this end, we propose TGFusion, a text-guided latent-space flow matching framework that unifies degradation suppression and cross-modal fusion. TGFusion encodes task, degradation, and generation cues into structured prompts. To fully exploit these priors, we design a Prompt-conditioned Multi-stream Joint Flow Transformer that represents text as an independent semantic stream alongside fusion, visible, and infrared streams. Joint attention enables token-level bidirectional interaction and layer-wise updating among semantic and visual representations, allowing degradation semantics to dynamically guide reliable information selection and fusion latent generation. Extensive experiments on public benchmarks and complex degradation scenarios demonstrate that TGFusion achieves superior or competitive performance in perceptual quality, image naturalness, structural-detail preservation, and infrared-saliency retention, while remaining robust across diverse single and compound degradations.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 18 of its 40 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
18 of 40 references.
Closest ancestors · 3
Same direction, newest first
- 2025MMAIF: Multi-task and Multi-degradation All-in-One for Image Fusion with Language Guidance19 Mar
- 2024Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Model31 Oct
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion13 Mar
Other references · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,628
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,876
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 315
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 230
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 230
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
- 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 109
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 83
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024An Intermediate Fusion ViT Enables Efficient Text-Image Alignment in Diffusion Models
- 2026FullFlow: Upgrading Text-to-Image Flow Matching Models for Bidirectional Vision--Language Generation
- 2026Semantic Routing: Exploring Multi-Layer LLM Feature Weighting for Diffusion Transformers
- 2026Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference
- 2025Rare Text Semantics Were Always There in Your Diffusion Transformer
- 2025FlowTok: Flowing Seamlessly Across Text and Image Tokens
- 2025Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approach
- 2025Multi-Grained Text-Guided Image Fusion for Multi-Exposure and Multi-Focus Scenarios