Dig2DIG: Dig into Diffusion Information Gains for Image Fusion
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Image fusion integrates complementary information from multi-source images to generate more informative results. Recently, the diffusion model, which demonstrates unprecedented generative potential, has been explored in image fusion. However, these approaches typically incorporate predefined multimodal guidance into diffusion, failing to capture the dynamically changing significance of each modality, while lacking theoretical guarantees. To address this issue, we reveal a significant spatio-temporal imbalance in image denoising; specifically, the diffusion model produces dynamic information gains in different image regions with denoising steps. Based on this observation, we Dig into the Diffusion Information Gains (Dig2DIG) and theoretically derive a diffusion-based dynamic image fusion framework that provably reduces the upper bound of the generalization error. Accordingly, we introduce diffusion information gains (DIG) to quantify the information contribution of each modality at different denoising steps, thereby providing dynamic guidance during the fusion process. Extensive experiments on multiple fusion scenarios confirm that our method outperforms existing diffusion-based approaches in terms of both fusion quality and inference efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 19 of its 42 references that are in the map. First posted on arXiv 24 Mar 2025.
Builds on
19 of 42 references.
Closest ancestors · 3
Same direction, newest first
- 2024Conditional Controllable Image Fusion3 Nov
- 2023Inversion-Free Image Editing with Natural Language7 Dec
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion13 Mar
Other references · 16
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 231
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 168
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 84
- 2023Provable Dynamic Fusion for Low-Quality Multimodal Datacited by 82
- 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
- 2022Dynamic Multimodal Fusioncited by 55
4 more
- 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusioncited by 54
- 2020Benchmarking and Comparing Multi-exposure Image Fusion Algorithmscited by 33
- 2023Stable Diffusion is Unstablecited by 27
- 2024Test-Time Dynamic Image Fusioncited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023DDRF: Denoising Diffusion Model for Remote Sensing Image Fusion
- 2026Reversible Efficient Diffusion for Image Fusion
- 2026Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios
- 2023Stimulating Diffusion Model for Image Denoising via Adaptive Embedding and Ensembling
- 2025A Simple Combination of Diffusion Models for Better Quality Trade-Offs in Image Denoising
- 2025Warm Diffusion: Recipe for Blur-Noise Mixture Diffusion Models
- 2025DSPFusion: Image Fusion via Degradation and Semantic Dual-Prior Guidance
- 2023A Unified Conditional Framework for Diffusion-based Image Restoration