Conditional Controllable Image Fusion
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Image fusion aims to integrate complementary information from multiple input images acquired through various sources to synthesize a new fused image. Existing methods usually employ distinct constraint designs tailored to specific scenes, forming fixed fusion paradigms. However, this data-driven fusion approach is challenging to deploy in varying scenarios, especially in rapidly changing environments. To address this issue, we propose a conditional controllable fusion (CCF) framework for general image fusion tasks without specific training. Due to the dynamic differences of different samples, our CCF employs specific fusion constraints for each individual in practice. Given the powerful generative capabilities of the denoising diffusion model, we first inject the specific constraints into the pre-trained DDPM as adaptive fusion conditions. The appropriate conditions are dynamically selected to ensure the fusion process remains responsive to the specific requirements in each reverse diffusion stage. Thus, CCF enables conditionally calibrating the fused images step by step. Extensive experiments validate our effectiveness in general fusion tasks across diverse scenarios against the competing methods without additional training.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 55 references that are in the map. First posted on arXiv 3 Nov 2024.
Builds on
24 of 55 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 415
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
11 more
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
- 2021RFN-Nest: An end-to-end residual fusion network for infrared and visible imagescited by 109
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 83
- 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
- 2022Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Reviewcited by 73
- 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
- 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
- 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusioncited by 54
- 2018Infrared and Visible Image Fusion using a Deep Learning Frameworkcited by 33
- 2020Benchmarking and Comparing Multi-exposure Image Fusion Algorithmscited by 33
- 2020VIFB: A Visible and Infrared Image Fusion Benchmarkcited by 25
Built on by
Citing papers per year: 2025: 7; 2026: 6.
13 papers.
Sort:
By area:
- 2025Efficient Rectified Flow for Image Fusioncited by 14
- 2025Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approachcited by 4
- 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Lawscited by 3
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusioncited by 3
- 2026Customized Fusion: A Closed-Loop Dynamic Network for Adaptive Multi-Task-Aware Infrared-Visible Image Fusioncited by 1
- 2025Dig2DIG: Dig into Diffusion Information Gains for Image Fusioncited by 0
- 2025RLBayes: a Bayesian Network Structure Learning Algorithm via Reinforcement Learning-Based Search Strategycited by 0
- 2025Neurodynamics-Driven Coupled Neural P Systems for Multi-Focus Image Fusioncited by 0
- 2025SSVIF: Self-Supervised Segmentation-Oriented Visible and Infrared Image Fusioncited by 0
- 2026EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusioncited by 0
- 2026Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinementcited by 0
- 2026Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusioncited by 0
- 2026When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion30 Sep 2026
- 2026Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion30 Sep 2026
- 2026Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinement28 May 2026
- 2026Customized Fusion: A Closed-Loop Dynamic Network for Adaptive Multi-Task-Aware Infrared-Visible Image Fusion10 Apr 2026
- 2026EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusion17 Mar 2026
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusion4 Mar 2026
- 2025Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approach8 Dec 2025
- 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws30 Oct 2025
- 2025SSVIF: Self-Supervised Segmentation-Oriented Visible and Infrared Image Fusion26 Sep 2025
- 2025Neurodynamics-Driven Coupled Neural P Systems for Multi-Focus Image Fusion22 Sep 2025
- 2025Efficient Rectified Flow for Image Fusion20 Sep 2025
- 2025RLBayes: a Bayesian Network Structure Learning Algorithm via Reinforcement Learning-Based Search Strategy7 Apr 2025
1 more
- 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Lawscited by 3
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusioncited by 3
- 2026Customized Fusion: A Closed-Loop Dynamic Network for Adaptive Multi-Task-Aware Infrared-Visible Image Fusioncited by 1
- 2025RLBayes: a Bayesian Network Structure Learning Algorithm via Reinforcement Learning-Based Search Strategycited by 0
- 2025Neurodynamics-Driven Coupled Neural P Systems for Multi-Focus Image Fusioncited by 0
- 2025SSVIF: Self-Supervised Segmentation-Oriented Visible and Infrared Image Fusioncited by 0
- 2026EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusioncited by 0
- 2026Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinementcited by 0
- 2026Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusioncited by 0
- 2026When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusioncited by 0
- 2026When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion30 Sep 2026
- 2026Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion30 Sep 2026
- 2026Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinement28 May 2026
- 2026Customized Fusion: A Closed-Loop Dynamic Network for Adaptive Multi-Task-Aware Infrared-Visible Image Fusion10 Apr 2026
- 2026EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusion17 Mar 2026
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusion4 Mar 2026
- 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws30 Oct 2025
- 2025SSVIF: Self-Supervised Segmentation-Oriented Visible and Infrared Image Fusion26 Sep 2025
- 2025Neurodynamics-Driven Coupled Neural P Systems for Multi-Focus Image Fusion22 Sep 2025
- 2025RLBayes: a Bayesian Network Structure Learning Algorithm via Reinforcement Learning-Based Search Strategy7 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024A Simple Approach to Unifying Diffusion-based Conditional Generation
- 2026Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios
- 2023A Unified Conditional Framework for Diffusion-based Image Restoration
- 2025FusionFM: All-in-One Multi-Modal Image Fusion with Flow Matching
- 2026Reversible Efficient Diffusion for Image Fusion
- 2023DDRF: Denoising Diffusion Model for Remote Sensing Image Fusion
- 2024Conditional Image Synthesis with Diffusion Models: A Survey
- 2022Entropy-driven Sampling and Training Scheme for Conditional Diffusion Generation