DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion
Not on the map. Why?
Abstract (arXiv)
Infrared and visible image fusion, a hot topic in the field of image processing, aims at obtaining fused images keeping the advantages of source images. This paper proposes a novel auto-encoder (AE) based fusion network. The core idea is that the encoder decomposes an image into background and detail feature maps with low- and high-frequency information, respectively, and that the decoder recovers the original image. To this end, the loss function makes the background/detail feature maps of source images similar/dissimilar. In the test phase, background and detail feature maps are respectively merged via a fusion module, and the fused image is recovered by the decoder. Qualitative and quantitative results illustrate that our method can generate fusion images containing highlighted targets and abundant detail texture information with strong robustness and meanwhile surpass state-of-the-art (SOTA) approaches.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 6; 2023: 20; 2024: 18; 2025: 16; 2026: 12.
72 papers.
Sort:
By area:
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
- 2023Equivariant Multi-Modality Image Fusioncited by 98
- 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
- 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
- 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
- 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
- 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusioncited by 54
- 2023A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusioncited by 47
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 45
38 more
- 2024Image Fusion via Vision-Language Modelcited by 40
- 2024CrossFuse: A Novel Cross Attention Mechanism based Infrared and Visible Image Fusion Approachcited by 38
- 2023An Interactively Reinforced Paradigm for Joint Infrared-Visible Image Fusion and Saliency Object Detectioncited by 36
- 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusioncited by 35
- 2023Learning a Graph Neural Network with Cross Modality Interaction for Image Fusioncited by 28
- 2023Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyondcited by 26
- 2023PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentationcited by 26
- 2024Task-driven Image Fusion with Learnable Fusion Losscited by 24
- 2023BiBench: Benchmarking and Analyzing Network Binarizationcited by 22
- 2024E2E-MFD: Towards End-to-End Synchronous Multimodal Fusion Detectioncited by 21
- 2023Towards Benchmarking and Assessing Visual Naturalness of Physical World Adversarial Attackscited by 18
- 2023Improving Misaligned Multi-modality Image Fusion with One-stage Progressive Dense Registrationcited by 17
- 2023ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss via Meta-Learningcited by 15
- 2024MaeFuse: Transferring Omni Features with Pretrained Masked Autoencoders for Infrared and Visible Image Fusion via Guided Trainingcited by 15
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
- 2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentationcited by 12
- 2024U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentationcited by 12
- 2024RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusioncited by 9
- 2025Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidancecited by 9
- 2024S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusioncited by 8
- 2024Conti-Fuse: A Novel Continuous Decomposition-based Fusion Framework for Infrared and Visible Imagescited by 8
- 2025A Unified Solution to Video Fusion: From Multi-Frame Learning to Benchmarkingcited by 8
- 2025Deep Unfolding Multi-modal Image Fusion Network via Attribution Analysiscited by 7
- 2024SFDFusion: An Efficient Spatial-Frequency Domain Fusion Network for Infrared and Visible Image Fusioncited by 6
- 2024Test-Time Dynamic Image Fusioncited by 6
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detectioncited by 6
- 2022A Unified Multi-Task Learning Framework of Real-Time Drone Supervision for Crowd Countingcited by 5
- 2023A Multi-scale Information Integration Framework for Infrared and Visible Image Fusioncited by 5
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 5
- 2022BiFSMNv2: Pushing Binary Neural Networks for Keyword Spotting to Real-Network Performancecited by 4
- 2023IAIFNet: An Illumination-Aware Infrared and Visible Image Fusion Networkcited by 4
- 2024DAE-Fuse: An Adaptive Discriminative Autoencoder for Multi-Modality Image Fusioncited by 4
- 2024Why mamba is effective? Exploit Linear Transformer-Mamba Network for Multi-Modality Image Fusioncited by 3
- 2025Cross-modal Offset-guided Dynamic Alignment and Fusion for Weakly Aligned UAV Object Detectioncited by 3
- 2025FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolutioncited by 3
- 2023A Dual Domain Multi-exposure Image Fusion Network based on the Spatial-Frequency Integrationcited by 2
- 2024A Semantic-Aware and Multi-Guided Network for Infrared-Visible Image Fusioncited by 1
- 2025Dream-IF: Dynamic Relative EnhAnceMent for Image Fusioncited by 1
50 most cited of 72 All 72 (JSON)
- 2026When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion30 Sep 2026
- 2026Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion30 Sep 2026
- 2026RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images11 Sep 2026
- 2026InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection4 Jul 2026
- 2026Dual Sparse Aggregation Transformer for Multispectral Object Detection30 Jun 2026
- 2026From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion10 Jun 2026
- 2026Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images13 May 2026
- 2026Adding Thermal Awareness to Visual Systems in Real-Time via Distilled Diffusion Models7 May 2026
- 2026EAPFusion: Intrinsic Evolving Auxiliary Prior Guidance for Infrared and Visible Image Fusion3 May 2026
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservation15 Mar 2026
- 2026MambaVF: State Space Model for Efficient Video Fusion5 Feb 2026
- 2026DIFF-MF: A Difference-Driven Channel-Spatial State Space Model for Multi-Modal Image Fusion9 Jan 2026
38 more
- 2025SWIR-LightFusion: Multi-spectral Semantic Fusion of Synthetic SWIR with Thermal IR (LWIR/MWIR) and RGB15 Oct 2025
- 2025FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolution11 Sep 2025
- 2025Hyperbolic Cycle Alignment for Infrared-Visible Image Fusion31 Jul 2025
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection24 Jul 2025
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detection19 Jul 2025
- 2025Cross-modal Offset-guided Dynamic Alignment and Fusion for Weakly Aligned UAV Object Detection20 Jun 2025
- 2025Causality-Driven Infrared and Visible Image Fusion27 May 2025
- 2025A Unified Solution to Video Fusion: From Multi-Frame Learning to Benchmarking26 May 2025
- 2025SMFusion: Semantic-Preserving Fusion of Multimodal Medical Images for Enhanced Clinical Diagnosis18 May 2025
- 2025Bi-directional Self-Registration for Misaligned Infrared-Visible Image Fusion11 May 2025
- 2025RGBX-DiffusionDet: A Framework for Multi-Modal RGB-X Object Detection Using DiffusionDet5 May 2025
- 2025SARTM: Segment Any RGB Thermal Model with Language aided Distillation4 May 2025
- 2025Dream-IF: Dynamic Relative EnhAnceMent for Image Fusion13 Mar 2025
- 2025Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidance4 Mar 2025
- 2025Deep Unfolding Multi-modal Image Fusion Network via Attribution Analysis3 Feb 2025
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaption18 Jan 2025
- 2024Task-driven Image Fusion with Learnable Fusion Loss4 Dec 2024
- 2024Test-Time Dynamic Image Fusion5 Nov 2024
- 2024SFDFusion: An Efficient Spatial-Frequency Domain Fusion Network for Infrared and Visible Image Fusion30 Oct 2024
- 2024Fuse4Seg: Image Fusion for Multi-Modal Medical Segmentation via Bi-level Optimization16 Sep 2024
- 2024DAE-Fuse: An Adaptive Discriminative Autoencoder for Multi-Modality Image Fusion16 Sep 2024
- 2024Why mamba is effective? Exploit Linear Transformer-Mamba Network for Multi-Modality Image Fusion5 Sep 2024
- 2024RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion31 Jul 2024
- 2024CrossFuse: A Novel Cross Attention Mechanism based Infrared and Visible Image Fusion Approach15 Jun 2024
- 2024A Semantic-Aware and Multi-Guided Network for Infrared-Visible Image Fusion11 Jun 2024
- 2024Conti-Fuse: A Novel Continuous Decomposition-based Fusion Framework for Infrared and Visible Images7 Jun 2024
- 2024S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion31 May 2024
- 2024U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation24 May 2024
- 2024MaeFuse: Transferring Omni Features with Pretrained Masked Autoencoders for Infrared and Visible Image Fusion via Guided Training17 Apr 2024
- 2024Fusion-Mamba for Cross-modality Object Detection14 Apr 2024
- 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion12 Apr 2024
- 2024Task-Customized Mixture of Adapters for General Image Fusion19 Mar 2024
- 2024E2E-MFD: Towards End-to-End Synchronous Multimodal Fusion Detection14 Mar 2024
- 2024Image Fusion via Vision-Language Model3 Feb 2024
- 2023BusReF: Infrared-Visible images registration and fusion focus on reconstructible area using one set of features30 Dec 2023
- 2023A Dual Domain Multi-exposure Image Fusion Network based on the Spatial-Frequency Integration17 Dec 2023
- 2023ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss via Meta-Learning13 Dec 2023
- 2023A Multi-scale Information Integration Framework for Infrared and Visible Image Fusion7 Dec 2023
50 newest of 72 All 72 (JSON)
- 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
- 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusioncited by 35
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
- 2024S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusioncited by 8
- 2024Why mamba is effective? Exploit Linear Transformer-Mamba Network for Multi-Modality Image Fusioncited by 3
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection24 Jul 2025
- 2024Why mamba is effective? Exploit Linear Transformer-Mamba Network for Multi-Modality Image Fusion5 Sep 2024
- 2024S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion31 May 2024
- 2024Fusion-Mamba for Cross-modality Object Detection14 Apr 2024
- 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion12 Apr 2024
- 2024Image Fusion via Vision-Language Modelcited by 40
- 2024Image Fusion via Vision-Language Model3 Feb 2024
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
- 2023Equivariant Multi-Modality Image Fusioncited by 98
- 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
- 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
- 2023A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusioncited by 47
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 45
- 2024CrossFuse: A Novel Cross Attention Mechanism based Infrared and Visible Image Fusion Approachcited by 38
- 2023An Interactively Reinforced Paradigm for Joint Infrared-Visible Image Fusion and Saliency Object Detectioncited by 36
- 2023Learning a Graph Neural Network with Cross Modality Interaction for Image Fusioncited by 28
- 2023Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyondcited by 26
12 most cited of 62 All 62 (JSON)
- 2026When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion30 Sep 2026
- 2026Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion30 Sep 2026
- 2026RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images11 Sep 2026
- 2026InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection4 Jul 2026
- 2026Dual Sparse Aggregation Transformer for Multispectral Object Detection30 Jun 2026
- 2026From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion10 Jun 2026
- 2026Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images13 May 2026
- 2026EAPFusion: Intrinsic Evolving Auxiliary Prior Guidance for Infrared and Visible Image Fusion3 May 2026
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservation15 Mar 2026
- 2026MambaVF: State Space Model for Efficient Video Fusion5 Feb 2026
- 2026DIFF-MF: A Difference-Driven Channel-Spatial State Space Model for Multi-Modal Image Fusion9 Jan 2026
- 2025SWIR-LightFusion: Multi-spectral Semantic Fusion of Synthetic SWIR with Thermal IR (LWIR/MWIR) and RGB15 Oct 2025
12 newest of 62 All 62 (JSON)