Causality-Driven Infrared and Visible Image Fusion
Not on the map. Why?
Abstract (arXiv)
Image fusion aims to combine complementary information from multiple source images to generate more comprehensive scene representations. Existing methods primarily rely on the stacking and design of network architectures to enhance the fusion performance, often ignoring the impact of dataset scene bias on model training. This oversight leads the model to learn spurious correlations between specific scenes and fusion weights under conventional likelihood estimation framework, thereby limiting fusion performance. To solve the above problems, this paper first re-examines the image fusion task from the causality perspective, and disentangles the model from the impact of bias by constructing a tailored causal graph to clarify the causalities among the variables in image fusion task. Then, the Back-door Adjustment based Feature Fusion Module (BAFFM) is proposed to eliminate confounder interference and enable the model to learn the true causal effect. Finally, Extensive experiments on three standard datasets prove that the proposed method significantly surpasses state-of-the-art methods in infrared and visible image fusion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 74 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
22 of 74 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
- 2021RFN-Nest: An end-to-end residual fusion network for infrared and visible imagescited by 109
- 2019Towards Causal VQA: Revealing and Reducing Spurious Correlations by Invariant and Covariant Semantic Editingcited by 108
- 2020Visual Commonsense R-CNNcited by 106
- 2023Equivariant Multi-Modality Image Fusioncited by 99
- 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
- 2020DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusioncited by 73
- 2020Deconfounded Image Captioning: A Causal Retrospectcited by 65
- 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusioncited by 54
10 more
- 2024Vision-and-Language Navigation via Causal Learningcited by 51
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 46
- 2023An Interactively Reinforced Paradigm for Joint Infrared-Visible Image Fusion and Saliency Object Detectioncited by 36
- 2023Context De-confounded Emotion Recognitioncited by 34
- 2025One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusioncited by 32
- 2020VIFB: A Visible and Infrared Image Fusion Benchmarkcited by 25
- 2021Image Fusion Transformercited by 24
- 2023Link-Context Learning for Multimodal LLMscited by 24
- 2023A Multi-scale Information Integration Framework for Infrared and Visible Image Fusioncited by 5
- 2023CHITNet: A Complementary to Harmonious Information Transfer Network for Infrared and Visible Image Fusioncited by 4
Built on by
Not cited yet.