mlsanityData to 14 Oct 2026

SGPDFuse: Semantically-Guided Physics-Disentanglement General Multi-Modal Image Fusion

arXiv 2608.29220 ↗First posted 29 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal image fusion (MMIF) aims to integrate complementary sensor data into a single representation that preserves intrinsic scene reality while eliminating environmental interferences. Most existing approaches rely on blind feature aggregation, which excels at signal accumulation but fails to distinguish essential content from physical degradations. We propose SGPDFuse, which bridges this gap by mapping inputs into a physics-disentangled structural representation via a Semantic-Physical Parametric Bridge (SPPB) built on pretrained vision foundation models, utilizing the Intrinsic-Variation principle to decouple invariant scene attributes from transient environmental factors. To guide this decomposition, we introduce a Semantic Alignment mechanism: we explicitly anchor the fused representation to salient semantic features in the same foundation model feature space via cosine similarity to preserve critical targets, while enforcing physical texture fidelity through Gram-matrix regularization to strictly eliminate unnatural artifacts. Extensive experiments demonstrate that SGPDFuse achieves state-of-the-art performance across infrared-visible, multi-focus, and multi-exposure benchmarks using a single architecture.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 41 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

19 of 41 references.

References · 19

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2018Understanding disentangling in β-VAEcited by 335
  4. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
  5. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  6. 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
  7. 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
  8. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 129
  9. 2021RFN-Nest: An end-to-end residual fusion network for infrared and visible imagescited by 109
  10. 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 84
  11. 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
  12. 2023A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusioncited by 47
7 more
  1. 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 46
  2. 2025DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusioncited by 34
  3. 2020Benchmarking and Comparing Multi-exposure Image Fusion Algorithmscited by 33
  4. 2025One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusioncited by 32
  5. 2024Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Modelcited by 31
  6. 2025Efficient Rectified Flow for Image Fusioncited by 15
  7. 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 6

Built on by

Not cited yet.