mlsanityData to 14 Oct 2026

When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion

arXiv 2609.39004 ↗First posted 30 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal image fusion (MMIF) aims to integrate complementary information from different modalities into a high-quality fused image and support downstream tasks. Recently, feature decomposition has become an important paradigm by separating source images into common and modality-specific unique features. However, existing methods lack clear supervision because ground-truth (GT) decomposition feature maps are unavailable. They usually combine multiple image-level metrics as losses, which are inherently incomplete and may conflict since each pixel couples attributes such as texture, edge, and contour. To address this, we propose a 1D signal-level self-supervised feature decomposition paradigm. Our core insight is to reformulate feature decomposition from unclear 2D image-level supervision into an integral-driven 1D signal-level optimization problem. This objective-level reformulation uses the 1D signal form to compute the integral constraint. The decomposer is optimized by the integral area between common and original signals, enabling more stable optimization with a clear optimization objective. Our model follows a two-stage SSL framework. Stage I designs dual pretext tasks for integral-driven decomposition at the signal level and structure-preserving reconstruction at the image level. Stage II fuses unique features and combines them with common features to reconstruct the fused image. Experiments on representative MMIF tasks show state-of-the-art (SOTA) performance. Code: github.com/Wangjiayu0512/SIDFusion.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 51 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

24 of 51 references.

References · 24

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  3. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
  4. 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
  5. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  6. 2023Equivariant Multi-Modality Image Fusioncited by 99
  7. 2023UniverSeg: Universal Medical Image Segmentationcited by 91
  8. 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
  9. 2019Deep Convolutional Neural Network for Multi-modal Image Restoration and Fusioncited by 79
  10. 2020DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusioncited by 73
  11. 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
  12. 2023Self-Supervised Multimodal Learning: A Surveycited by 58
12 more
  1. 2023A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusioncited by 47
  2. 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 46
  3. 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 35
  4. 2025DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusioncited by 34
  5. 2024Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Modelcited by 31
  6. 2023Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyondcited by 26
  7. 2024Task-driven Image Fusion with Learnable Fusion Losscited by 25
  8. 2025DifIISR: A Diffusion Model with Gradient Guidance for Infrared Image Super-Resolutioncited by 22
  9. 2023ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss via Meta-Learningcited by 15
  10. 2024Conditional Controllable Image Fusioncited by 13
  11. 2025ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Promptscited by 9
  12. 2024BSAFusion: A Bidirectional Stepwise Feature Alignment Network for Unaligned Medical Image Fusioncited by 6

Built on by

Not cited yet.