Diff-RF: Mutually Reinforced Image Registration and Fusion via Degradation-Aware Learning
Not on the map. Why?
Abstract (arXiv)
Image registration and fusion aim to establish spatial correspondences from misaligned multi-modal source images, and integrate complementary information. However, in real-world imaging scenarios, source images are often affected by complex and diverse degradations, such as low illumination, noise, etc., which severely hinder the effectiveness of registration and fusion. To address this issue, we propose a mutually reinforced image registration and fusion diffusion framework via degradation-aware learning, termed Diff-RF. It explores the intrinsic coupling between registration-fusion and information restoration in the degradation conditions, enabling high-quality fusion of unregistered images under complex degradation conditions. First, the intra-modal restoration module is designed to alleviate modality-specific degradations by leveraging information within each modality, thereby providing more reliable structural representations for registration and facilitating subsequent cross-modal fusion. Second, we develop a cross-modal diffusion registration and fusion module that establishes bidirectional interaction between registration and fusion. By integrating fusion-derived visual cues and correspondence-based geometric conditions into the diffusion process, the proposed framework progressively refines spatial alignment and exploits cross-modal complementary information to achieve collaborative enhancement. Rather than treating them as independent components, degradation-aware information restoration and the collaborative optimization of registration and fusion are tightly coupled, achieving overall performance improvements. Extensive experiments on multiple extended datasets demonstrate that Diff-RF achieves superior registration accuracy and fusion quality under various degraded scenarios, exhibiting strong robustness and generalization ability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 46 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
20 of 46 references.
References · 20
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 231
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
- 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 129
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 84
- 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
8 more
- 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
- 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusioncited by 54
- 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 35
- 2023Diffusion Model for Dense Matchingcited by 21
- 2026Learning Continuous Wasserstein Barycenter Space for Generalized All-in-One Image Restorationcited by 15
- 2025LUT-Fuse: Towards Extremely Fast Infrared and Visible Image Fusion via Distillation to Learnable Look-Up Tablescited by 9
- 2026CRFT: Consistent-Recurrent Feature Flow Transformer for Cross-Modal Image Registrationcited by 3
- 2026FusionRegister: Every Infrared and Visible Image Fusion Deserves Registrationcited by 2
Built on by
Not cited yet.