Collaborative Learning for Unsupervised Multimodal Remote Sensing Image Registration: Integrating Self-Supervision and MIM-Guided Diffusion-Based Image Translation
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
The substantial modality-induced variations in radiometric, texture, and structural characteristics pose significant challenges for the accurate registration of multimodal images. While supervised deep learning methods have demonstrated strong performance, they often rely on large-scale annotated datasets, limiting their practical application. Traditional unsupervised methods usually optimize registration by minimizing differences in feature representations, yet often fail to robustly capture geometric discrepancies, particularly under substantial spatial and radiometric variations, thus hindering convergence stability. To address these challenges, we propose a Collaborative Learning framework for Unsupervised Multimodal Image Registration, named CoLReg, which reformulates unsupervised registration learning into a collaborative training paradigm comprising three components: (1) a cross-modal image translation network, MIMGCD, which employs a learnable Maximum Index Map (MIM) guided conditional diffusion model to synthesize modality-consistent image pairs; (2) a self-supervised intermediate registration network which learns to estimate geometric transformations using accurate displacement labels derived from MIMGCD outputs; (3) a distilled cross-modal registration network trained with pseudo-label predicted by the intermediate network. The three networks are jointly optimized through an alternating training strategy wherein each network enhances the performance of the others. This mutual collaboration progressively reduces modality discrepancies, enhances the quality of pseudo-labels, and improves registration accuracy. Extensive experimental results on multiple datasets demonstrate that our ColReg achieves competitive or superior performance compared to state-of-the-art unsupervised approaches and even surpasses several supervised baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 18 of its 36 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
18 of 36 references.
Closest ancestors · 1
Same direction, newest first
Other references · 17
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 231
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2016Deep Image Homography Estimationcited by 136
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
- 2019Content-Aware Unsupervised Deep Homography Estimationcited by 62
- 2020Deep Homography Estimation for Dynamic Scenescited by 61
- 2021DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenescited by 46
5 more
- 2021Deep Lucas-Kanade Homography for Multimodal Image Alignmentcited by 38
- 2022ReDFeat: Recoupling Detection and Description for Multimodal Feature Learningcited by 26
- 2021Perceptual Loss for Robust Unsupervised Homography Estimationcited by 13
- 2024STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagerycited by 7
- 2024Unsupervised Homography Estimation on Multimodal Image Pair via Alternating Optimizationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OmniRSI: Taming Latent Diffusion for Unified Multimodal Remote Sensing Image Generation
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensing
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimators
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensing
- 2025UniDiff: Parameter-Efficient Adaptation of Diffusion Models for Land Cover Classification with Multi-Modal Remotely Sensed Imagery and Sparse Annotations
- 2025Balanced Diffusion-Guided Fusion for Multimodal Remote Sensing Classification
- 2024Mask Approximation Net: A Novel Diffusion Model Approach for Remote Sensing Change Captioning
- 2025DiffRegCD: Integrated Registration and Change Detection with Diffusion Features