OSDM-MReg: Multimodal Image Registration based One Step Diffusion Model
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Multimodal remote sensing image registration aligns images from different sensors for data fusion and analysis. However, existing methods often struggle to extract modality-invariant features when faced with large nonlinear radiometric differences, such as those between SAR and optical images. To address these challenges, we propose OSDM-MReg, a novel multimodal image registration framework that bridges the modality gap through image-to-image translation. Specifically, we introduce a one-step unaligned target-guided conditional diffusion model (UTGOS-CDM) to translate source and target images into a unified representation domain. Unlike traditional conditional DDPM that require hundreds of iterative steps for inference, our model incorporates a novel inverse translation objective during training to enable direct prediction of the translated image in a single step at test time, significantly accelerating the registration process. After translation, we design a multimodal multiscale registration network (MM-Reg) that extracts and fuses both unimodal and translated multimodal images using the proposed multimodal fusion strategy, enhancing the robustness and precision of alignment across scales and modalities. Extensive experiments on the OSdataset demonstrate that OSDM-MReg achieves superior registration accuracy compared to state-of-the-art methods.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 15 of its 33 references that are in the map. First posted on arXiv 8 Apr 2025.
Builds on
15 of 33 references.
References · 15
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2017Working hard to know your neighbor's margins: Local descriptor learning losscited by 212
- 2016Deep Image Homography Estimationcited by 136
- 2019SOSNet: Second Order Similarity Regularization for Local Descriptor Learningcited by 131
- 2020Deep Homography Estimation for Dynamic Scenescited by 61
- 2021DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenescited by 46
- 2022Iterative Deep Homography Estimationcited by 45
- 2021Deep Lucas-Kanade Homography for Multimodal Image Alignmentcited by 38
- 2022ReDFeat: Recoupling Detection and Description for Multimodal Feature Learningcited by 26
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
- 2020Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detectioncited by 22
- 2024STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagerycited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Multi-Expert Learning Framework with the State Space Model for Optical and SAR Image Registration
- 2024Multi-Sensor Diffusion-Driven Optical Image Translation for Large-Scale Applications
- 2025UniDiff: Parameter-Efficient Adaptation of Diffusion Models for Land Cover Classification with Multi-Modal Remotely Sensed Imagery and Sparse Annotations
- 2026OmniRSI: Taming Latent Diffusion for Unified Multimodal Remote Sensing Image Generation
- 2025Task-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusion
- 2025DM3T: Harmonizing Modalities via Diffusion for Multi-Object Tracking
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior
- 2025IMG: Calibrating Diffusion Models via Implicit Multimodal Guidance