mlsanityData to 14 Oct 2026

OSDM-MReg: Multimodal Image Registration based One Step Diffusion Model

arXiv 2504.06027 ↗First posted 8 Apr 2025cs.CV eess.IVcited by 2

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Multimodal remote sensing image registration aligns images from different sensors for data fusion and analysis. However, existing methods often struggle to extract modality-invariant features when faced with large nonlinear radiometric differences, such as those between SAR and optical images. To address these challenges, we propose OSDM-MReg, a novel multimodal image registration framework that bridges the modality gap through image-to-image translation. Specifically, we introduce a one-step unaligned target-guided conditional diffusion model (UTGOS-CDM) to translate source and target images into a unified representation domain. Unlike traditional conditional DDPM that require hundreds of iterative steps for inference, our model incorporates a novel inverse translation objective during training to enable direct prediction of the translated image in a single step at test time, significantly accelerating the registration process. After translation, we design a multimodal multiscale registration network (MM-Reg) that extracts and fuses both unimodal and translated multimodal images using the proposed multimodal fusion strategy, enhancing the robustness and precision of alignment across scales and modalities. Extensive experiments on the OSdataset demonstrate that OSDM-MReg achieves superior registration accuracy compared to state-of-the-art methods.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 15 of its 33 references that are in the map. First posted on arXiv 8 Apr 2025.

Builds on

15 of 33 references.

References · 15

  1. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  2. 2017Working hard to know your neighbor's margins: Local descriptor learning losscited by 212
  3. 2016Deep Image Homography Estimationcited by 136
  4. 2019SOSNet: Second Order Similarity Regularization for Local Descriptor Learningcited by 131
  5. 2020Deep Homography Estimation for Dynamic Scenescited by 61
  6. 2021DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenescited by 46
  7. 2022Iterative Deep Homography Estimationcited by 45
  8. 2021Deep Lucas-Kanade Homography for Multimodal Image Alignmentcited by 38
  9. 2022ReDFeat: Recoupling Detection and Description for Multimodal Feature Learningcited by 26
  10. 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
  11. 2020Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detectioncited by 22
  12. 2024STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagerycited by 7
3 more
  1. 2021SDGMNet: Statistic-based Dynamic Gradient Modulation for Local Descriptor Learningcited by 5
  2. 2023PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignmentcited by 4
  3. 2023Multimodal Object Detection in Remote Sensingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Multi-Expert Learning Framework with the State Space Model for Optical and SAR Image Registration
  2. 2024Multi-Sensor Diffusion-Driven Optical Image Translation for Large-Scale Applications
  3. 2025UniDiff: Parameter-Efficient Adaptation of Diffusion Models for Land Cover Classification with Multi-Modal Remotely Sensed Imagery and Sparse Annotations
  4. 2026OmniRSI: Taming Latent Diffusion for Unified Multimodal Remote Sensing Image Generation
  5. 2025Task-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusion
  6. 2025DM3T: Harmonizing Modalities via Diffusion for Multi-Object Tracking
  7. 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior
  8. 2025IMG: Calibrating Diffusion Models via Implicit Multimodal Guidance