DMM-Align: Closed-Loop Optimization for 2D-3D Registration with Dual-Role Diffusion
Not on the map. Why?
Abstract (arXiv)
2D-3D registration remains brittle in challenging scenarios such as low overlap, occlusion, repetitive structures, and severe cross-modal ambiguity. A key reason is that existing methods improve representation learning, correspondence estimation, or pose computation in isolation, while the dominant failure mode is inherently cross-level, where errors propagate between features, correspondences, and pose. To address this limitation, we propose DMM-Align: Diffusion-based Matching Matrix Alignment, a closed-loop framework that couples correspondence refinement, pose estimation, and representation learning through a shared differentiable geometric state. Our method leverages diffusion in two coordinated roles: a geometry-aware diffusion process refines the soft matching matrix for robust correspondence estimation, while a geometry-conditioned diffusion teacher injects pose-induced supervision back into feature learning. These processes are connected via a differentiable geometric hinge that converts correspondences into a global pose and exposes geometric inconsistency to upstream modules. Extensive experiments on 7-Scenes and RGB-D Scenes V2 demonstrate that DMM-Align consistently outperforms strong baselines, especially under low-overlap and heavy-occlusion conditions, highlighting the effectiveness of closed-loop geometric feedback for robust 2D-3D registration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 55 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
5 of 55 references.
References · 5
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 20183DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registrationcited by 103
- 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 37
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 31
Built on by
Not cited yet.