mlsanityData to 14 Oct 2026

DMM-Align: Closed-Loop Optimization for 2D-3D Registration with Dual-Role Diffusion

arXiv 2609.27794 ↗First posted 17 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

2D-3D registration remains brittle in challenging scenarios such as low overlap, occlusion, repetitive structures, and severe cross-modal ambiguity. A key reason is that existing methods improve representation learning, correspondence estimation, or pose computation in isolation, while the dominant failure mode is inherently cross-level, where errors propagate between features, correspondences, and pose. To address this limitation, we propose DMM-Align: Diffusion-based Matching Matrix Alignment, a closed-loop framework that couples correspondence refinement, pose estimation, and representation learning through a shared differentiable geometric state. Our method leverages diffusion in two coordinated roles: a geometry-aware diffusion process refines the soft matching matrix for robust correspondence estimation, while a geometry-conditioned diffusion teacher injects pose-induced supervision back into feature learning. These processes are connected via a differentiable geometric hinge that converts correspondences into a global pose and exposes geometric inconsistency to upstream modules. Extensive experiments on 7-Scenes and RGB-D Scenes V2 demonstrate that DMM-Align consistently outperforms strong baselines, especially under low-overlap and heavy-occlusion conditions, highlighting the effectiveness of closed-loop geometric feedback for robust 2D-3D registration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 55 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

5 of 55 references.

References · 5

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  2. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  3. 20183DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registrationcited by 103
  4. 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 37
  5. 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 31

Built on by

Not cited yet.