mlsanityData to 7 Oct 2026

C-GenReg: Training-Free 3D Point Cloud Registration by Multi-View-Consistent Geometry-to-Image Generation with Probabilistic Modalities Fusion

arXiv 2604.16680 ↗First posted 17 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce C-GenReg, a training-free framework for 3D point cloud registration that leverages the complementary strengths of world-scale generative priors and registration-oriented Vision Foundation Models (VFMs). Current learning-based 3D point cloud registration methods struggle to generalize across sensing modalities, sampling differences, and environments. Hence, C-GenReg augments the geometric point cloud registration branch by transferring the matching problem into an auxiliary image domain, where VFMs excel, using a World Foundation Model to synthesize multi-view-consistent RGB representations from the input geometry. This generative transfer, preserves spatial coherence across source and target views without any fine-tuning. From these generated views, a VFM pretrained for finding dense correspondences extracts matches. The resulting pixel correspondences are lifted back to 3D via the original depth maps. To further enhance robustness, we introduce a "Match-then-Fuse" probabilistic cold-fusion scheme that combines two independent correspondence posteriors, that of the generated-RGB branch with that of the raw geometric branch. This principled fusion preserves each modality inductive bias and provides calibrated confidence without any additional learning. C-GenReg is zero-shot and plug-and-play: all modules are pretrained and operate without fine-tuning. Extensive experiments on indoor (3DMatch, ScanNet) and outdoor (Waymo) benchmarks demonstrate strong zero-shot performance and superior cross-domain generalization. For the first time, we demonstrate a generative registration framework that operates successfully on real outdoor LiDAR data, where no imagery data is available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

17 of 33 references.

References · 17

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  5. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  7. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  8. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  9. 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
  10. 2023RoMa: Robust Dense Feature Matchingcited by 296
  11. 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
  12. 2022Geometric Transformer for Fast and Robust Point Cloud Registrationcited by 200
5 more
  1. 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 68
  2. 2022SC^2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registrationcited by 62
  3. 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 29
  4. 2023Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registrationcited by 26
  5. 2025Foundational Models for 3D Point Clouds: A Survey and Outlookcited by 12

Built on by

Not cited yet.