C-GenReg: Training-Free 3D Point Cloud Registration by Multi-View-Consistent Geometry-to-Image Generation with Probabilistic Modalities Fusion
Not on the map. Why?
Abstract (arXiv)
We introduce C-GenReg, a training-free framework for 3D point cloud registration that leverages the complementary strengths of world-scale generative priors and registration-oriented Vision Foundation Models (VFMs). Current learning-based 3D point cloud registration methods struggle to generalize across sensing modalities, sampling differences, and environments. Hence, C-GenReg augments the geometric point cloud registration branch by transferring the matching problem into an auxiliary image domain, where VFMs excel, using a World Foundation Model to synthesize multi-view-consistent RGB representations from the input geometry. This generative transfer, preserves spatial coherence across source and target views without any fine-tuning. From these generated views, a VFM pretrained for finding dense correspondences extracts matches. The resulting pixel correspondences are lifted back to 3D via the original depth maps. To further enhance robustness, we introduce a "Match-then-Fuse" probabilistic cold-fusion scheme that combines two independent correspondence posteriors, that of the generated-RGB branch with that of the raw geometric branch. This principled fusion preserves each modality inductive bias and provides calibrated confidence without any additional learning. C-GenReg is zero-shot and plug-and-play: all modules are pretrained and operate without fine-tuning. Extensive experiments on indoor (3DMatch, ScanNet) and outdoor (Waymo) benchmarks demonstrate strong zero-shot performance and superior cross-domain generalization. For the first time, we demonstrate a generative registration framework that operates successfully on real outdoor LiDAR data, where no imagery data is available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
17 of 33 references.
References · 17
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
- 2022Geometric Transformer for Fast and Robust Point Cloud Registrationcited by 200
5 more
- 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 68
- 2022SC^2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registrationcited by 62
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 29
- 2023Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registrationcited by 26
- 2025Foundational Models for 3D Point Clouds: A Survey and Outlookcited by 12
Built on by
Not cited yet.