mlsanityData to 7 Oct 2026

Robust 3D Alignment of Generative Reconstructions via Partial Monocular Observations

arXiv 2607.00498 ↗First posted 1 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Aligning generative 3D reconstructions with partial monocular observations is a critical but under-explored challenge in computer vision. This task is inherently ill-posed due to severe asymmetries between noisy, sparse monocular inputs and dense generative priors, whose scale ambiguity and geometric hallucinations, combined with the lack of initial overlap, render traditional registration pipelines ineffective. To resolve these issues, we propose a training-free and interpretable geometric alignment framework that grounds generative 3D priors via a 3D similarity transformation (Sim(3)), which can recover accurate metric scale and pose. Specifically, we introduce an explicit scale factor to resolve metric ambiguity and employ a coarse-to-fine alignment strategy, leveraging geometry-aware descriptors for robust initialization and a decoupled closed-form solver for precision refinement. In addition, we introduce a Hallucination Filtering operation to effectively suppress outliers caused by hallucinated geometry. To evaluate alignment performance under these extreme conditions, we introduce GenPMOAlign--Where2Place, a rigorous benchmark specifically designed for Generative-to-Partial Monocular Observational Alignment. Experiments demonstrate that our method achieves stable and accurate registration, substantially outperforming both classical geometric pipelines and state-of-the-art learning-based baselines. Code and the benchmark will be publicly released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

30 of 49 references.

References · 30

  1. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  2. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
  3. 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
  4. 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
  5. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
  6. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  7. 2020Deep Global Registrationcited by 228
  8. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  9. 2020D3Feat: Joint Learning of Dense Detection and Description of 3D Local Featurescited by 175
  10. 2021CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registrationcited by 151
  11. 2018Scan2CAD: Learning CAD Model Alignment in RGB-D Scanscited by 142
  12. 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 141
18 more
  1. 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
  2. 2019Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejectioncited by 92
  3. 20233D Registration with Maximal Cliquescited by 83
  4. 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 83
  5. 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
  6. 2025GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Trainingcited by 32
  7. 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
  8. 2024PARE-Net: Position-Aware Rotation-Equivariant Networks for Robust Point Cloud Registrationcited by 18
  9. 2023HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimationcited by 17
  10. 2025ZeroGrasp: Zero-Shot Shape Reconstruction Enabled Robotic Graspingcited by 13
  11. 2021LiTAMIN2: Ultra Light LiDAR-based SLAM using Geometric Approximation applied with KL-Divergencecited by 9
  12. 2024Efficient and Robust Point Cloud Registration via Heuristics-guided Parameter Searchcited by 8
  13. 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matchingcited by 8
  14. 2023ZeroReg: Zero-Shot Point Cloud Registration with Foundation Modelscited by 6
  15. 2024CLIPPER+: A Fast Maximal Clique Algorithm for Robust Global Registrationcited by 5
  16. 2025RARE: Refine Any Registration of Pairwise Point Clouds via Zero-Shot Learningcited by 5
  17. 2024PointRegGPT: Boosting 3D Point Cloud Registration using Generative Point-Cloud Pairs for Trainingcited by 4
  18. 2026Towards Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setupscited by 1

Built on by

Not cited yet.