Towards Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setups
Not on the map. Why?
Abstract (arXiv)
Some deep learning-based point cloud registration methods struggle with zero-shot generalization, often requiring dataset-specific hyperparameter tuning or retraining for new environments. We identify three critical limitations: (a) fixed user-defined parameters (e.g., voxel size, search radius) that fail to generalize across varying scales, (b) learned keypoint detectors exhibit poor cross-domain transferability, and (c) absolute coordinates amplify scale mismatches between datasets. To address these three issues, we present BUFFER-X, a training-free registration framework that achieves zero-shot generalization through: (a) geometric bootstrapping for automatic hyperparameter estimation, (b) distribution-aware farthest point sampling to replace learned detectors, and (c) patch-level coordinate normalization to ensure scale consistency. Our approach employs hierarchical multi-scale matching to extract correspondences across local, middle, and global receptive fields, enabling robust registration in diverse environments. For efficiency-critical applications, we introduce BUFFER-X-Lite, which reduces total computation time by 43% (relative to BUFFER-X) through early exit strategies and fast pose solvers while preserving accuracy. We evaluate on a comprehensive benchmark comprising 12 datasets spanning object-scale, indoor, and outdoor scenes, including cross-sensor registration between heterogeneous LiDAR configurations. Results demonstrate that our approach generalizes effectively without manual tuning or prior knowledge of test domains. Code: https://github.com/MIT-SPARK/BUFFER-X.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 65 of its 114 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
65 of 114 references.
References · 65
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 388
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 287
38 more
- 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2020Deep Global Registrationcited by 228
- 2020D3Feat: Joint Learning of Dense Detection and Description of 3D Local Featurescited by 175
- 2020Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualizationcited by 170
- 2016Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registrationcited by 159
- 2021CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registrationcited by 151
- 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 141
- 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
- 20183DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registrationcited by 100
- 2019Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejectioncited by 92
- 2021A comprehensive survey on point cloud registrationcited by 84
- 20233D Registration with Maximal Cliquescited by 83
- 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 83
- 2021Only Train Once: A One-Shot Neural Network Training And Pruning Frameworkcited by 70
- 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 68
- 2021LCDNet: Deep Loop Closure Detection and Point Cloud Registration for LiDAR SLAMcited by 67
- 2020The Newer College Dataset: Handheld LiDAR, Inertial and Vision with Ground Truthcited by 61
- 2021Learning general and distinctive 3D local deep descriptors for point cloud registrationcited by 41
- 2023A Survey on Global LiDAR Localization: Challenges, Advances and Open Problemscited by 40
- 2019A Polynomial-time Solution for Robust Registration with Extreme Outlier Ratescited by 38
- 2020ROBIN: a Graph-Theoretic Approach to Reject Outliers in Robust Estimation using Invariantscited by 38
- 2021Patchwork: Concentric Zone-based Region-wise Ground Segmentation with Ground Likelihood Estimation Using a 3D LiDAR Sensorcited by 28
- 2023Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registrationcited by 26
- 2023HeLiPR: Heterogeneous LiDAR Dataset for inter-LiDAR Place Recognition under Spatiotemporal Variationscited by 26
- 2022A Single Correspondence Is Enough: Robust Global Registration to Avoid Degeneracy in Urban Environmentscited by 19
- 2023Quatro++: Robust Global Registration Exploiting Ground Segmentation for Loop Closing in LiDAR SLAMcited by 18
- 2024PARE-Net: Position-Aware Rotation-Equivariant Networks for Robust Point Cloud Registrationcited by 18
- 2023Instant Domain Augmentation for LiDAR Semantic Segmentationcited by 16
- 2023Resilient and Distributed Multi-Robot Visual SLAM: Datasets, Experiments, and Lessons Learnedcited by 16
- 2024FastMAC: Stochastic Spectral Sampling of Correspondence Graphcited by 16
- 2024Scalable 3D Registration via Truncated Entry-wise Absolute Residualscited by 16
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisitedcited by 16
- 2021PHASER: a Robust and Correspondence-free Global Pointcloud Registrationcited by 15
- 2024Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extensioncited by 15
- 2023Accelerating Globally Optimal Consensus Maximization in Geometric Visioncited by 14
- 2021TriVoC: Efficient Voting-based Consensus Maximization for Robust Point Cloud Registration with Extreme Outlier Ratioscited by 11
- 2023Segregator: Global Point Cloud Registration with Semantic and Geometric Cuescited by 11
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimators
- 2023Diff-PCR: Diffusion-Based Correspondence Searching in Doubly Stochastic Matrix Space for Point Cloud Registration
- 2026FS-I2P:A Hierarchical Focus-Sweep Registration Network with Dynamically Allocated Depth
- 2026Image-to-Point Cloud Registration Made Easy with Rectified Flow-based LiDAR Upsampling
- 2025Efficient Point Clouds Upsampling via Flow Matching
- 2026Learning Point Cloud Geometry as a Statistical Manifold: Theory and Practice ↗
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior
- 2023DIPR: Efficient Point Cloud Registration via Dynamic Iteration