A Consistency-Aware Spot-Guided Transformer for Versatile and Hierarchical Point Cloud Registration
Not on the map. Why?
Abstract (arXiv)
Deep learning-based feature matching has shown great superiority for point cloud registration in the absence of pose priors. Although coarse-to-fine matching approaches are prevalent, the coarse matching of existing methods is typically sparse and loose without consideration of geometric consistency, which makes the subsequent fine matching rely on ineffective optimal transport and hypothesis-and-selection methods for consistency. Therefore, these methods are neither efficient nor scalable for real-time applications such as odometry in robotics. To address these issues, we design a consistency-aware spot-guided Transformer (CAST), which incorporates a spot-guided cross-attention module to avoid interfering with irrelevant areas, and a consistency-aware self-attention module to enhance matching capabilities with geometrically consistent correspondences. Furthermore, a lightweight fine matching module for both sparse keypoints and dense features can estimate the transformation accurately. Extensive experiments on both outdoor LiDAR point cloud datasets and indoor RGBD point cloud datasets demonstrate that our method achieves state-of-the-art accuracy, efficiency, and robustness.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 36 of its 63 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
36 of 63 references.
References · 36
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,231
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,628
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,498
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,994
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,203
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 334
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 320
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 288
- 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
- 2020Deep Global Registrationcited by 228
- 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 180
24 more
- 2020D3Feat: Joint Learning of Dense Detection and Description of 3D Local Featurescited by 176
- 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
- 2021CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registrationcited by 151
- 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 142
- 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
- 2020Feature-metric Registration: A Fast Semi-supervised Approach for Robust Point Cloud Registration without Correspondencescited by 108
- 20183DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registrationcited by 103
- 2022REGTR: End-to-end Point Cloud Correspondences with Transformerscited by 95
- 20233D Registration with Maximal Cliquescited by 84
- 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 83
- 2019USIP: Unsupervised Stable Interest Point Detection from 3D Point Cloudscited by 70
- 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 69
- 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
- 2016Learning to Navigate the Energy Landscapecited by 62
- 2022SC^2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registrationcited by 62
- 2021Deep Two-View Structure-from-Motion Revisitedcited by 39
- 20232D3D-MATR: 2D-3D Matching Transformer for Detection-free Registration between Images and Point Cloudscited by 27
- 2023Adaptive Spot-Guided Transformer for Consistent Local Feature Matchingcited by 22
- 2024FastMAC: Stochastic Spectral Sampling of Correspondence Graphcited by 16
- 2020RSKDD-Net: Random Sample-based Keypoint Detector and Descriptorcited by 12
- 2016Fine-To-Coarse Global Registration of RGB-D Scanscited by 7
- 2020REDE: End-to-end Object 6D Pose Robust Estimation Using Differentiable Outliers Eliminationcited by 7
- 2023KDD-LOAM: Jointly Learned Keypoint Detector and Descriptors Assisted LiDAR Odometry and Mappingcited by 4
- 2023Adaptive Multi-step Refinement Network for Robust Point Cloud Registrationcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 2.
4 papers.
- 20243D Registration in 30 Years: A Surveycited by 2
- 2026LEADER: Learning Reliable Local-to-Global Correspondences for LiDAR Relocalizationcited by 1
- 2025MT-PCR: Hybrid Mamba-Transformer Network with Spatial Serialization for Point Cloud Registrationcited by 0
- 2026BridgeMatch: Conditional Transport Bridges in Matching Matrix Space for 3D Deformable Registrationcited by 0
- 2026BridgeMatch: Conditional Transport Bridges in Matching Matrix Space for 3D Deformable Registration10 Sep 2026
- 2026LEADER: Learning Reliable Local-to-Global Correspondences for LiDAR Relocalization13 Apr 2026
- 2025MT-PCR: Hybrid Mamba-Transformer Network with Spatial Serialization for Point Cloud Registration16 Jun 2025
- 20243D Registration in 30 Years: A Survey18 Dec 2024