Learning general and distinctive 3D local deep descriptors for point cloud registration
Not on the map. Why?
Abstract (arXiv)
An effective 3D descriptor should be invariant to different geometric transformations, such as scale and rotation, robust to occlusions and clutter, and capable of generalising to different application domains. We present a simple yet effective method to learn general and distinctive 3D local descriptors that can be used to register point clouds that are captured in different domains. Point cloud patches are extracted, canonicalised with respect to their local reference frame, and encoded into scale and rotation-invariant compact descriptors by a deep neural network that is invariant to permutations of the input points. This design is what enables our descriptors to generalise across domains. We evaluate and compare our descriptors with alternative handcrafted and deep learning-based descriptors on several indoor and outdoor datasets that are reconstructed by using both RGBD sensors and laser scanners. Our descriptors outperform most recent descriptors by a large margin in terms of generalisation, and also become the state of the art in benchmarks where training and testing are performed in the same domain.
Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 21 May 2021.
Builds on
18 of 35 references.
References · 18
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 181
- 2020D3Feat: Joint Learning of Dense Detection and Description of 3D Local Featurescited by 177
- 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
- 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 142
- 2018PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptorscited by 141
- 20183D Point Capsule Networkscited by 106
- 20183DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registrationcited by 103
- 2020End-to-End Learning Local Multi-view Descriptors for 3D Point Cloudscited by 47
6 more
- 2017Learning Compact Geometric Featurescited by 45
- 2013Rotational Projection Statistics for 3D Local Surface Description and Object Recognitioncited by 36
- 20193D Local Features for Direct Pairwise Registrationcited by 26
- 2020Distinctive 3D local deep descriptorscited by 21
- 2019Learning an Effective Equivariant 3D Descriptor Without Supervisioncited by 14
- 2018Iterative Transformer Network for 3D Point Cloudcited by 11
Built on by
Citing papers per year: 2022: 3; 2023: 7; 2024: 8; 2025: 13; 2026: 11.
42 papers.
Sort:
By area:
- 2023FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation modelscited by 57
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 49
- 2022GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentationcited by 35
- 2023Open-vocabulary object 6D pose estimationcited by 29
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisitedcited by 16
- 2025Accurate and efficient zero-shot 6D pose estimation with frozen foundation modelscited by 13
- 2025TurboReg: TurboClique for Robust and Efficient Point Cloud Registrationcited by 13
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 2023G3Reg: Pyramid Graph-based Global Registration using Gaussian Ellipsoid Modelcited by 11
- 2022Overlap-guided Gaussian Mixture Models for Point Cloud Registrationcited by 10
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matchingcited by 9
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous drivingcited by 8
30 more
- 2025BUFFER-X: Towards Zero-Shot Point Cloud Registration in Diverse Scenescited by 8
- 2023Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimationcited by 7
- 2022Data Augmentation-free Unsupervised Learning for 3D Point Cloud Understandingcited by 6
- 2024PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformercited by 6
- 2024Weak-to-Strong 3D Object Detection with X-Ray Distillationcited by 5
- 2025Unlocking Generalization Power in LiDAR Point Cloud Registrationcited by 5
- 2023Novel class discovery meets foundation models for 3D semantic segmentationcited by 4
- 2024ML-SemReg: Boosting Point Cloud Registration with Multi-level Semantic Consistencycited by 4
- 2024PointRegGPT: Boosting 3D Point Cloud Registration using Generative Point-Cloud Pairs for Trainingcited by 4
- 2025Distilling 3D distinctive local descriptors for 6D pose estimationcited by 4
- 2023PatchMixer: Rethinking network design to boost generalization for 3D point cloud understandingcited by 3
- 2025Fully-Geometric Cross-Attention for Point Cloud Registrationcited by 3
- 2025Automated 3D-GS Registration and Fusion via Skeleton Alignment and Gaussian-Adaptive Featurescited by 3
- 20243D Registration in 30 Years: A Surveycited by 2
- 2025CHIP: A multi-sensor dataset for 6D pose estimation of chairs in industrial settingscited by 2
- 2026UniMesh: Unifying 3D Mesh Understanding and Generationcited by 2
- 2024QuadricsReg: Large-Scale Point Cloud Registration using Quadric Primitivescited by 1
- 2025Correspondence-Free Fast and Robust Spherical Point Pattern Registrationcited by 1
- 2026Toward Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setupscited by 1
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimationcited by 1
- 2025LAHNet: Local Attentive Hashing Network for Point Cloud Registrationcited by 0
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignmentcited by 0
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimationcited by 0
- 2026xperception -- Making Robotic Grasping Easiercited by 0
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenescited by 0
- 2026Coarse-to-Fine Registration of Jawbone CT and Intraoral Scan Data Using GeDi and ICP with Pseudo-IOS Ground Truthcited by 0
- 2026Foundational feature fusion for conditional flow matching in 6D pose estimationcited by 0
- 2026Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Featurescited by 0
- 2026ReLoc: Rethinking Scene Coordinate Regression Architecture for Robust Outdoor LiDAR-based Localizationcited by 0
- 2026NovaSplat: Model-Free 6D Object Pose Estimation via 3D Gaussian Splatting Onboarding and Refinementcited by 0
- 2026NovaSplat: Model-Free 6D Object Pose Estimation via 3D Gaussian Splatting Onboarding and Refinement9 Oct 2026
- 2026ReLoc: Rethinking Scene Coordinate Regression Architecture for Robust Outdoor LiDAR-based Localization27 Sep 2026
- 2026Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Features6 Sep 2026
- 2026Foundational feature fusion for conditional flow matching in 6D pose estimation29 Aug 2026
- 2026Coarse-to-Fine Registration of Jawbone CT and Intraoral Scan Data Using GeDi and ICP with Pseudo-IOS Ground Truth3 Aug 2026
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes26 Jul 2026
- 2026xperception -- Making Robotic Grasping Easier14 Jul 2026
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation19 Apr 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 2026Toward Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setups6 Jan 2026
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment23 Dec 2025
30 more
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matching1 Dec 2025
- 2025LAHNet: Local Attentive Hashing Network for Point Cloud Registration30 Nov 2025
- 2025Correspondence-Free Fast and Robust Spherical Point Pattern Registration4 Aug 2025
- 2025Automated 3D-GS Registration and Fusion via Skeleton Alignment and Gaussian-Adaptive Features28 Jul 2025
- 2025TurboReg: TurboClique for Robust and Efficient Point Cloud Registration2 Jul 2025
- 2025Accurate and efficient zero-shot 6D pose estimation with frozen foundation models11 Jun 2025
- 2025CHIP: A multi-sensor dataset for 6D pose estimation of chairs in industrial settings11 Jun 2025
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objects24 Mar 2025
- 2025Distilling 3D distinctive local descriptors for 6D pose estimation19 Mar 2025
- 2025Unlocking Generalization Power in LiDAR Point Cloud Registration13 Mar 2025
- 2025BUFFER-X: Towards Zero-Shot Point Cloud Registration in Diverse Scenes11 Mar 2025
- 2025Fully-Geometric Cross-Attention for Point Cloud Registration12 Feb 2025
- 20243D Registration in 30 Years: A Survey18 Dec 2024
- 2024QuadricsReg: Large-Scale Point Cloud Registration using Quadric Primitives4 Dec 2024
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image25 Nov 2024
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisited23 Sep 2024
- 2024PointRegGPT: Boosting 3D Point Cloud Registration using Generative Point-Cloud Pairs for Training19 Jul 2024
- 2024ML-SemReg: Boosting Point Cloud Registration with Multi-level Semantic Consistency13 Jul 2024
- 2024PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer22 Apr 2024
- 2024Weak-to-Strong 3D Object Detection with X-Ray Distillation31 Mar 2024
- 2023Novel class discovery meets foundation models for 3D semantic segmentation6 Dec 2023
- 2023FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation models1 Dec 2023
- 2023Open-vocabulary object 6D pose estimation1 Dec 2023
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous driving6 Nov 2023
- 2023G3Reg: Pyramid Graph-based Global Registration using Gaussian Ellipsoid Model22 Aug 2023
- 2023PatchMixer: Rethinking network design to boost generalization for 3D point cloud understanding28 Jul 2023
- 2023Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation28 Jul 2023
- 2022Overlap-guided Gaussian Mixture Models for Point Cloud Registration17 Oct 2022
- 2022Data Augmentation-free Unsupervised Learning for 3D Point Cloud Understanding6 Oct 2022
- 2022GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation20 Jul 2022
- 2024Weak-to-Strong 3D Object Detection with X-Ray Distillation31 Mar 2024
- 2023FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation modelscited by 57
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 49
- 2022GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentationcited by 35
- 2023Open-vocabulary object 6D pose estimationcited by 29
- 2024KISS-Matcher: Fast and Robust Point Cloud Registration Revisitedcited by 16
- 2025Accurate and efficient zero-shot 6D pose estimation with frozen foundation modelscited by 13
- 2025TurboReg: TurboClique for Robust and Efficient Point Cloud Registrationcited by 13
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 2023G3Reg: Pyramid Graph-based Global Registration using Gaussian Ellipsoid Modelcited by 11
- 2022Overlap-guided Gaussian Mixture Models for Point Cloud Registrationcited by 10
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous drivingcited by 8
- 2025BUFFER-X: Towards Zero-Shot Point Cloud Registration in Diverse Scenescited by 8
12 most cited of 39 All 39 (JSON)
- 2026NovaSplat: Model-Free 6D Object Pose Estimation via 3D Gaussian Splatting Onboarding and Refinement9 Oct 2026
- 2026ReLoc: Rethinking Scene Coordinate Regression Architecture for Robust Outdoor LiDAR-based Localization27 Sep 2026
- 2026Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Features6 Sep 2026
- 2026Coarse-to-Fine Registration of Jawbone CT and Intraoral Scan Data Using GeDi and ICP with Pseudo-IOS Ground Truth3 Aug 2026
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes26 Jul 2026
- 2026xperception -- Making Robotic Grasping Easier14 Jul 2026
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation19 Apr 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 2026Toward Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setups6 Jan 2026
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment23 Dec 2025
- 2025LAHNet: Local Attentive Hashing Network for Point Cloud Registration30 Nov 2025
12 newest of 39 All 39 (JSON)