Self-supervised Learning for Pre-Training 3D Point Clouds: A Survey
Not on the map. Why?
Abstract (arXiv)
Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes it an ideal choice for a wide range of applications, including computer vision, robotics, and autonomous driving, all of which require an understanding of the underlying spatial structures. Given the challenges associated with annotating large-scale point clouds, self-supervised point cloud representation learning has attracted increasing attention in recent years. This approach aims to learn generic and useful point cloud representations from unlabeled data, circumventing the need for extensive manual annotations. In this paper, we present a comprehensive survey of self-supervised point cloud representation learning using DNNs. We begin by presenting the motivation and general trends in recent research. We then briefly introduce the commonly used datasets and evaluation metrics. Following that, we delve into an extensive exploration of self-supervised point cloud representation learning methods based on these techniques. Finally, we share our thoughts on some of the challenges and potential issues that future research in self-supervised learning for pre-training 3D point clouds may encounter.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 113 of its 158 references that are in the map. First posted on arXiv 8 May 2023.
Builds on
113 of 158 references.
References · 113
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023Segment Anythingcited by 8,234
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
38 more
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
- 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 223
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2023SegGPT: Segmenting Everything In Contextcited by 194
- 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 151
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 144
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2020SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instancescited by 123
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
- 2020MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Maskcited by 117
- 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 108
- 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
50 most cited of 113 All 113 (JSON)
Built on by
Citing papers per year: 2023: 5; 2024: 5; 2025: 7; 2026: 4.
21 papers.
Sort:
By area:
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 93
- 2023Towards Knowledge-driven Autonomous Drivingcited by 29
- 2025Locate 3D: Real-World Object Localization via Self-Supervised Learning in 3Dcited by 23
- 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentationcited by 11
- 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learningcited by 11
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understandingcited by 10
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
- 2023Code-Switched Text Synthesis in Unseen Language Pairscited by 7
- 2025Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representationscited by 7
- 2024MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysiscited by 4
- 2024GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3Dcited by 3
- 2024GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learningcited by 2
9 more
- 2025Token Adaptation via Side Graph Convolution for Efficient Fine-tuning of 3D Point Cloud Transformerscited by 2
- 2025Gaussian2Scene: 3D Scene Representation Learning via Self-supervised Learning with 3D Gaussian Splattingcited by 2
- 2026ED-DiT: Physics-Guided Diffusion Pretraining for Transferable Molecular Representations from Electron Densitycited by 1
- 2023M3CS: Multi-Target Masked Point Modeling with Learnable Codebook and Siamese Decoderscited by 0
- 2025Asymmetric Dual Self-Distillation for 3D Self-Supervised Representation Learningcited by 0
- 2025Multi-modal Multi-task Pre-training for Improved Point Cloud Understandingcited by 0
- 2026Criteria-first, semantics-later: reproducible structure discovery in image-based sciencescited by 0
- 2026Channel-Level Relation to Attentive Aggregation with Neighborhood-Homogeneity Constraint for Point Cloud Analysiscited by 0
- 2026MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancementcited by 0
- 2026ED-DiT: Physics-Guided Diffusion Pretraining for Transferable Molecular Representations from Electron Density4 Aug 2026
- 2026MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement30 Jun 2026
- 2026Channel-Level Relation to Attentive Aggregation with Neighborhood-Homogeneity Constraint for Point Cloud Analysis4 May 2026
- 2026Criteria-first, semantics-later: reproducible structure discovery in image-based sciences17 Feb 2026
- 2025Multi-modal Multi-task Pre-training for Improved Point Cloud Understanding23 Jul 2025
- 2025Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representations7 Jul 2025
- 2025Asymmetric Dual Self-Distillation for 3D Self-Supervised Representation Learning26 Jun 2025
- 2025Gaussian2Scene: 3D Scene Representation Learning via Self-supervised Learning with 3D Gaussian Splatting10 Jun 2025
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May 2025
- 2025Locate 3D: Real-World Object Localization via Self-Supervised Learning in 3D19 Apr 2025
- 2025Token Adaptation via Side Graph Convolution for Efficient Fine-tuning of 3D Point Cloud Transformers19 Feb 2025
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey24 Oct 2024
9 more
- 2024GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learning8 Sep 2024
- 2024GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3D20 May 2024
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May 2024
- 2024MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysis1 Mar 2024
- 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learning15 Dec 2023
- 2023Towards Knowledge-driven Autonomous Driving7 Dec 2023
- 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentation31 Oct 2023
- 2023M3CS: Multi-Target Masked Point Modeling with Learnable Codebook and Siamese Decoders23 Sep 2023
- 2023Code-Switched Text Synthesis in Unseen Language Pairs26 May 2023
- 2023Towards Knowledge-driven Autonomous Drivingcited by 29
- 2023Towards Knowledge-driven Autonomous Driving7 Dec 2023
- 2025Locate 3D: Real-World Object Localization via Self-Supervised Learning in 3Dcited by 23
- 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentationcited by 11
- 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learningcited by 11
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
- 2023Code-Switched Text Synthesis in Unseen Language Pairscited by 7
- 2025Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representationscited by 7
- 2024MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysiscited by 4
- 2024GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learningcited by 2
- 2025Token Adaptation via Side Graph Convolution for Efficient Fine-tuning of 3D Point Cloud Transformerscited by 2
- 2025Gaussian2Scene: 3D Scene Representation Learning via Self-supervised Learning with 3D Gaussian Splattingcited by 2
- 2023M3CS: Multi-Target Masked Point Modeling with Learnable Codebook and Siamese Decoderscited by 0
- 2025Multi-modal Multi-task Pre-training for Improved Point Cloud Understandingcited by 0
12 most cited of 15 All 15 (JSON)
- 2026MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement30 Jun 2026
- 2026Channel-Level Relation to Attentive Aggregation with Neighborhood-Homogeneity Constraint for Point Cloud Analysis4 May 2026
- 2026Criteria-first, semantics-later: reproducible structure discovery in image-based sciences17 Feb 2026
- 2025Multi-modal Multi-task Pre-training for Improved Point Cloud Understanding23 Jul 2025
- 2025Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representations7 Jul 2025
- 2025Gaussian2Scene: 3D Scene Representation Learning via Self-supervised Learning with 3D Gaussian Splatting10 Jun 2025
- 2025Locate 3D: Real-World Object Localization via Self-Supervised Learning in 3D19 Apr 2025
- 2025Token Adaptation via Side Graph Convolution for Efficient Fine-tuning of 3D Point Cloud Transformers19 Feb 2025
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey24 Oct 2024
- 2024GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learning8 Sep 2024
- 2024MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysis1 Mar 2024
- 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learning15 Dec 2023
12 newest of 15 All 15 (JSON)