mlsanityData to 14 Oct 2026

Self-supervised Learning for Pre-Training 3D Point Clouds: A Survey

arXiv 2305.04691 ↗First posted 8 May 2023cs.CVcited by 21

Not on the map. Why?

Abstract (arXiv)

Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes it an ideal choice for a wide range of applications, including computer vision, robotics, and autonomous driving, all of which require an understanding of the underlying spatial structures. Given the challenges associated with annotating large-scale point clouds, self-supervised point cloud representation learning has attracted increasing attention in recent years. This approach aims to learn generic and useful point cloud representations from unlabeled data, circumventing the need for extensive manual annotations. In this paper, we present a comprehensive survey of self-supervised point cloud representation learning using DNNs. We begin by presenting the motivation and general trends in recent research. We then briefly introduce the commonly used datasets and evaluation metrics. Following that, we delve into an extensive exploration of self-supervised point cloud representation learning methods based on these techniques. Finally, we share our thoughts on some of the challenges and potential issues that future research in self-supervised learning for pre-training 3D point clouds may encounter.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 113 of its 158 references that are in the map. First posted on arXiv 8 May 2023.

Builds on

113 of 158 references.

References · 113

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2023Segment Anythingcited by 8,234
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  9. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  10. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  11. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  12. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
38 more
  1. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  2. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  4. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  5. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  6. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  7. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  8. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
  9. 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
  10. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  11. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
  12. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
  13. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
  14. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
  15. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  16. 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
  17. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
  18. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  19. 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
  20. 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
  21. 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 223
  22. 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
  23. 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
  24. 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
  25. 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
  26. 2023SegGPT: Segmenting Everything In Contextcited by 194
  27. 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
  28. 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
  29. 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
  30. 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
  31. 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 151
  32. 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 144
  33. 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
  34. 2020SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instancescited by 123
  35. 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
  36. 2020MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Maskcited by 117
  37. 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 108
  38. 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100

50 most cited of 113 All 113 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 5; 2025: 7; 2026: 4.

21 papers.

Sort:

By area:

  1. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 93
  2. 2023Towards Knowledge-driven Autonomous Drivingcited by 29
  3. 2025Locate 3D: Real-World Object Localization via Self-Supervised Learning in 3Dcited by 23
  4. 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentationcited by 11
  5. 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learningcited by 11
  6. 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understandingcited by 10
  7. 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
  8. 2023Code-Switched Text Synthesis in Unseen Language Pairscited by 7
  9. 2025Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representationscited by 7
  10. 2024MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysiscited by 4
  11. 2024GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3Dcited by 3
  12. 2024GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learningcited by 2
9 more
  1. 2025Token Adaptation via Side Graph Convolution for Efficient Fine-tuning of 3D Point Cloud Transformerscited by 2
  2. 2025Gaussian2Scene: 3D Scene Representation Learning via Self-supervised Learning with 3D Gaussian Splattingcited by 2
  3. 2026ED-DiT: Physics-Guided Diffusion Pretraining for Transferable Molecular Representations from Electron Densitycited by 1
  4. 2023M3CS: Multi-Target Masked Point Modeling with Learnable Codebook and Siamese Decoderscited by 0
  5. 2025Asymmetric Dual Self-Distillation for 3D Self-Supervised Representation Learningcited by 0
  6. 2025Multi-modal Multi-task Pre-training for Improved Point Cloud Understandingcited by 0
  7. 2026Criteria-first, semantics-later: reproducible structure discovery in image-based sciencescited by 0
  8. 2026Channel-Level Relation to Attentive Aggregation with Neighborhood-Homogeneity Constraint for Point Cloud Analysiscited by 0
  9. 2026MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancementcited by 0