mlsanityData to 14 Oct 2026

Self-Supervised Learning for Point Clouds Data: A Survey

arXiv 2305.11881 ↗First posted 9 May 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D point clouds are a crucial type of data collected by LiDAR sensors and widely used in transportation applications due to its concise descriptions and accurate localization. Deep neural networks (DNNs) have achieved remarkable success in processing large amount of disordered and sparse 3D point clouds, especially in various computer vision tasks, such as pedestrian detection and vehicle recognition. Among all the learning paradigms, Self-Supervised Learning (SSL), an unsupervised training paradigm that mines effective information from the data itself, is considered as an essential solution to solve the time-consuming and labor-intensive data labelling problems via smart pre-training task design. This paper provides a comprehensive survey of recent advances on SSL for point clouds. We first present an innovative taxonomy, categorizing the existing SSL methods into four broad categories based on the pretexts' characteristics. Under each category, we then further categorize the methods into more fine-grained groups and summarize the strength and limitations of the representative methods. We also compare the performance of the notable SSL methods in literature on multiple downstream tasks on benchmark datasets both quantitatively and qualitatively. Finally, we propose a number of future research directions based on the identified limitations of existing SSL research on point clouds.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 95 of its 134 references that are in the map. First posted on arXiv 9 May 2023.

Builds on

95 of 134 references.

References · 95

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  10. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  11. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  12. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
38 more
  1. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  4. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  5. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  6. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  7. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  8. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
  9. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  10. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
  11. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  12. 2018Deep Graph Infomaxcited by 1,106
  13. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
  14. 2020PCT: Point cloud transformercited by 732
  15. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
  16. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  17. 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
  18. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  19. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
  20. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
  21. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
  22. 2017Look, Listen and Learncited by 458
  23. 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
  24. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
  25. 2017Few-Shot Learning with Graph Neural Networkscited by 324
  26. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  27. 2019RepPoints: Point Set Representation for Object Detectioncited by 264
  28. 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
  29. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  30. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  31. 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
  32. 2020How Well Do Self-Supervised Models Transfer?cited by 213
  33. 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
  34. 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
  35. 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
  36. 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
  37. 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
  38. 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 164

50 most cited of 95 All 95 (JSON)

Built on by

Not cited yet.