Self-Supervised Learning for Point Clouds Data: A Survey
Not on the map. Why?
Abstract (arXiv)
3D point clouds are a crucial type of data collected by LiDAR sensors and widely used in transportation applications due to its concise descriptions and accurate localization. Deep neural networks (DNNs) have achieved remarkable success in processing large amount of disordered and sparse 3D point clouds, especially in various computer vision tasks, such as pedestrian detection and vehicle recognition. Among all the learning paradigms, Self-Supervised Learning (SSL), an unsupervised training paradigm that mines effective information from the data itself, is considered as an essential solution to solve the time-consuming and labor-intensive data labelling problems via smart pre-training task design. This paper provides a comprehensive survey of recent advances on SSL for point clouds. We first present an innovative taxonomy, categorizing the existing SSL methods into four broad categories based on the pretexts' characteristics. Under each category, we then further categorize the methods into more fine-grained groups and summarize the strength and limitations of the representative methods. We also compare the performance of the notable SSL methods in literature on multiple downstream tasks on benchmark datasets both quantitatively and qualitatively. Finally, we propose a number of future research directions based on the identified limitations of existing SSL research on point clouds.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 95 of its 134 references that are in the map. First posted on arXiv 9 May 2023.
Builds on
95 of 134 references.
References · 95
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
38 more
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2018Deep Graph Infomaxcited by 1,106
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
- 2020PCT: Point cloud transformercited by 732
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2017Look, Listen and Learncited by 458
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
- 2017Few-Shot Learning with Graph Neural Networkscited by 324
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2019RepPoints: Point Set Representation for Object Detectioncited by 264
- 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2020How Well Do Self-Supervised Models Transfer?cited by 213
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 164
50 most cited of 95 All 95 (JSON)
Built on by
Not cited yet.