Self-supervised Learning of Point Clouds via Orientation Estimation
Not on the map. Why?
Abstract (arXiv)
Point clouds provide a compact and efficient representation of 3D shapes. While deep neural networks have achieved impressive results on point cloud learning tasks, they require massive amounts of manually labeled data, which can be costly and time-consuming to collect. In this paper, we leverage 3D self-supervision for learning downstream tasks on point clouds with fewer labels. A point cloud can be rotated in infinitely many ways, which provides a rich label-free source for self-supervision. We consider the auxiliary task of predicting rotations that in turn leads to useful features for other tasks such as shape classification and 3D keypoint prediction. Using experiments on ShapeNet and ModelNet, we demonstrate that our approach outperforms the state-of-the-art. Moreover, features learned by our model are complementary to other self-supervised methods and combining them leads to further performance improvement.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 28; 2023: 17; 2024: 10; 2025: 9.
72 papers.
Sort:
By area:
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 192
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
- 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Promptingcited by 74
38 more
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimationcited by 68
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
- 2023Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-trainingcited by 52
- 2024Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysiscited by 52
- 2022SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Cloudscited by 49
- 2022Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learningcited by 46
- 2023Three Pillars improving Vision Foundation Model Distillation for Lidarcited by 43
- 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzlescited by 36
- 2021Geometry-Aware Self-Training for Unsupervised Domain Adaptationon Object Point Cloudscited by 31
- 2021Domain Adaptation on Point Clouds via Geometry-Aware Implicitscited by 26
- 2021Multimodal Semi-Supervised Learning for 3D Objectscited by 24
- 2023BEVContrast: Self-Supervision in BEV Space for Automotive Lidar Point Cloudscited by 24
- 2023Self-supervised Learning for Pre-Training 3D Point Clouds: A Surveycited by 21
- 2022Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learningcited by 19
- 20223D-OAE: Occlusion Auto-Encoders for Self-Supervised Learning on Point Cloudscited by 18
- 2022POS-BERT: Point Cloud One-Stage BERT Pre-Trainingcited by 16
- 2022CO^3: Cooperative Unsupervised 3D Representation Learning for Autonomous Drivingcited by 15
- 2022Masked Surfel Prediction for Self-Supervised Point Cloud Learningcited by 15
- 2024RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learningcited by 15
- 2023Neural Semantic Surface Mapscited by 13
- 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Drivingcited by 11
- 2022Unsupervised Point Cloud Pre-Training via Contrasting and Clusteringcited by 9
- 2022Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learningcited by 9
- 2023SC3K: Self-supervised and Coherent 3D Keypoints Estimation from Rotated, Noisy, and Decimated Point Cloud Datacited by 9
- 2024Shelf-Supervised Cross-Modal Pre-Training for 3D Object Detectioncited by 9
- 2024Advancing 3D Point Cloud Understanding through Deep Transfer Learning: A Comprehensive Surveycited by 9
- 2022Self-Supervised Learning with Multi-View Rendering for 3D Point Cloud Analysiscited by 8
- 2021Hierarchical View Predictor: Unsupervised 3D Global Feature Learning through Hierarchical Prediction among Unordered Viewscited by 7
- 2022PointVST: Self-Supervised Pre-training for 3D Point Clouds via View-Specific Point-to-Image Translationcited by 7
- 2024Self-supervised Learning of LiDAR 3D Point Clouds via 2D-3D Neural Calibrationcited by 7
- 2022Data Augmentation-free Unsupervised Learning for 3D Point Cloud Understandingcited by 6
- 2023Regress Before Construct: Regress Autoencoder for Point Cloud Self-supervised Learningcited by 6
- 2021Point Discriminative Learning for Data-efficient 3D Point Cloud Analysiscited by 5
- 2022Boosting Point-BERT by Multi-choice Tokenscited by 5
- 2022PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understandingcited by 5
- 2024Multi-modal Relation Distillation for Unified 3D Representation Learningcited by 5
- 2023PointGame: Geometrically and Adaptively Masked Auto-Encoder on Point Cloudscited by 4
- 2023Novel class discovery meets foundation models for 3D semantic segmentationcited by 4
50 most cited of 72 All 72 (JSON)
- 20253D sans 3D Scans: Scalable Pre-training from Video-Generated Point Clouds28 Dec 2025
- 2025CrossJEPA: Cross-Modal Joint-Embedding Predictive Architecture for Efficient 3D Representation Learning from 2D Images23 Nov 2025
- 2025PointLAMA: Latent Attention meets Mamba for Efficient Point Cloud Pretraining23 Jul 2025
- 2025Attention-Guided Multi-Scale Local Reconstruction for Point Clouds via Masked Autoencoder Self-Supervised Learning5 Jul 2025
- 2025A Cross Branch Fusion-Based Contrastive Learning Framework for Point Cloud Self-supervised Learning30 May 2025
- 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles29 May 2025
- 2025Physics-Driven Local-Whole Elastic Deformation Modeling for Point Cloud Representation Learning20 May 2025
- 2025CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation12 Mar 2025
- 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Driving7 Jan 2025
- 2024Is Contrastive Distillation Enough for Learning Comprehensive 3D Representations?12 Dec 2024
- 2024Symmetry-Robust 3D Orientation Estimation2 Oct 2024
- 2024Bridging Domain Gap of Point Cloud Representations via Self-Supervised Geometric Augmentation11 Sep 2024
38 more
- 2024RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learning31 Aug 2024
- 2024Advancing 3D Point Cloud Understanding through Deep Transfer Learning: A Comprehensive Survey25 Jul 2024
- 2024Multi-modal Relation Distillation for Unified 3D Representation Learning19 Jul 2024
- 2024Shelf-Supervised Cross-Modal Pre-Training for 3D Object Detection14 Jun 2024
- 2024Cross-Modal Self-Training: Aligning Images and Pointclouds to Learn Classification without Labels15 Apr 2024
- 2024Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis3 Mar 2024
- 2024Self-supervised Learning of LiDAR 3D Point Clouds via 2D-3D Neural Calibration23 Jan 2024
- 2023Novel class discovery meets foundation models for 3D semantic segmentation6 Dec 2023
- 2023Three Pillars improving Vision Foundation Model Distillation for Lidar26 Oct 2023
- 2023BEVContrast: Self-Supervision in BEV Space for Automotive Lidar Point Clouds26 Oct 2023
- 2023Regress Before Construct: Regress Autoencoder for Point Cloud Self-supervised Learning25 Sep 2023
- 2023Neural Semantic Surface Maps9 Sep 2023
- 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following1 Sep 2023
- 2023SC3K: Self-supervised and Coherent 3D Keypoints Estimation from Rotated, Noisy, and Decimated Point Cloud Data10 Aug 2023
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Models15 Jun 2023
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding18 May 2023
- 2023Self-Supervised Learning for Point Clouds Data: A Survey9 May 2023
- 2023Self-supervised Learning for Pre-Training 3D Point Clouds: A Survey8 May 2023
- 2023MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive Learning26 Apr 2023
- 2023PointGame: Geometrically and Adaptively Masked Auto-Encoder on Point Clouds23 Mar 2023
- 2023CLR-GAM: Contrastive Point Cloud Learning with Guided Augmentation and Feature Mapping28 Feb 2023
- 2023Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-training27 Feb 2023
- 2023PointSmile: Point Self-supervised Learning via Curriculum Mutual Information30 Jan 2023
- 2023Slice Transformer and Self-supervised Learning for 6DoF Localization in 3D Point Cloud Maps21 Jan 2023
- 2022PointVST: Self-Supervised Pre-training for 3D Point Clouds via View-Specific Point-to-Image Translation29 Dec 2022
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?16 Dec 2022
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoders13 Dec 2022
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimation12 Dec 2022
- 2022PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understanding22 Nov 2022
- 2022Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learning13 Nov 2022
- 2022Joint Data and Feature Augmentation for Self-Supervised Representation Learning on Point Clouds2 Nov 2022
- 2022SL3D: Self-supervised-Self-labeled 3D Recognition30 Oct 2022
- 2022Self-Supervised Learning with Multi-View Rendering for 3D Point Cloud Analysis28 Oct 2022
- 2022HAVANA: Hard negAtiVe sAmples aware self-supervised coNtrastive leArning for Airborne laser scanning point clouds semantic segmentation19 Oct 2022
- 2022Data Augmentation-free Unsupervised Learning for 3D Point Cloud Understanding6 Oct 2022
- 2022PointACL:Adversarial Contrastive Learning for Robust Point Clouds Representation under Adversarial Attack14 Sep 2022
- 2022SeRP: Self-Supervised Representation Learning Using Perturbed Point Clouds13 Sep 2022
- 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Prompting4 Aug 2022
50 newest of 72 All 72 (JSON)
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 192
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
- 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Promptingcited by 74
12 most cited of 69 All 69 (JSON)
- 20253D sans 3D Scans: Scalable Pre-training from Video-Generated Point Clouds28 Dec 2025
- 2025CrossJEPA: Cross-Modal Joint-Embedding Predictive Architecture for Efficient 3D Representation Learning from 2D Images23 Nov 2025
- 2025Attention-Guided Multi-Scale Local Reconstruction for Point Clouds via Masked Autoencoder Self-Supervised Learning5 Jul 2025
- 2025A Cross Branch Fusion-Based Contrastive Learning Framework for Point Cloud Self-supervised Learning30 May 2025
- 2025Physics-Driven Local-Whole Elastic Deformation Modeling for Point Cloud Representation Learning20 May 2025
- 2025CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation12 Mar 2025
- 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Driving7 Jan 2025
- 2024Is Contrastive Distillation Enough for Learning Comprehensive 3D Representations?12 Dec 2024
- 2024Symmetry-Robust 3D Orientation Estimation2 Oct 2024
- 2024Bridging Domain Gap of Point Cloud Representations via Self-Supervised Geometric Augmentation11 Sep 2024
- 2024RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learning31 Aug 2024
- 2024Advancing 3D Point Cloud Understanding through Deep Transfer Learning: A Comprehensive Survey25 Jul 2024
12 newest of 69 All 69 (JSON)