Unsupervised Point Cloud Pre-Training via Contrasting and Clustering
Not on the map. Why?
Abstract (arXiv)
Annotating large-scale point clouds is highly time-consuming and often infeasible for many complex real-world tasks. Point cloud pre-training has therefore become a promising strategy for learning discriminative representations without labeled data. In this paper, we propose a general unsupervised pre-training framework, termed ConClu, which jointly integrates contrasting and clustering. The contrasting objective maximizes the similarity between feature representations extracted from two augmented views of the same point cloud, while the clustering objective simultaneously partitions the data and enforces consistency between cluster assignments across augmentations. Experimental results on multiple downstream tasks show that our method outperforms state-of-the-art approaches, demonstrating the effectiveness of the proposed framework. Code is available at https://github.com/gfmei/conclu.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 5 Feb 2022.
Builds on
19 of 29 references.
References · 19
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2018Multiresolution Tree Networks for 3D Point Cloud Processingcited by 91
- 2019Unsupervised Multi-Task Feature Learning on Point Cloudscited by 89
7 more
- 2020Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Cloudscited by 75
- 2020Self-supervised Learning of Point Clouds via Orientation Estimationcited by 72
- 2020Info3D: Representation Learning on 3D Objects using Mutual Information Maximization and Contrastive Learningcited by 68
- 2019Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds from Multiple Angles by Joint Self-Reconstruction and Half-to-Half Predictioncited by 66
- 2019RL-GAN-Net: A Reinforcement Learning Agent Controlled GAN Network for Real-Time Point Cloud Shape Completioncited by 58
- 2016VConv-DAE: Deep Volumetric Shape Learning Without Object Labelscited by 50
- 2019Geometry Sharing Network for 3D Point Cloud Classification and Segmentationcited by 33
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 0; 2025: 2; 2026: 1.
9 papers.
- 2022CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-trainingcited by 159
- 2023Self-supervised Learning for Pre-Training 3D Point Clouds: A Surveycited by 21
- 2022Rethinking the compositionality of point clouds through regularization in the hyperbolic spacecited by 18
- 2023PointDC:Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-modal Distillation and Super-Voxel Clusteringcited by 15
- 20253D CoCa: Contrastive Learners are 3D Captionerscited by 13
- 2022Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learningcited by 9
- 2023SC3K: Self-supervised and Coherent 3D Keypoints Estimation from Rotated, Noisy, and Decimated Point Cloud Datacited by 9
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligencecited by 3
- 2025PanFoMa: A Lightweight Foundation Model and Benchmark for Pan-Cancercited by 0
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligence10 Jan 2026
- 2025PanFoMa: A Lightweight Foundation Model and Benchmark for Pan-Cancer2 Dec 2025
- 20253D CoCa: Contrastive Learners are 3D Captioners13 Apr 2025
- 2023SC3K: Self-supervised and Coherent 3D Keypoints Estimation from Rotated, Noisy, and Decimated Point Cloud Data10 Aug 2023
- 2023Self-supervised Learning for Pre-Training 3D Point Clouds: A Survey8 May 2023
- 2023PointDC:Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-modal Distillation and Super-Voxel Clustering18 Apr 2023
- 2022Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learning13 Nov 2022
- 2022CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-training3 Oct 2022
- 2022Rethinking the compositionality of point clouds through regularization in the hyperbolic space21 Sep 2022