CLR-GAM: Contrastive Point Cloud Learning with Guided Augmentation and Feature Mapping
Not on the map. Why?
Abstract (arXiv)
Point cloud data plays an essential role in robotics and self-driving applications. Yet, annotating point cloud data is time-consuming and nontrivial while they enable learning discriminative 3D representations that empower downstream tasks, such as classification and segmentation. Recently, contrastive learning-based frameworks have shown promising results for learning 3D representations in a self-supervised manner. However, existing contrastive learning methods cannot precisely encode and associate structural features and search the higher dimensional augmentation space efficiently. In this paper, we present CLR-GAM, a novel contrastive learning-based framework with Guided Augmentation (GA) for efficient dynamic exploration strategy and Guided Feature Mapping (GFM) for similar structural feature association between augmented point clouds. We empirically demonstrate that the proposed approach achieves state-of-the-art performance on both simulated and real-world 3D point cloud datasets for three different downstream tasks, i.e., 3D point cloud classification, few-shot learning, and object part segmentation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 63 references that are in the map. First posted on arXiv 28 Feb 2023.
Builds on
42 of 63 references.
References · 42
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2016Unifying Count-Based Exploration and Intrinsic Motivationcited by 632
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
30 more
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2017Count-Based Exploration with Neural Density Modelscited by 255
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2018SO-Net: Self-Organizing Network for Point Cloud Analysiscited by 210
- 2020Never Give Up: Learning Directed Exploration Strategiescited by 210
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2015Action-Conditional Video Prediction using Deep Networks in Atari Gamescited by 171
- 2015Incentivizing Exploration In Reinforcement Learning With Deep Predictive Modelscited by 154
- 20183D Point Capsule Networkscited by 106
- 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
- 2018Multiresolution Tree Networks for 3D Point Cloud Processingcited by 91
- 2019Unsupervised Multi-Task Feature Learning on Point Cloudscited by 89
- 2020Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Cloudscited by 75
- 2020Self-supervised Learning of Point Clouds via Orientation Estimationcited by 72
- 2020Info3D: Representation Learning on 3D Objects using Mutual Information Maximization and Contrastive Learningcited by 68
- 2019Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds from Multiple Angles by Joint Self-Reconstruction and Half-to-Half Predictioncited by 66
- 2020Self-Supervised Few-Shot Learning on Point Cloudscited by 66
- 2021Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learningcited by 52
- 2021Improving Contrastive Learning by Visualizing Feature Transformationcited by 44
- 2018View Inter-Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Learning Global Shape Memories to Support Local View Predictionscited by 43
- 2016MoCap-guided Data Augmentation for 3D Pose Estimation in the Wildcited by 37
- 2018Learning to Play with Intrinsically-Motivated Self-Aware Agentscited by 34
- 2015Dreaming More Data: Class-dependent Distributions over Diffeomorphisms for Learned Data Augmentationcited by 24
- 2021Progressive Seed Generation Auto-encoder for Unsupervised Point Cloud Learningcited by 12
- 2016AGA: Attribute Guided Augmentationcited by 10
- 2016A data augmentation methodology for training machine/deep learning gait recognition algorithmscited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.