Self-Distillation for Unsupervised 3D Domain Adaptation
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
Point cloud classification is a popular task in 3D vision. However, previous works, usually assume that point clouds at test time are obtained with the same procedure or sensor as those at training time. Unsupervised Domain Adaptation (UDA) instead, breaks this assumption and tries to solve the task on an unlabeled target domain, leveraging only on a supervised source domain. For point cloud classification, recent UDA methods try to align features across domains via auxiliary tasks such as point cloud reconstruction, which however do not optimize the discriminative power in the target domain in feature space. In contrast, in this work, we focus on obtaining a discriminative feature space for the target domain enforcing consistency between a point cloud and its augmented version. We then propose a novel iterative self-training methodology that exploits Graph Neural Networks in the UDA context to refine pseudo-labels. We perform extensive experiments and set the new state-of-the-art in standard UDA benchmarks for point cloud classification. Finally, we show how our approach can be extended to more complex tasks such as part segmentation.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 62 of its 79 references that are in the map. First posted on arXiv 15 Oct 2022.
Builds on
62 of 79 references.
References · 62
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Graph Attention Networkscited by 8,923
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
38 more
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2017Adversarial Discriminative Domain Adaptationcited by 1,311
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,082
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2019Graph Neural Networks for Social Recommendationcited by 714
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 683
- 2016Deep Transfer Learning with Joint Adaptation Networkscited by 612
- 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
- 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 472
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 443
- 2019Confidence Regularized Self-Trainingcited by 419
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2016Unsupervised Domain Adaptation with Residual Transfer Networkscited by 341
- 2016Domain Separation Networkscited by 320
- 2018Session-based Recommendation with Graph Neural Networkscited by 312
- 2019Bidirectional Learning for Domain Adaptation of Semantic Segmentationcited by 308
- 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 239
- 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 199
- 2020Instance Adaptive Self-Training for Unsupervised Domain Adaptationcited by 177
- 2020Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentationcited by 153
- 2019Domain Adaptation for Semantic Segmentation with Maximum Squares Losscited by 138
- 2018DeepInf: Social Influence Prediction with Deep Learningcited by 128
- 2017Pointwise Convolutional Neural Networkscited by 127
- 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
- 2019Grid-GCN for Fast and Scalable Point Cloud Learningcited by 103
- 2020Self-Supervised Learning for Domain Adaptation on Point-Cloudscited by 99
- 20203DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detectioncited by 89
- 2020A Closer Look at Local Aggregation Operators in Point Cloud Analysiscited by 87
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 5.
12 papers.
- 2024Backpropagation-free Network for 3D Test-time Adaptationcited by 14
- 2024Adapting Fine-Grained Cross-View Localization to Areas without Fine Ground Truthcited by 14
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformationcited by 11
- 2025Rotation-Adaptive Point Cloud Domain Generalization via Intricate Orientation Learningcited by 5
- 2023Progressive Classifier and Feature Extractor Adaptation for Unsupervised Domain Adaptation on Point Cloudscited by 2
- 2023Towards Generalized Multi-stage Clustering: Multi-view Self-distillationcited by 0
- 2024Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformerscited by 0
- 2024Curvature Diversity-Driven Deformation and Domain Alignment for Point Cloudcited by 0
- 2025Locating and Mitigating Gradient Conflicts in Point Cloud Domain Adaptation via Saliency Map Skewnesscited by 0
- 2025Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognitioncited by 0
- 2025Asymmetric Dual Self-Distillation for 3D Self-Supervised Representation Learningcited by 0
- 2025ALDI-ray: Adapting the ALDI Framework for Security X-ray Object Detectioncited by 0
- 2025ALDI-ray: Adapting the ALDI Framework for Security X-ray Object Detection2 Dec 2025
- 2025Asymmetric Dual Self-Distillation for 3D Self-Supervised Representation Learning26 Jun 2025
- 2025Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition26 Jun 2025
- 2025Locating and Mitigating Gradient Conflicts in Point Cloud Domain Adaptation via Saliency Map Skewness22 Apr 2025
- 2025Rotation-Adaptive Point Cloud Domain Generalization via Intricate Orientation Learning4 Feb 2025
- 2024Curvature Diversity-Driven Deformation and Domain Alignment for Point Cloud3 Oct 2024
- 2024Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformers26 Jul 2024
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformation23 Jul 2024
- 2024Adapting Fine-Grained Cross-View Localization to Areas without Fine Ground Truth1 Jun 2024
- 2024Backpropagation-free Network for 3D Test-time Adaptation27 Mar 2024
- 2023Progressive Classifier and Feature Extractor Adaptation for Unsupervised Domain Adaptation on Point Clouds27 Nov 2023
- 2023Towards Generalized Multi-stage Clustering: Multi-view Self-distillation29 Oct 2023
Similar, not cited
Close in wording, no citation either way
- 2025Multi-Modal Assistance for Unsupervised Domain Adaptation on Point Cloud 3D Object Detection
- 2023T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point Clouds
- 2021UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimation
- 2022Self-Supervised Learning with Multi-View Rendering for 3D Point Cloud Analysis
- 2024Unsupervised Point Cloud Registration with Self-Distillation
- 2022Unsupervised Domain Adaptation for Monocular 3D Object Detection via Self-Training
- 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation
- 2024Multi-Target Unsupervised Domain Adaptation for Semantic Segmentation without External Data