mlsanityData to 14 Oct 2026

Self-Distillation for Unsupervised 3D Domain Adaptation

arXiv 2210.08226 ↗First posted 15 Oct 2022cs.CVcited by 12

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

Point cloud classification is a popular task in 3D vision. However, previous works, usually assume that point clouds at test time are obtained with the same procedure or sensor as those at training time. Unsupervised Domain Adaptation (UDA) instead, breaks this assumption and tries to solve the task on an unlabeled target domain, leveraging only on a supervised source domain. For point cloud classification, recent UDA methods try to align features across domains via auxiliary tasks such as point cloud reconstruction, which however do not optimize the discriminative power in the target domain in feature space. In contrast, in this work, we focus on obtaining a discriminative feature space for the target domain enforcing consistency between a point cloud and its augmented version. We then propose a novel iterative self-training methodology that exploits Graph Neural Networks in the UDA context to refine pseudo-labels. We perform extensive experiments and set the new state-of-the-art in standard UDA benchmarks for point cloud classification. Finally, we show how our approach can be extended to more complex tasks such as part segmentation.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 62 of its 79 references that are in the map. First posted on arXiv 15 Oct 2022.

Builds on

62 of 79 references.

References · 62

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2017Graph Attention Networkscited by 8,923
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  9. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  10. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  11. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  12. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
38 more
  1. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  2. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  3. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  4. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  5. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  6. 2017Adversarial Discriminative Domain Adaptationcited by 1,311
  7. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
  8. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
  9. 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,082
  10. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
  11. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
  12. 2018Open3D: A Modern Library for 3D Data Processingcited by 721
  13. 2019Graph Neural Networks for Social Recommendationcited by 714
  14. 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 683
  15. 2016Deep Transfer Learning with Joint Adaptation Networkscited by 612
  16. 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
  17. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  18. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  19. 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 472
  20. 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 443
  21. 2019Confidence Regularized Self-Trainingcited by 419
  22. 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
  23. 2016Unsupervised Domain Adaptation with Residual Transfer Networkscited by 341
  24. 2016Domain Separation Networkscited by 320
  25. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  26. 2019Bidirectional Learning for Domain Adaptation of Semantic Segmentationcited by 308
  27. 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 239
  28. 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 199
  29. 2020Instance Adaptive Self-Training for Unsupervised Domain Adaptationcited by 177
  30. 2020Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentationcited by 153
  31. 2019Domain Adaptation for Semantic Segmentation with Maximum Squares Losscited by 138
  32. 2018DeepInf: Social Influence Prediction with Deep Learningcited by 128
  33. 2017Pointwise Convolutional Neural Networkscited by 127
  34. 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
  35. 2019Grid-GCN for Fast and Scalable Point Cloud Learningcited by 103
  36. 2020Self-Supervised Learning for Domain Adaptation on Point-Cloudscited by 99
  37. 20203DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detectioncited by 89
  38. 2020A Closer Look at Local Aggregation Operators in Point Cloud Analysiscited by 87

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 5; 2025: 5.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Multi-Modal Assistance for Unsupervised Domain Adaptation on Point Cloud 3D Object Detection
  2. 2023T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point Clouds
  3. 2021UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimation
  4. 2022Self-Supervised Learning with Multi-View Rendering for 3D Point Cloud Analysis
  5. 2024Unsupervised Point Cloud Registration with Self-Distillation
  6. 2022Unsupervised Domain Adaptation for Monocular 3D Object Detection via Self-Training
  7. 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation
  8. 2024Multi-Target Unsupervised Domain Adaptation for Semantic Segmentation without External Data