Teachers in concordance for pseudo-labeling of 3D sequential data
Not on the map. Why?
Abstract (arXiv)
Automatic pseudo-labeling is a powerful tool to tap into large amounts of sequential unlabeled data. It is specially appealing in safety-critical applications of autonomous driving, where performance requirements are extreme, datasets are large, and manual labeling is very challenging. We propose to leverage sequences of point clouds to boost the pseudolabeling technique in a teacher-student setup via training multiple teachers, each with access to different temporal information. This set of teachers, dubbed Concordance, provides higher quality pseudo-labels for student training than standard methods. The output of multiple teachers is combined via a novel pseudo label confidence-guided criterion. Our experimental evaluation focuses on the 3D point cloud domain and urban driving scenarios. We show the performance of our method applied to 3D semantic segmentation and 3D object detection on three benchmark datasets. Our approach, which uses only 20% manual labels, outperforms some fully supervised methods. A notable performance boost is achieved for classes rarely appearing in training data.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 37 of its 55 references that are in the map. First posted on arXiv 13 Jul 2022.
Builds on
37 of 55 references.
References · 37
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
- 2019Similarity-Preserving Knowledge Distillationcited by 516
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
25 more
- 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
- 2019On the Efficacy of Knowledge Distillationcited by 381
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 306
- 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 275
- 2020SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Drivingcited by 226
- 2018Tangent Convolutions for Dense Prediction in 3Dcited by 173
- 2019End-to-End Multi-View Fusion for 3D Object Detection in LiDAR Point Cloudscited by 171
- 2020SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentationcited by 170
- 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2019xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentationcited by 129
- 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 119
- 2019MeteorNet: Deep Learning on Dynamic 3D Point Cloud Sequencescited by 117
- 2021Instant-Teaching: An End-to-End Semi-Supervised Object Detection Frameworkcited by 113
- 2020Cylinder3D: An Effective 3D Framework for Driving-scene LiDAR Semantic Segmentationcited by 112
- 2019SESS: Self-Ensembling Semi-Supervised 3D Object Detectioncited by 89
- 20203DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detectioncited by 89
- 2021Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentationcited by 87
- 2019What You See is What You Get: Exploiting Visibility for 3D Object Detectioncited by 69
- 2020Self-Loop Uncertainty: A Novel Pseudo-Label for Semi-Supervised Medical Image Segmentationcited by 42
- 2019Knowledge Flow: Improve Upon Your Teacherscited by 36
- 2020TORNADO-Net: mulTiview tOtal vaRiatioN semAntic segmentation with Diamond inceptiOn modulecited by 36
- 2021Pseudo-labeling for Scalable 3D Object Detectioncited by 32
- 2018Deep Learning under Privileged Information Using Heteroscedastic Dropoutcited by 27
- 2022Automatic Labeling to Generate Training Data for Online LiDAR-based Moving Object Segmentationcited by 27
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024TrajSSL: Trajectory-Enhanced Semi-Supervised 3D Object Detection
- 2025Knowledge Distillation for Semantic Segmentation: A Label Space Unification Approach
- 2025Learning Adaptive Pseudo-Label Selection for Semi-Supervised 3D Object Detection
- 2025Robust Object Detection with Pseudo Labels from VLMs using Per-Object Co-teaching
- 2025VESPA: Towards un(Human)supervised Open-World Pointcloud Labeling for Autonomous Driving
- 20243D Annotation-Free Learning by Distilling 2D Open-Vocabulary Segmentation Models for Autonomous Driving
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Driving
- 2023LabelFormer: Object Trajectory Refinement for Offboard Perception from LiDAR Point Clouds