LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose the LiDAR Distillation to bridge the domain gap induced by different LiDAR beams for 3D object detection. In many real-world applications, the LiDAR points used by mass-produced robots and vehicles usually have fewer beams than that in large-scale public datasets. Moreover, as the LiDARs are upgraded to other product models with different beam amount, it becomes challenging to utilize the labeled data captured by previous versions' high-resolution sensors. Despite the recent progress on domain adaptive 3D detection, most methods struggle to eliminate the beam-induced domain gap. We find that it is essential to align the point cloud density of the source domain with that of the target domain during the training process. Inspired by this discovery, we propose a progressive framework to mitigate the beam-induced domain shift. In each iteration, we first generate low-beam pseudo LiDAR by downsampling the high-beam point clouds. Then the teacher-student framework is employed to distill rich information from the data with more beams. Extensive experiments on Waymo, nuScenes and KITTI datasets with three different LiDAR-based detectors demonstrate the effectiveness of our LiDAR Distillation. Notably, our approach does not increase any additional computation cost for inference.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 47 of its 59 references that are in the map. First posted on arXiv 28 Mar 2022.
Builds on
47 of 59 references.
References · 47
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
35 more
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2019Similarity-Preserving Knowledge Distillationcited by 507
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 442
- 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 409
- 2019From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Networkcited by 366
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2019A Comprehensive Overhaul of Feature Distillationcited by 341
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 2018Strong-Weak Distribution Alignment for Adaptive Object Detectioncited by 269
- 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 231
- 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
- 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
- 2019Distilling Object Detectors with Fine-grained Feature Imitationcited by 188
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
- 2017Asymmetric Tri-training for Unsupervised Domain Adaptationcited by 152
- 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
- 2018Large scale distributed neural network training through online distillationcited by 144
- 2020Exploring Categorical Regularization for Domain Adaptive Object Detectioncited by 130
- 2019xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentationcited by 129
- 2020Harmonizing Transferability and Discriminability for Adapting Object Detectorscited by 125
- 2020Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Cloudscited by 116
- 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
- 2021Distilling Object Detectors via Decoupled Featurescited by 105
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 93
- 2020Cross-domain Object Detection through Coarse-to-Fine Feature Adaptationcited by 82
- 2021Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistencycited by 63
- 2020Spatial Attention Pyramid Network for Unsupervised Domain Adaptationcited by 56
- 2020SF-UDA3D: Source-Free Unsupervised Domain Adaptation for LiDAR-Based 3D Object Detectioncited by 25
- 2018Quantization Mimic: Towards Very Tiny CNN for Object Detectioncited by 20
- 2021Uncertainty-aware Mean Teacher for Source-free Unsupervised Domain Adaptive 3D Object Detectioncited by 18
- 2017Unsupervised Domain Adaptation for 3D Keypoint Estimation via View Consistencycited by 14
- 2021Attentive Prototypes for Source-free Unsupervised Domain Adaptive 3D Object Detectioncited by 13
Built on by
Citing papers per year: 2022: 3; 2023: 18; 2024: 23; 2025: 7; 2026: 3.
54 papers.
Sort:
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2023Uni3D: A Unified Baseline for Multi-dataset 3D Object Detectioncited by 39
- 2023Density-Insensitive Unsupervised Domain Adaption on 3D Object Detectioncited by 31
- 2023X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detectioncited by 28
- 2023Revisiting Domain-Adaptive 3D Object Detection by Reliable, Diverse and Class-balanced Pseudo-Labelingcited by 28
- 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillationcited by 27
- 2024Is Your LiDAR Placement Optimized for 3D Scene Understanding?cited by 25
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentationcited by 24
- 2023Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detectioncited by 21
- 2023SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptationcited by 21
- 2023AD-PT: Autonomous Driving Pre-Training with Large-scale Point Cloud Datasetcited by 21
38 more
- 2023A Survey of Label-Efficient Deep Learning for 3D Point Cloudscited by 20
- 2023Benchmarking the Robustness of LiDAR Semantic Segmentation Modelscited by 18
- 2023MS3D++: Ensemble of Experts for Multi-Source Unsupervised Domain Adaptation in 3D Object Detectioncited by 14
- 2024Event-guided Low-light Video Semantic Segmentationcited by 14
- 2023ReSimAD: Zero-Shot 3D Domain Transfer for Autonomous Driving with Source Reconstruction and Target Simulationcited by 13
- 2024Unified Domain Generalization and Adaptation for Multi-View 3D Object Detectioncited by 13
- 2023MS3D: Leveraging Multiple Detectors for Unsupervised Domain Adaptation in 3D Object Detectioncited by 12
- 2024CrackNex: a Few-shot Low-light Crack Segmentation Model Based on Retinex Theory for UAV Inspectionscited by 12
- 2024UADA3D: Unsupervised Adversarial Domain Adaptation for 3D Object Detection with Sparse LiDAR and Large Domain Gapscited by 12
- 2024PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud Understandingcited by 11
- 2022Viewer-Centred Surface Completion for Unsupervised Domain Adaptation in 3D Object Detectioncited by 10
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domainscited by 10
- 2023GeoAdapt: Self-Supervised Test-Time Adaptation in LiDAR Place Recognition Using Geometric Priorscited by 8
- 2022Paint and Distill: Boosting 3D Object Detection with Semantic Passing Networkcited by 7
- 2023Rethinking LiDAR Domain Generalization: Single Source as Multiple Density Domainscited by 7
- 2024Density-guided Translator Boosts Synthetic-to-Real Unsupervised Domain Adaptive Segmentation of 3D Point Cloudscited by 7
- 2024Pseudo Label Refinery for Unsupervised Domain Adaptation on Cross-dataset 3D Object Detectioncited by 7
- 2023Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detectioncited by 6
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detectioncited by 6
- 2024STAL3D: Unsupervised Domain Adaptation for 3D Object Detection via Collaborating Self-Training and Adversarial Learningcited by 6
- 2024Segment, Lift and Fit: Automatic 3D Shape Labeling from 2D Promptscited by 6
- 2023Offline-to-Online Knowledge Distillation for Video Instance Segmentationcited by 5
- 2022SAILOR: Scaling Anchors via Insights into Latent Object Representationcited by 4
- 2024Detect Closer Surfaces that can be Seen: New Modeling and Evaluation in Cross-domain 3D Object Detectioncited by 4
- 2024Learning 3D Perception from Others' Predictionscited by 4
- 2024DALI: Domain Adaptive LiDAR Object Detection via Distribution-level and Instance-level Pseudo Label Denoisingcited by 4
- 2024LEROjD: Lidar Extended Radar-Only Object Detectioncited by 3
- 2024Uni2Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detectioncited by 3
- 2025Reflectance Prediction-based Knowledge Distillation for Robust 3D Object Detection in Compressed Point Cloudscited by 3
- 2024Revisiting Cross-Domain Problem for LiDAR-based 3D Object Detectioncited by 2
- 2025GBlobs: Explicit Local Structure via Gaussian Blobs for Improved Cross-Domain LiDAR-based 3D Object Detectioncited by 2
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shiftcited by 2
- 2023Semantic Segmentation on 3D Point Clouds with High Density Variationscited by 1
- 2024Semi-Supervised Domain Adaptation Using Target-Oriented Domain Augmentation for 3D Object Detectioncited by 1
- 2025Improving Generalization Ability for 3D Object Detection by Learning Sparsity-invariant Featurescited by 1
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perceptioncited by 1
- 2024Finetuning Pre-trained Model with Limited Data for LiDAR-based 3D Object Detection by Bridging Domain Gapscited by 0
- 2025An Investigation of Beam Density on LiDAR Object Detection Performancecited by 0
50 most cited of 54 All 54 (JSON)
- 2026CARE: Camera-Residual Reserves for First Sightings in Adaptive LiDAR Sensing25 Aug 2026
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception30 Jun 2026
- 2026x2-Fusion: Cross-Modality and Cross-Dimension Flow Estimation in Event Edge Space17 Mar 2026
- 2025IMKD: Intensity-Aware Multi-Level Knowledge Distillation for Camera-Radar Fusion17 Dec 2025
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shift21 Nov 2025
- 2025Reflectance Prediction-based Knowledge Distillation for Robust 3D Object Detection in Compressed Point Clouds23 May 2025
- 2025CornerPoint3D: Look at the Nearest Corner Instead of the Center3 Apr 2025
- 2025An Investigation of Beam Density on LiDAR Object Detection Performance19 Mar 2025
- 2025GBlobs: Explicit Local Structure via Gaussian Blobs for Improved Cross-Domain LiDAR-based 3D Object Detection11 Mar 2025
- 2025Improving Generalization Ability for 3D Object Detection by Learning Sparsity-invariant Features4 Feb 2025
- 2024DALI: Domain Adaptive LiDAR Object Detection via Distribution-level and Instance-level Pseudo Label Denoising11 Dec 2024
- 2024Event-guided Low-light Video Semantic Segmentation1 Nov 2024
38 more
- 2024PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud Understanding1 Nov 2024
- 2024Unified Domain Generalization and Adaptation for Multi-View 3D Object Detection29 Oct 2024
- 2024Learning 3D Perception from Others' Predictions3 Oct 2024
- 2024Finetuning Pre-trained Model with Limited Data for LiDAR-based 3D Object Detection by Bridging Domain Gaps2 Oct 2024
- 2024Uni2Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detection30 Sep 2024
- 2024LEROjD: Lidar Extended Radar-Only Object Detection9 Sep 2024
- 2024Revisiting Cross-Domain Problem for LiDAR-based 3D Object Detection22 Aug 2024
- 2024Segment, Lift and Fit: Automatic 3D Shape Labeling from 2D Prompts16 Jul 2024
- 2024Detect Closer Surfaces that can be Seen: New Modeling and Evaluation in Cross-domain 3D Object Detection4 Jul 2024
- 2024STAL3D: Unsupervised Domain Adaptation for 3D Object Detection via Collaborating Self-Training and Adversarial Learning27 Jun 2024
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detection21 Jun 2024
- 2024Semi-Supervised Domain Adaptation Using Target-Oriented Domain Augmentation for 3D Object Detection17 Jun 2024
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentation2 May 2024
- 2024Pseudo Label Refinery for Unsupervised Domain Adaptation on Cross-dataset 3D Object Detection30 Apr 2024
- 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillation28 Mar 2024
- 2024Density-guided Translator Boosts Synthetic-to-Real Unsupervised Domain Adaptive Segmentation of 3D Point Clouds27 Mar 2024
- 2024UADA3D: Unsupervised Adversarial Domain Adaptation for 3D Object Detection with Sparse LiDAR and Large Domain Gaps26 Mar 2024
- 2024Is Your LiDAR Placement Optimized for 3D Scene Understanding?25 Mar 2024
- 2024CrackNex: a Few-shot Low-light Crack Segmentation Model Based on Retinex Theory for UAV Inspections5 Mar 2024
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domains27 Feb 2024
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlook2 Jan 2024
- 2023Rethinking LiDAR Domain Generalization: Single Source as Multiple Density Domains19 Dec 2023
- 2023ReSimAD: Zero-Shot 3D Domain Transfer for Autonomous Driving with Source Reconstruction and Target Simulation11 Sep 2023
- 2023MS3D++: Ensemble of Experts for Multi-Source Unsupervised Domain Adaptation in 3D Object Detection11 Aug 2023
- 2023GeoAdapt: Self-Supervised Test-Time Adaptation in LiDAR Place Recognition Using Geometric Priors9 Aug 2023
- 2023Revisiting Domain-Adaptive 3D Object Detection by Reliable, Diverse and Class-balanced Pseudo-Labeling16 Jul 2023
- 2023Semantic Segmentation on 3D Point Clouds with High Density Variations4 Jul 2023
- 2023Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detection4 Jul 2023
- 2023AD-PT: Autonomous Driving Pre-Training with Large-scale Point Cloud Dataset1 Jun 2023
- 2023A Survey of Label-Efficient Deep Learning for 3D Point Clouds31 May 2023
- 2023Density-Insensitive Unsupervised Domain Adaption on 3D Object Detection19 Apr 2023
- 2023SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptation6 Apr 2023
- 2023MS3D: Leveraging Multiple Detectors for Unsupervised Domain Adaptation in 3D Object Detection5 Apr 2023
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptions30 Mar 2023
- 2023Uni3D: A Unified Baseline for Multi-dataset 3D Object Detection13 Mar 2023
- 2023Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detection10 Mar 2023
- 2023X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection3 Mar 2023
- 2023Offline-to-Online Knowledge Distillation for Video Instance Segmentation15 Feb 2023
50 newest of 54 All 54 (JSON)
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2023Uni3D: A Unified Baseline for Multi-dataset 3D Object Detectioncited by 39
- 2023Density-Insensitive Unsupervised Domain Adaption on 3D Object Detectioncited by 31
- 2023X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detectioncited by 28
- 2023Revisiting Domain-Adaptive 3D Object Detection by Reliable, Diverse and Class-balanced Pseudo-Labelingcited by 28
- 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillationcited by 27
- 2024Is Your LiDAR Placement Optimized for 3D Scene Understanding?cited by 25
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentationcited by 24
- 2023Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detectioncited by 21
- 2023SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptationcited by 21
- 2023AD-PT: Autonomous Driving Pre-Training with Large-scale Point Cloud Datasetcited by 21
12 most cited of 54 All 54 (JSON)
- 2026CARE: Camera-Residual Reserves for First Sightings in Adaptive LiDAR Sensing25 Aug 2026
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception30 Jun 2026
- 2026x2-Fusion: Cross-Modality and Cross-Dimension Flow Estimation in Event Edge Space17 Mar 2026
- 2025IMKD: Intensity-Aware Multi-Level Knowledge Distillation for Camera-Radar Fusion17 Dec 2025
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shift21 Nov 2025
- 2025Reflectance Prediction-based Knowledge Distillation for Robust 3D Object Detection in Compressed Point Clouds23 May 2025
- 2025CornerPoint3D: Look at the Nearest Corner Instead of the Center3 Apr 2025
- 2025An Investigation of Beam Density on LiDAR Object Detection Performance19 Mar 2025
- 2025GBlobs: Explicit Local Structure via Gaussian Blobs for Improved Cross-Domain LiDAR-based 3D Object Detection11 Mar 2025
- 2025Improving Generalization Ability for 3D Object Detection by Learning Sparsity-invariant Features4 Feb 2025
- 2024DALI: Domain Adaptive LiDAR Object Detection via Distribution-level and Instance-level Pseudo Label Denoising11 Dec 2024
- 2024Event-guided Low-light Video Semantic Segmentation1 Nov 2024
12 newest of 54 All 54 (JSON)