KECOR: Kernel Coding Rate Maximization for Active 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
Achieving a reliable LiDAR-based object detector in autonomous driving is paramount, but its success hinges on obtaining large amounts of precise 3D annotations. Active learning (AL) seeks to mitigate the annotation burden through algorithms that use fewer labels and can attain performance comparable to fully supervised learning. Although AL has shown promise, current approaches prioritize the selection of unlabeled point clouds with high uncertainty and/or diversity, leading to the selection of more instances for labeling and reduced computational efficiency. In this paper, we resort to a novel kernel coding rate maximization (KECOR) strategy which aims to identify the most informative point clouds to acquire labels through the lens of information theory. Greedy search is applied to seek desired point clouds that can maximize the minimal number of bits required to encode the latent features. To determine the uniqueness and informativeness of the selected samples from the model perspective, we construct a proxy network of the 3D detector head and compute the outer product of Jacobians from all proxy layers to form the empirical neural tangent kernel (NTK) matrix. To accommodate both one-stage (i.e., SECOND) and two-stage detectors (i.e., PVRCNN), we further incorporate the classification entropy maximization and well trade-off between detection performance and the total number of bounding boxes selected for annotation. Extensive experiments conducted on two 3D benchmarks and a 2D detection dataset evidence the superiority and versatility of the proposed approach. Our results show that approximately 44% box-level annotation costs and 26% computational time are reduced compared to the state-of-the-art AL method, without compromising detection performance.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 43 of its 78 references that are in the map. First posted on arXiv 16 Jul 2023.
Builds on
43 of 78 references.
References · 43
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 602
- 2020A Survey of Deep Active Learningcited by 547
- 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 428
31 more
- 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 409
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2019Learning Loss for Active Learningcited by 335
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 2020Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reductioncited by 141
- 2020Contextual Diversity for Active Learningcited by 139
- 2021Batch Active Learning at Scalecited by 127
- 2022Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection from Point Cloudscited by 102
- 2022PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detectioncited by 99
- 2021Gone Fishing: Neural Active Learning with Fisher Embeddingscited by 88
- 2019Harnessing the Power of Infinitely Wide Deep Nets on Small-data Taskscited by 87
- 2020Task-Aware Variational Adversarial Active Learningcited by 84
- 2021Influence Selection for Active Learningcited by 82
- 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
- 2021Multiple instance active learning for object detectioncited by 77
- 2019BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectorscited by 68
- 2022Active Learning by Feature Mixingcited by 63
- 2022Fast Finite Width Neural Tangent Kernelcited by 62
- 2022Entropy-based Active Learning for Object Detection with Progressive Diversity Constraintcited by 53
- 2018Localization-Aware Active Learning for Object Detectioncited by 48
- 2022VISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attentioncited by 48
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 47
- 2019Deep Active Learning for Efficient Training of a LiDAR 3D Object Detectorcited by 45
- 2021Frustratingly Easy Transferability Estimationcited by 44
- 2022Self-Supervised Learning via Maximum Entropy Codingcited by 33
- 2021Consistency-based Active Learning for Object Detectioncited by 32
- 2023Exploring Active 3D Object Detection from a Generalization Perspectivecited by 26
- 2022Making Look-Ahead Active Learning Strategies Feasible with Neural Tangent Kernelscited by 25
- 2015Hierarchical Subquery Evaluation for Active Learning on a Graphcited by 21
- 2022OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Datacited by 13
- 2020PAL : Pretext-based Active Learningcited by 9
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 6.
13 papers.
Sort:
By area:
- 2024Find n' Propagate: Open-Vocabulary 3D Object Detection in Urban Environmentscited by 21
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detectioncited by 7
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detectioncited by 6
- 2025Generalizable Prompt Learning of CLIP: A Brief Overviewcited by 3
- 2025IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detectioncited by 2
- 2024Distribution Discrepancy and Feature Heterogeneity for Active 3D Object Detectioncited by 1
- 2024STONE: A Submodular Optimization Framework for Active 3D Object Detectioncited by 1
- 2025SCORE: Soft Label Compression-Centric Dataset Condensation via Coding Rate Optimizationcited by 1
- 2025CodeMerge: Codebook-Guided Model Merging for Robust Test-Time Adaptation in Autonomous Drivingcited by 1
- 2023Open-CRB: Towards Open World Active Learning for 3D Object Detectioncited by 0
1 more
- 2025IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detection24 Nov 2025
- 2025CodeMerge: Codebook-Guided Model Merging for Robust Test-Time Adaptation in Autonomous Driving22 May 2025
- 2025HeAL3D: Heuristical-enhanced Active Learning for 3D Object Detection1 May 2025
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detection20 Mar 2025
- 2025SCORE: Soft Label Compression-Centric Dataset Condensation via Coding Rate Optimization18 Mar 2025
- 2025Generalizable Prompt Learning of CLIP: A Brief Overview3 Mar 2025
- 2024STONE: A Submodular Optimization Framework for Active 3D Object Detection4 Oct 2024
- 2024Distribution Discrepancy and Feature Heterogeneity for Active 3D Object Detection9 Sep 2024
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detection21 Jun 2024
- 2024Find n' Propagate: Open-Vocabulary 3D Object Detection in Urban Environments20 Mar 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration30 Jan 2024
1 more
- 2025Generalizable Prompt Learning of CLIP: A Brief Overviewcited by 3
- 2025Generalizable Prompt Learning of CLIP: A Brief Overview3 Mar 2025
- 2024Find n' Propagate: Open-Vocabulary 3D Object Detection in Urban Environmentscited by 21
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detectioncited by 7
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detectioncited by 6
- 2025IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detectioncited by 2
- 2024Distribution Discrepancy and Feature Heterogeneity for Active 3D Object Detectioncited by 1
- 2024STONE: A Submodular Optimization Framework for Active 3D Object Detectioncited by 1
- 2025SCORE: Soft Label Compression-Centric Dataset Condensation via Coding Rate Optimizationcited by 1
- 2023Open-CRB: Towards Open World Active Learning for 3D Object Detectioncited by 0
- 2025HeAL3D: Heuristical-enhanced Active Learning for 3D Object Detectioncited by 0
- 2025IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detection24 Nov 2025
- 2025HeAL3D: Heuristical-enhanced Active Learning for 3D Object Detection1 May 2025
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detection20 Mar 2025
- 2025SCORE: Soft Label Compression-Centric Dataset Condensation via Coding Rate Optimization18 Mar 2025
- 2024STONE: A Submodular Optimization Framework for Active 3D Object Detection4 Oct 2024
- 2024Distribution Discrepancy and Feature Heterogeneity for Active 3D Object Detection9 Sep 2024
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detection21 Jun 2024
- 2024Find n' Propagate: Open-Vocabulary 3D Object Detection in Urban Environments20 Mar 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration30 Jan 2024
- 2023Open-CRB: Towards Open World Active Learning for 3D Object Detection16 Oct 2023