Exploring Diversity-based Active Learning for 3D Object Detection in Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
3D object detection has recently received much attention due to its great potential in autonomous vehicle (AV). The success of deep learning based object detectors relies on the availability of large-scale annotated datasets, which is time-consuming and expensive to compile, especially for 3D bounding box annotation. In this work, we investigate diversity-based active learning (AL) as a potential solution to alleviate the annotation burden. Given limited annotation budget, only the most informative frames and objects are automatically selected for human to annotate. Technically, we take the advantage of the multimodal information provided in an AV dataset, and propose a novel acquisition function that enforces spatial and temporal diversity in the selected samples. We benchmark the proposed method against other AL strategies under realistic annotation cost measurement, where the realistic costs for annotating a frame and a 3D bounding box are both taken into consideration. We demonstrate the effectiveness of the proposed method on the nuScenes dataset and show that it outperforms existing AL strategies significantly. Code is available at https://github.com/Linkon87/Exploring-Diversity-based-Active-Learning-for-3D-Object-Detection-in-Autonomous-Driving
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 38 of its 69 references that are in the map. First posted on arXiv 16 May 2022.
Builds on
38 of 69 references.
References · 38
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
26 more
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 602
- 2020A Survey of Deep Active Learningcited by 547
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2019Learning Loss for Active Learningcited by 335
- 2019Variational Adversarial Active Learningcited by 284
- 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
- 2020Cold-start Active Learning through Self-supervised Language Modelingcited by 128
- 2019Frustum ConvNet: Sliding Frustums to Aggregate Local Point-Wise Features for Amodal 3D Object Detectioncited by 124
- 2019Consistency-based Semi-supervised Active Learning: Towards Minimizing Labeling Costcited by 114
- 2019Object as Hotspots: An Anchor-Free 3D Object Detection Approach via Firing of Hotspotscited by 84
- 2021Multiple instance active learning for object detectioncited by 77
- 2019Active Learning for Deep Detection Neural Networkscited by 62
- 2022Entropy-based Active Learning for Object Detection with Progressive Diversity Constraintcited by 53
- 2021ReDAL: Region-based and Diversity-aware Active Learning for Point Cloud Semantic Segmentationcited by 52
- 2018Active Learning for Deep Object Detectioncited by 49
- 2018Localization-Aware Active Learning for Object Detectioncited by 48
- 2018CEREALS - Cost-Effective REgion-based Active Learning for Semantic Segmentationcited by 47
- 2019Deep Active Learning for Efficient Training of a LiDAR 3D Object Detectorcited by 45
- 2021Consistency-based Active Learning for Object Detectioncited by 32
- 2017Dropout Inference in Bayesian Neural Networks with Alpha-divergencescited by 28
- 2021TALISMAN: Targeted Active Learning for Object Detection with Rare Classes and Slices using Submodular Mutual Informationcited by 27
- 2017Active Self-Paced Learning for Cost-Effective and Progressive Face Identificationcited by 19
- 2021Label-Efficient Point Cloud Semantic Segmentation: An Active Learning Approachcited by 17
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 7; 2025: 4; 2026: 1.
16 papers.
Sort:
By area:
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2024ActiveAD: Planning-Oriented Active Learning for End-to-End Autonomous Drivingcited by 16
- 2023BaSAL: Size-Balanced Warm Start Active Learning for LiDAR Semantic Segmentationcited by 8
- 2023Deep Kernel Methods Learn Better: From Cards to Process Optimizationcited by 7
- 2024A Unified Approach Towards Active Learning and Out-of-Distribution Detectioncited by 7
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detectioncited by 7
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
- 2023ReBound: An Open-Source 3D Bounding Box Annotation Tool for Active Learningcited by 4
- 2022MUS-CDB: Mixed Uncertainty Sampling with Class Distribution Balancing for Active Annotation in Aerial Object Detectioncited by 3
- 2025To Label or Not to Label: PALM -- A Predictive Model for Evaluating Sample Efficiency in Active Learning Modelscited by 2
4 more
- 2025Inconsistency-based Active Learning for LiDAR Object Detectioncited by 1
- 2025Table Detection with Active Learningcited by 1
- 2026Class-Distribution Guided Active Learning for 3D Occupancy Prediction in Autonomous Drivingcited by 1
- 2024TSceneJAL: Joint Active Learning of Traffic Scenes for 3D Object Detectioncited by 0
- 2026Class-Distribution Guided Active Learning for 3D Occupancy Prediction in Autonomous Driving28 Mar 2026
- 2025Table Detection with Active Learning24 Sep 2025
- 2025To Label or Not to Label: PALM -- A Predictive Model for Evaluating Sample Efficiency in Active Learning Models21 Jul 2025
- 2025Inconsistency-based Active Learning for LiDAR Object Detection1 May 2025
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detection20 Mar 2025
- 2024TSceneJAL: Joint Active Learning of Traffic Scenes for 3D Object Detection25 Dec 2024
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities22 Aug 2024
- 2024A Unified Approach Towards Active Learning and Out-of-Distribution Detection18 May 2024
- 2024ActiveAD: Planning-Oriented Active Learning for End-to-End Autonomous Driving5 Mar 2024
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Sets11 Feb 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration30 Jan 2024
4 more
- 2023BaSAL: Size-Balanced Warm Start Active Learning for LiDAR Semantic Segmentation12 Oct 2023
- 2023Deep Kernel Methods Learn Better: From Cards to Process Optimization25 Mar 2023
- 2023ReBound: An Open-Source 3D Bounding Box Annotation Tool for Active Learning11 Mar 2023
- 2022MUS-CDB: Mixed Uncertainty Sampling with Class Distribution Balancing for Active Annotation in Aerial Object Detection6 Dec 2022
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2023BaSAL: Size-Balanced Warm Start Active Learning for LiDAR Semantic Segmentationcited by 8
- 2023Deep Kernel Methods Learn Better: From Cards to Process Optimizationcited by 7
- 2024A Unified Approach Towards Active Learning and Out-of-Distribution Detectioncited by 7
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detectioncited by 7
- 2023ReBound: An Open-Source 3D Bounding Box Annotation Tool for Active Learningcited by 4
- 2022MUS-CDB: Mixed Uncertainty Sampling with Class Distribution Balancing for Active Annotation in Aerial Object Detectioncited by 3
- 2025To Label or Not to Label: PALM -- A Predictive Model for Evaluating Sample Efficiency in Active Learning Modelscited by 2
- 2025Inconsistency-based Active Learning for LiDAR Object Detectioncited by 1
- 2025Table Detection with Active Learningcited by 1
12 most cited of 14 All 14 (JSON)
- 2026Class-Distribution Guided Active Learning for 3D Occupancy Prediction in Autonomous Driving28 Mar 2026
- 2025Table Detection with Active Learning24 Sep 2025
- 2025To Label or Not to Label: PALM -- A Predictive Model for Evaluating Sample Efficiency in Active Learning Models21 Jul 2025
- 2025Inconsistency-based Active Learning for LiDAR Object Detection1 May 2025
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detection20 Mar 2025
- 2024TSceneJAL: Joint Active Learning of Traffic Scenes for 3D Object Detection25 Dec 2024
- 2024A Unified Approach Towards Active Learning and Out-of-Distribution Detection18 May 2024
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Sets11 Feb 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration30 Jan 2024
- 2023BaSAL: Size-Balanced Warm Start Active Learning for LiDAR Semantic Segmentation12 Oct 2023
- 2023Deep Kernel Methods Learn Better: From Cards to Process Optimization25 Mar 2023
12 newest of 14 All 14 (JSON)