Active Learning for Deep Object Detection via Probabilistic Modeling
Not on the map. Why?
Abstract (arXiv)
Active learning aims to reduce labeling costs by selecting only the most informative samples on a dataset. Few existing works have addressed active learning for object detection. Most of these methods are based on multiple models or are straightforward extensions of classification methods, hence estimate an image's informativeness using only the classification head. In this paper, we propose a novel deep active learning approach for object detection. Our approach relies on mixture density networks that estimate a probabilistic distribution for each localization and classification head's output. We explicitly estimate the aleatoric and epistemic uncertainty in a single forward pass of a single model. Our method uses a scoring function that aggregates these two types of uncertainties for both heads to obtain every image's informativeness score. We demonstrate the efficacy of our approach in PASCAL VOC and MS-COCO datasets. Our approach outperforms single-model based methods and performs on par with multi-model based methods at a fraction of the computing cost.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). Builds on 30 of its 41 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
30 of 41 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Fast R-CNNcited by 2,930
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
18 more
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 428
- 2019Learning Loss for Active Learningcited by 335
- 2019Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Drivingcited by 105
- 2018Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detectioncited by 82
- 2019BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectorscited by 68
- 2019Active Learning for Deep Detection Neural Networkscited by 62
- 2020Scalable Active Learning for Object Detectioncited by 58
- 2018Localization-Aware Active Learning for Object Detectioncited by 48
- 2019Deep Active Learning for Efficient Training of a LiDAR 3D Object Detectorcited by 45
- 2019Mixture Dense Regression for Object Detection and Human Pose Estimationcited by 29
- 2017Uncertainty-Aware Learning from Demonstration using Mixture Density Networks with Sampling-Free Variance Modelingcited by 25
- 2018Large-Scale Visual Active Learning with Deep Probabilistic Ensemblescited by 13
- 2016Very Efficient Training of Convolutional Neural Networks using Fast Fourier Transform and Overlap-and-Addcited by 7
- 2018Task Agnostic Robust Learning on Corrupt Outputs by Correlation-Guided Mixture Density Networkscited by 4
- 2019Training Data Subset Search with Ensemble Active Learningcited by 3
- 2019Deep Mixture Density Network for Probabilistic Object Detectioncited by 2
Built on by
Citing papers per year: 2021: 5; 2022: 18; 2023: 21; 2024: 15; 2025: 11; 2026: 9.
79 papers.
Sort:
By area:
- 2022A Comparative Survey of Deep Active Learningcited by 88
- 2022Entropy-based Active Learning for Object Detection with Progressive Diversity Constraintcited by 53
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 48
- 2023Unbiased Scene Graph Generation in Videoscited by 38
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 32
- 2022Plug and Play Active Learning for Object Detectioncited by 28
- 2021Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detectioncited by 27
- 2023Exploring Active 3D Object Detection from a Generalization Perspectivecited by 26
- 2023Streaming Active Learning with Deep Neural Networkscited by 20
- 2022Improving the Intra-class Long-tail in 3D Detection via Rare Example Miningcited by 19
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibrationcited by 19
- 2022Active Learning Strategies for Weakly-supervised Object Detectioncited by 17
38 more
- 2022Semantic Segmentation with Active Semi-Supervised Learningcited by 16
- 2022Active Pointly-Supervised Instance Segmentationcited by 15
- 2022Optical Flow Training under Limited Label Budget via Active Learningcited by 14
- 2023Box-Level Active Detectioncited by 13
- 2023KECOR: Kernel Coding Rate Maximization for Active 3D Object Detectioncited by 13
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learningcited by 10
- 2023Towards Free Data Selection with General-Purpose Modelscited by 10
- 2023One step closer to unbiased aleatoric uncertainty estimationcited by 10
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenescited by 9
- 2023Multi-Task Consistency for Active Learningcited by 9
- 2021Bayesian Active Learning for Sim-to-Real Robotic Perceptioncited by 8
- 2023ALWOD: Active Learning for Weakly-Supervised Object Detectioncited by 8
- 2022Deep Active Learning for Computer Vision: Past and Futurecited by 7
- 2024SSE: Multimodal Semantic Data Selection and Enrichment for Industrial-scale Data Assimilationcited by 7
- 2021Towards General and Efficient Active Learningcited by 6
- 2022ALBench: A Framework for Evaluating Active Learning in Object Detectioncited by 6
- 2025Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detectioncited by 6
- 2024Uncertainty Estimation for 3D Object Detection via Evidential Learningcited by 5
- 2024VLMine: Long-Tail Data Mining with Vision Language Modelscited by 4
- 2024Structural-Entropy-Based Sample Selection for Efficient and Effective Learningcited by 4
- 2022Bucketized Active Sampling for Learning ACOPFcited by 3
- 2022Towards Rapid Prototyping and Comparability in Active Learning for Deep Object Detectioncited by 3
- 2023Assessing Domain Gap for Continual Domain Adaptation in Object Detectioncited by 3
- 2023Active Learning for Object Detection with Non-Redundant Informative Samplingcited by 3
- 2024Cost-Sensitive Uncertainty-Based Failure Recognition for Object Detectioncited by 3
- 2025OmViD: Omni-supervised active learning for video action detectioncited by 3
- 2022MIME: Minority Inclusion for Majority Group Enhancement of AI Performancecited by 2
- 2022Query-based Hard-Image Retrieval for Object Detection at Test Timecited by 2
- 2022Pixel is All You Need: Adversarial Trajectory-Ensemble Active Learning for Salient Object Detectioncited by 2
- 2023Deep Active Learning with Noisy Oracle in Object Detectioncited by 2
- 2024Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learningcited by 2
- 2025Active Learning via Vision-Language Model Adaptation with Open Datacited by 2
- 2025Streamlining the Development of Active Learning Methods in Real-World Object Detectioncited by 2
- 2022Virtual Reality via Object Pose Estimation and Active Learning: Realizing Telepresence Robots with Aerial Manipulation Capabilitiescited by 1
- 2022Evaluating Zero-cost Active Learning for Object Detectioncited by 1
- 2023Classification Committee for Active Deep Object Detectioncited by 1
- 2023DeLR: Active Learning for Detection with Decoupled Localization and Recognition Querycited by 1
- 2024Deep Active Learning: A Reality Checkcited by 1
50 most cited of 79 All 79 (JSON)
- 2026From internal representations to model improvement through prediction errors28 Sep 2026
- 2026FuDU: A Fuzzy Dual-dimensional Uncertainty Framework for Streaming Active Learning in Industrial Defect Detection2 Sep 2026
- 2026Cost-efficient Active Learning for Referring Image Segmentation and Grounding31 Aug 2026
- 2026Distance to Class Prototypes: Active Learning for Object Detection28 Jul 2026
- 2026Balancing Uncertainty and Diversity of Samples: Leveraging Diversity of Least, High Confidence Samples for Effective Active Learning21 May 2026
- 2026From Model Uncertainty to Human Attention: Localization-Aware Visual Cues for Scalable Annotation Review12 May 2026
- 2026Portable Active Learning for Object Detection11 May 2026
- 2026Probabilistic Object Detection with Conformal Prediction8 May 2026
- 2026Frequency-guided Multi-level Reasoning for Scene Graph Generation in Video19 Apr 2026
- 2025Where to Measure: Epistemic Uncertainty-Based Sensor Placement with ConvCNPs27 Nov 2025
- 2025Online Data Curation for Object Detection via Marginal Contributions to Dataset-level Average Precision18 Nov 2025
- 2025Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection25 Sep 2025
38 more
- 2025Table Detection with Active Learning24 Sep 2025
- 2025Streamlining the Development of Active Learning Methods in Real-World Object Detection27 Aug 2025
- 2025OmViD: Omni-supervised active learning for video action detection19 Aug 2025
- 2025Optimizing Active Learning in Vision-Language Models via Parameter-Efficient Uncertainty Calibration29 Jul 2025
- 2025Active Learning via Vision-Language Model Adaptation with Open Data2 Jun 2025
- 2025Inconsistency-based Active Learning for LiDAR Object Detection1 May 2025
- 2025HeAL3D: Heuristical-enhanced Active Learning for 3D Object Detection1 May 2025
- 2025Breaking the SSL-AL Barrier: A Synergistic Semi-Supervised Active Learning Framework for 3D Object Detection26 Jan 2025
- 2024TSceneJAL: Joint Active Learning of Traffic Scenes for 3D Object Detection25 Dec 2024
- 2024Uncertainty Estimation for 3D Object Detection via Evidential Learning31 Oct 2024
- 2024STONE: A Submodular Optimization Framework for Active 3D Object Detection4 Oct 2024
- 2024Structural-Entropy-Based Sample Selection for Efficient and Effective Learning3 Oct 2024
- 2024VLMine: Long-Tail Data Mining with Vision Language Models23 Sep 2024
- 2024SSE: Multimodal Semantic Data Selection and Enrichment for Industrial-scale Data Assimilation20 Sep 2024
- 2024Distribution Discrepancy and Feature Heterogeneity for Active 3D Object Detection9 Sep 2024
- 2024Prediction Accuracy & Reliability: Classification and Object Localization under Distribution Shift5 Sep 2024
- 2024UTrack: Multi-Object Tracking with Uncertain Detections30 Aug 2024
- 2024MILAN: Milli-Annotations for Lidar Semantic Segmentation22 Jul 2024
- 2024Uncertainty Quantification in Table Structure Recognition1 Jul 2024
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach24 May 2024
- 2024Cost-Sensitive Uncertainty-Based Failure Recognition for Object Detection26 Apr 2024
- 2024Deep Active Learning: A Reality Check21 Mar 2024
- 2024Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning5 Mar 2024
- 2023DeLR: Active Learning for Detection with Decoupled Localization and Recognition Query28 Dec 2023
- 2023One step closer to unbiased aleatoric uncertainty estimation16 Dec 2023
- 2023A comprehensive survey on deep active learning in medical image analysis22 Oct 2023
- 2023Open-CRB: Towards Open World Active Learning for 3D Object Detection16 Oct 2023
- 2023Deep Active Learning with Noisy Oracle in Object Detection30 Sep 2023
- 2023Towards Free Data Selection with General-Purpose Models29 Sep 2023
- 2023Two-Step Active Learning for Instance Segmentation with Uncertainty and Diversity Sampling28 Sep 2023
- 2023ALWOD: Active Learning for Weakly-Supervised Object Detection14 Sep 2023
- 2023Classification Committee for Active Deep Object Detection16 Aug 2023
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learning17 Jul 2023
- 2023Active Learning for Object Detection with Non-Redundant Informative Sampling17 Jul 2023
- 2023KECOR: Kernel Coding Rate Maximization for Active 3D Object Detection16 Jul 2023
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibration3 Jul 2023
- 2023Multi-Task Consistency for Active Learning21 Jun 2023
- 2023Unbiased Scene Graph Generation in Videos3 Apr 2023
50 newest of 79 All 79 (JSON)
- 2022A Comparative Survey of Deep Active Learningcited by 88
- 2022Entropy-based Active Learning for Object Detection with Progressive Diversity Constraintcited by 53
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 48
- 2023Unbiased Scene Graph Generation in Videoscited by 38
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 32
- 2022Plug and Play Active Learning for Object Detectioncited by 28
- 2021Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detectioncited by 27
- 2023Exploring Active 3D Object Detection from a Generalization Perspectivecited by 26
- 2023Streaming Active Learning with Deep Neural Networkscited by 20
- 2022Improving the Intra-class Long-tail in 3D Detection via Rare Example Miningcited by 19
- 2023Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibrationcited by 19
- 2022Active Learning Strategies for Weakly-supervised Object Detectioncited by 17
12 most cited of 76 All 76 (JSON)
- 2026From internal representations to model improvement through prediction errors28 Sep 2026
- 2026FuDU: A Fuzzy Dual-dimensional Uncertainty Framework for Streaming Active Learning in Industrial Defect Detection2 Sep 2026
- 2026Cost-efficient Active Learning for Referring Image Segmentation and Grounding31 Aug 2026
- 2026Distance to Class Prototypes: Active Learning for Object Detection28 Jul 2026
- 2026Balancing Uncertainty and Diversity of Samples: Leveraging Diversity of Least, High Confidence Samples for Effective Active Learning21 May 2026
- 2026From Model Uncertainty to Human Attention: Localization-Aware Visual Cues for Scalable Annotation Review12 May 2026
- 2026Portable Active Learning for Object Detection11 May 2026
- 2026Probabilistic Object Detection with Conformal Prediction8 May 2026
- 2026Frequency-guided Multi-level Reasoning for Scene Graph Generation in Video19 Apr 2026
- 2025Where to Measure: Epistemic Uncertainty-Based Sensor Placement with ConvCNPs27 Nov 2025
- 2025Online Data Curation for Object Detection via Marginal Contributions to Dataset-level Average Precision18 Nov 2025
- 2025Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection25 Sep 2025
12 newest of 76 All 76 (JSON)