Online Data Curation for Object Detection via Marginal Contributions to Dataset-level Average Precision
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
High-quality data has become a primary driver of progress under scale laws, with curated datasets often outperforming much larger unfiltered ones at lower cost. Online data curation extends this idea by dynamically selecting training samples based on the model's evolving state. While effective in classification and multimodal learning, existing online sampling strategies rarely extend to object detection because of its structural complexity and domain gaps. We introduce DetGain, an online data curation method specifically for object detection that estimates the marginal perturbation of each image to dataset-level Average Precision (AP) based on its prediction quality. By modeling global score distributions, DetGain efficiently estimates the global AP change and computes teacher-student contribution gaps to select informative samples at each iteration. The method is architecture-agnostic and minimally intrusive, enabling straightforward integration into diverse object detection architectures. Experiments on the COCO dataset with multiple representative detectors show consistent improvements in accuracy. DetGain also demonstrates strong robustness under low-quality data and can be effectively combined with knowledge distillation techniques to further enhance performance, highlighting its potential as a general and complementary strategy for data-efficient object detection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 51 of its 63 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
51 of 63 references.
Closest ancestors · 4
Same direction, newest first
- 2023CrossKD: Cross-Head Knowledge Distillation for Object Detection20 Jun
- 2023Active Teacher for Semi-Supervised Object Detection15 Mar
- 2022PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient5 Jul
- 2021Localization Distillation for Dense Object Detection24 Feb
Other references · 47
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
35 more
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
- 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 579
- 2023Textbooks Are All You Needcited by 569
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 540
- 2020Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detectioncited by 409
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 339
- 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
- 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 274
- 2022Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learntcited by 236
- 2020VarifocalNet: An IoU-aware Dense Object Detectorcited by 231
- 2020Coresets via Bilevel Optimization for Continual Learning and Streamingcited by 192
- 2020Contextual Diversity for Active Learningcited by 139
- 2015Online Batch Selection for Faster Training of Neural Networkscited by 122
- 2024Data Shapley in One Training Runcited by 81
- 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
- 2021Multiple instance active learning for object detectioncited by 77
- 2019Prime Sample Attention in Object Detectioncited by 55
- 2022Entropy-based Active Learning for Object Detection with Progressive Diversity Constraintcited by 53
- 2019Ordered SGD: A New Stochastic Optimization Framework for Empirical Risk Minimizationcited by 51
- 2018Localization-Aware Active Learning for Object Detectioncited by 48
- 2019Towards Accurate One-Stage Object Detection with AP-Losscited by 36
- 2024Data curation via joint example selection further accelerates multimodal learningcited by 33
- 2022Plug and Play Active Learning for Object Detectioncited by 28
- 2023Bad Students Make Great Teachers: Active Learning Accelerates Large-Scale Visual Understandingcited by 28
- 2020Choosing the Sample with Lowest Loss makes SGD Robustcited by 26
- 2021Robust and Decomposable Average Precision for Image Retrievalcited by 19
- 2024Active Data Curation Effectively Distills Large-Scale Multimodal Modelscited by 19
- 2024Coreset Selection for Object Detectioncited by 18
- 2023Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillationcited by 10
- 2025Progressive Data Dropout: An Embarrassingly Simple Approach to Faster Trainingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Image compositing is all you need for data augmentation
- 2024Simplifying Source-Free Domain Adaptation for Object Detection: Effective Self-Training Strategies and Performance Insights
- 2022Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning
- 2023Revisiting DETR Pre-training for Object Detection
- 2024OD-DETR: Online Distillation for Stabilizing Training of Detection Transformer
- 2024Long-Tailed Object Detection Pre-training: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction
- 2024ODGEN: Domain-specific Object Detection Data Generation with Diffusion Models
- 2023Periodically Exchange Teacher-Student for Source-Free Object Detection