Adaptive Self-Training for Object Detection
Not on the map. Why?
Abstract (arXiv)
Deep learning has emerged as an effective solution for solving the task of object detection in images but at the cost of requiring large labeled datasets. To mitigate this cost, semi-supervised object detection methods, which consist in leveraging abundant unlabeled data, have been proposed and have already shown impressive results. However, most of these methods require linking a pseudo-label to a ground-truth object by thresholding. In previous works, this threshold value is usually determined empirically, which is time consuming, and only done for a single data distribution. When the domain, and thus the data distribution, changes, a new and costly parameter search is necessary. In this work, we introduce our method Adaptive Self-Training for Object Detection (ASTOD), which is a simple yet effective teacher-student method. ASTOD determines without cost a threshold value based directly on the ground value of the score histogram. To improve the quality of the teacher predictions, we also propose a novel pseudo-labeling procedure. We use different views of the unlabeled images during the pseudo-labeling step to reduce the number of missed predictions and thus obtain better candidate labels. Our teacher and our student are trained separately, and our method can be used in an iterative fashion by replacing the teacher by the student. On the MS-COCO dataset, our method consistently performs favorably against state-of-the-art methods that do not require a threshold parameter, and shows competitive results with methods that require a parameter sweep search. Additional experiments with respect to a supervised baseline on the DIOR dataset containing satellite images lead to similar conclusions, and prove that it is possible to adapt the score threshold automatically in self-training, regardless of the data distribution. The code is available at https:// github.com/rvandeghen/ASTOD
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 7 Dec 2022.
Builds on
28 of 38 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2020Meta Pseudo Labelscited by 372
- 2020Rethinking Pre-training and Self-trainingcited by 352
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
16 more
- 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
- 2020A Simple Semi-Supervised Learning Framework for Object Detectioncited by 282
- 2014Learning with Pseudo-Ensemblescited by 241
- 2021Humble Teachers Teach Better Students for Semi-Supervised Object Detectioncited by 115
- 2021Instant-Teaching: An End-to-End Semi-Supervised Object Detection Frameworkcited by 112
- 2019Adversarially Robust Generalization Just Requires More Unlabeled Datacited by 75
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectorscited by 69
- 2022PseCo: Pseudo Labeling and Consistency Training for Semi-Supervised Object Detectioncited by 51
- 2020Improving Object Detection with Selective Self-supervised Self-trainingcited by 35
- 2021Semi-Supervised Object Detection with Adaptive Class-Rebalancing Self-Trainingcited by 28
- 2022Omni-DETR: Omni-Supervised Object Detection with Transformerscited by 28
- 2022Semi-Supervised Training to Improve Player and Ball Detection in Soccercited by 25
- 2021MUM : Mix Image Tiles and UnMix Feature Tiles for Semi-Supervised Object Detectioncited by 21
- 2022Non-iterative optimization of pseudo-labeling thresholds for training object detection models from multiple datasetscited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 1.
4 papers.
- 2023SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformerscited by 49
- 2024Enhancing Source-Free Domain Adaptive Object Detection with Low-confidence Pseudo Label Distillationcited by 14
- 2023Revisiting DETR Pre-training for Object Detectioncited by 5
- 2023Rethinking Scale Imbalance in Semi-supervised Object Detection for Aerial Imagescited by 0
- 2024Enhancing Source-Free Domain Adaptive Object Detection with Low-confidence Pseudo Label Distillation18 Jul 2024
- 2023SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformers1 Dec 2023
- 2023Rethinking Scale Imbalance in Semi-supervised Object Detection for Aerial Images23 Oct 2023
- 2023Revisiting DETR Pre-training for Object Detection2 Aug 2023