Open-Set Semi-Supervised Object Detection
Not on the map. Why?
Abstract (arXiv)
Recent developments for Semi-Supervised Object Detection (SSOD) have shown the promise of leveraging unlabeled data to improve an object detector. However, thus far these methods have assumed that the unlabeled data does not contain out-of-distribution (OOD) classes, which is unrealistic with larger-scale unlabeled datasets. In this paper, we consider a more practical yet challenging problem, Open-Set Semi-Supervised Object Detection (OSSOD). We first find the existing SSOD method obtains a lower performance gain in open-set conditions, and this is caused by the semantic expansion, where the distracting OOD objects are mispredicted as in-distribution pseudo-labels for the semi-supervised training. To address this problem, we consider online and offline OOD detection modules, which are integrated with SSOD methods. With the extensive studies, we found that leveraging an offline OOD detector based on a self-supervised vision transformer performs favorably against online OOD detectors due to its robustness to the interference of pseudo-labeling. In the experiment, our proposed framework effectively addresses the semantic expansion issue and shows consistent improvements on many OSSOD benchmarks, including large-scale COCO-OpenImages. We also verify the effectiveness of our framework under different OSSOD conditions, including varying numbers of in-distribution classes, different degrees of supervision, and different combinations of unlabeled sets.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 50 of its 58 references that are in the map. First posted on arXiv 29 Aug 2022.
Builds on
50 of 58 references.
References · 50
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
38 more
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
- 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 569
- 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 472
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2020Open-Vocabulary Object Detection Using Captionscited by 427
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 316
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 306
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2021Towards Open World Object Detectioncited by 297
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2020A Simple Semi-Supervised Learning Framework for Object Detectioncited by 282
- 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2018MixUp as Locally Linear Out-Of-Manifold Regularizationcited by 158
- 2021Humble Teachers Teach Better Students for Semi-Supervised Object Detectioncited by 116
- 2021Instant-Teaching: An End-to-End Semi-Supervised Object Detection Frameworkcited by 113
- 2021Learning Open-World Object Proposals without Learning to Classifycited by 109
- 2018Generative Probabilistic Novelty Detection with Adversarial Autoencoderscited by 99
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2020Multi-Task Curriculum Framework for Open-Set Semi-Supervised Learningcited by 82
- 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
- 2020Proposal Learning for Semi-Supervised Object Detectioncited by 55
- 2021OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outlierscited by 43
- 2019Soft Anchor-Point Object Detectioncited by 42
- 2021Trash to Treasure: Harvesting OOD Data with Cross-Modal Matching for Open-Set Semi-Supervised Learningcited by 40
- 2021Learning to Detect Every Thing in an Open Worldcited by 37
- 2021Uncertainty for Identifying Open-Set Errors in Visual Object Detectioncited by 26
- 2021An Effective Baseline for Robustness to Distributional Shiftcited by 25
- 2021A Geometric Perspective towards Neural Calibration via Sensitivity Decompositioncited by 19
Built on by
Citing papers per year: 2023: 9; 2024: 5; 2025: 2; 2026: 1.
17 papers.
Sort:
By area:
- 2023OtterHD: A High-Resolution Multi-modality Modelcited by 72
- 2024AIDE: An Automatic Data Engine for Object Detection in Autonomous Drivingcited by 26
- 2023Label-Efficient Learning in Agriculture: A Comprehensive Reviewcited by 16
- 2024Open-Set Recognition in the Age of Vision-Language Modelscited by 13
- 2023RoPAWS: Robust Semi-supervised Representation Learning from Uncurated Datacited by 10
- 2023Unsupervised Recognition of Unknown Objects for Open-World Object Detectioncited by 6
- 2023Semi-supervised Object Detection: A Survey on Recent Research and Progresscited by 5
- 2025Distracted Robot: How Visual Clutter Undermine Robotic Manipulationcited by 5
- 2023Semi-Supervised Object Detection with Uncurated Unlabeled Data for Remote Sensing Imagescited by 4
- 2024Semi-Supervised Object Detection: A Survey on Progress from CNN to Transformercited by 4
- 2025Improving Robotic Manipulation Robustness via NICE Scene Surgerycited by 3
- 2023Open-World Weakly-Supervised Object Localizationcited by 2
5 more
- 2023Generalized Open-World Semi-Supervised Object Detectioncited by 1
- 2023Online Open-set Semi-supervised Object Detection with Dual Competing Headcited by 0
- 2024Multimodal-Enhanced Objectness Learner for Corner Case Detection in Autonomous Drivingcited by 0
- 2024Class-balanced Open-set Semi-supervised Object Detection for Medical Imagescited by 0
- 2026HMR-Net: Hierarchical Modular Routing for Cross-Domain Object Detection in Aerial Imagescited by 0
- 2026HMR-Net: Hierarchical Modular Routing for Cross-Domain Object Detection in Aerial Images20 Apr 2026
- 2025Distracted Robot: How Visual Clutter Undermine Robotic Manipulation27 Nov 2025
- 2025Improving Robotic Manipulation Robustness via NICE Scene Surgery27 Nov 2025
- 2024Class-balanced Open-set Semi-supervised Object Detection for Medical Images22 Aug 2024
- 2024Semi-Supervised Object Detection: A Survey on Progress from CNN to Transformer11 Jul 2024
- 2024AIDE: An Automatic Data Engine for Object Detection in Autonomous Driving26 Mar 2024
- 2024Open-Set Recognition in the Age of Vision-Language Models25 Mar 2024
- 2024Multimodal-Enhanced Objectness Learner for Corner Case Detection in Autonomous Driving3 Feb 2024
- 2023OtterHD: A High-Resolution Multi-modality Model7 Nov 2023
- 2023Semi-Supervised Object Detection with Uncurated Unlabeled Data for Remote Sensing Images9 Oct 2023
- 2023Unsupervised Recognition of Unknown Objects for Open-World Object Detection31 Aug 2023
- 2023Generalized Open-World Semi-Supervised Object Detection28 Jul 2023
5 more
- 2023Semi-supervised Object Detection: A Survey on Recent Research and Progress25 Jun 2023
- 2023Label-Efficient Learning in Agriculture: A Comprehensive Review24 May 2023
- 2023Online Open-set Semi-supervised Object Detection with Dual Competing Head23 May 2023
- 2023Open-World Weakly-Supervised Object Localization17 Apr 2023
- 2023RoPAWS: Robust Semi-supervised Representation Learning from Uncurated Data28 Feb 2023
- 2024Open-Set Recognition in the Age of Vision-Language Modelscited by 13
- 2024Open-Set Recognition in the Age of Vision-Language Models25 Mar 2024
- 2023OtterHD: A High-Resolution Multi-modality Modelcited by 72
- 2023Label-Efficient Learning in Agriculture: A Comprehensive Reviewcited by 16
- 2023RoPAWS: Robust Semi-supervised Representation Learning from Uncurated Datacited by 10
- 2023Unsupervised Recognition of Unknown Objects for Open-World Object Detectioncited by 6
- 2023Semi-supervised Object Detection: A Survey on Recent Research and Progresscited by 5
- 2025Distracted Robot: How Visual Clutter Undermine Robotic Manipulationcited by 5
- 2023Semi-Supervised Object Detection with Uncurated Unlabeled Data for Remote Sensing Imagescited by 4
- 2024Semi-Supervised Object Detection: A Survey on Progress from CNN to Transformercited by 4
- 2025Improving Robotic Manipulation Robustness via NICE Scene Surgerycited by 3
- 2023Open-World Weakly-Supervised Object Localizationcited by 2
- 2023Generalized Open-World Semi-Supervised Object Detectioncited by 1
- 2023Online Open-set Semi-supervised Object Detection with Dual Competing Headcited by 0
12 most cited of 15 All 15 (JSON)
- 2026HMR-Net: Hierarchical Modular Routing for Cross-Domain Object Detection in Aerial Images20 Apr 2026
- 2025Distracted Robot: How Visual Clutter Undermine Robotic Manipulation27 Nov 2025
- 2025Improving Robotic Manipulation Robustness via NICE Scene Surgery27 Nov 2025
- 2024Class-balanced Open-set Semi-supervised Object Detection for Medical Images22 Aug 2024
- 2024Semi-Supervised Object Detection: A Survey on Progress from CNN to Transformer11 Jul 2024
- 2024Multimodal-Enhanced Objectness Learner for Corner Case Detection in Autonomous Driving3 Feb 2024
- 2023OtterHD: A High-Resolution Multi-modality Model7 Nov 2023
- 2023Semi-Supervised Object Detection with Uncurated Unlabeled Data for Remote Sensing Images9 Oct 2023
- 2023Unsupervised Recognition of Unknown Objects for Open-World Object Detection31 Aug 2023
- 2023Generalized Open-World Semi-Supervised Object Detection28 Jul 2023
- 2023Semi-supervised Object Detection: A Survey on Recent Research and Progress25 Jun 2023
- 2023Label-Efficient Learning in Agriculture: A Comprehensive Review24 May 2023
12 newest of 15 All 15 (JSON)