Expanding Low-Density Latent Regions for Open-Set Object Detection
Not on the map. Why?
Abstract (arXiv)
Modern object detectors have achieved impressive progress under the close-set setup. However, open-set object detection (OSOD) remains challenging since objects of unknown categories are often misclassified to existing known classes. In this work, we propose to identify unknown objects by separating high/low-density regions in the latent space, based on the consensus that unknown objects are usually distributed in low-density latent regions. As traditional threshold-based methods only maintain limited low-density regions, which cannot cover all unknown objects, we present a novel Open-set Detector (OpenDet) with expanded low-density regions. To this aim, we equip OpenDet with two learners, Contrastive Feature Learner (CFL) and Unknown Probability Learner (UPL). CFL performs instance-level contrastive learning to encourage compact features of known classes, leaving more low-density regions for unknown classes; UPL optimizes unknown probability based on the uncertainty of predictions, which further divides more low-density regions around the cluster of known classes. Thus, unknown objects in low-density regions can be easily identified with the learned unknown probability. Extensive experiments demonstrate that our method can significantly improve the OSOD performance, e.g., OpenDet reduces the Absolute Open-Set Errors by 25%-35% on six OSOD benchmarks. Code is available at: https://github.com/csuhan/opendet2.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 28 Mar 2022.
Builds on
43 of 55 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
31 more
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Supervised Contrastive Learningcited by 2,803
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2015Towards Open Set Deep Networkscited by 533
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 351
- 2021Towards Open World Object Detectioncited by 297
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 280
- 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2014Towards Open World Recognitioncited by 226
- 2021Parametric Contrastive Learningcited by 217
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021FSCE: Few-Shot Object Detection via Contrastive Proposal Encodingcited by 168
- 2017Generative OpenMax for Multi-Class Open Set Classificationcited by 157
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2019C2AE: Class Conditioned Auto-Encoder for Open-set Recognitioncited by 142
- 2021Contrastive Learning based Hybrid Networks for Long-Tailed Image Classificationcited by 130
- 2021Learning Placeholders for Open-Set Recognitioncited by 121
- 2020Learning Open Set Network with Discriminative Reciprocal Pointscited by 115
- 2017Dropout Sampling for Robust Object Detection in Open-Set Conditionscited by 112
- 2020Conditional Gaussian Distribution Learning for Open Set Recognitioncited by 104
- 2018Evaluating Merging Strategies for Sampling-based Uncertainty Techniques in Object Detectioncited by 51
- 2021Exemplar-Based Open-Set Panoptic Segmentation Networkcited by 37
- 2017Sparse Representation-based Open Set Recognitioncited by 36
- 2020Revisiting One-vs-All Classifiers for Predictive Uncertainty and Out-of-Distribution Detection in Neural Networkscited by 31
Built on by
Citing papers per year: 2022: 5; 2023: 10; 2024: 12; 2025: 5; 2026: 6.
38 papers.
Sort:
By area:
- 2023Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discoverycited by 39
- 2023Contrastive Conditional Latent Diffusion for Audio-visual Segmentationcited by 30
- 2024Open-Set Recognition in the Age of Vision-Language Modelscited by 13
- 2023Activate and Reject: Towards Safe Domain Generalization under Category Shiftcited by 9
- 2022Dual Decision Improves Open-Set Panoptic Segmentationcited by 8
- 2022Towards Generalized Few-Shot Open-Set Object Detectioncited by 8
- 2022Open-Set Object Detection Using Classification-free Object Proposal and Instance-level Contrastive Learningcited by 7
- 2023Unsupervised Recognition of Unknown Objects for Open-World Object Detectioncited by 6
- 2025Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalancecited by 6
- 2023USD: Unknown Sensitive Detector Empowered by Decoupled Objectness and Segment Anything Modelcited by 4
- 2023Rethinking Polyp Segmentation from an Out-of-Distribution Perspectivecited by 4
- 2024Hierarchical Visual Categories Modeling: A Joint Representation Learning and Density Estimation Framework for Out-of-Distribution Detectioncited by 4
26 more
- 2024Open-Vocabulary Object Detection with Meta Prompt Representation and Instance Contrastive Optimizationcited by 3
- 2024Boosting Few-Shot Open-Set Object Detection via Prompt Learning and Robust Decision Boundarycited by 3
- 2025Deep Learning for Sports Video Event Detection: Tasks, Datasets, Methods, and Challengescited by 3
- 2022Tunable Hybrid Proposal Networks for the Open Worldcited by 2
- 2024UADet: A Remarkably Simple Yet Effective Uncertainty-Aware Open-Set Object Detection Frameworkcited by 2
- 2022Rethinking Open-Set Object Detection: Issues, a New Formulation, and Taxonomycited by 1
- 2023Generalized Open-World Semi-Supervised Object Detectioncited by 1
- 2024O1O: Grouping of Known Classes to Identify Unknown Objects as Odd-One-Outcited by 1
- 2024Open-Set Object Detection By Aligning Known Class Representationscited by 1
- 2026DDStereo: Efficient Dual Decoder Transformers for Stereo 3D Road Anomaly Detectioncited by 1
- 2023Online Open-set Semi-supervised Object Detection with Dual Competing Headcited by 0
- 2023Detecting Out-of-distribution Objects Using Neuron Activation Patternscited by 0
- 2023Incremental Object Detection with CLIPcited by 0
- 2024Wasserstein Distance-based Expansion of Low-Density Latent Regions for Unknown Class Detectioncited by 0
- 2024YOLOOC: YOLO-based Open-Class Incremental Object Detection with Novel Class Discoverycited by 0
- 2024OSR-ViT: A Simple and Modular Framework for Open-Set Object Detection and Discoverycited by 0
- 2024Class-balanced Open-set Semi-supervised Object Detection for Medical Imagescited by 0
- 2024Collaborative Feature-Logits Contrastive Learning for Open-Set Semi-Supervised Object Detectioncited by 0
- 2025FindMeIfYouCan: Bringing Open Set metrics to textitnear , textitfar and textitfarther Out-of-Distribution Object Detectioncited by 0
- 2025Adapt, But Don't Forget: Fine-Tuning and Contrastive Routing for Lane Detection under Distribution Shiftcited by 0
- 2025Three-Way Open-Set Detection for Robust Autonomous Navigationcited by 0
- 2026OOVDet: Low-Density Prior Learning for Zero-Shot Out-of-Vocabulary Object Detectioncited by 0
- 2026Towards Adaptive Open-Set Object Detection via Category-Level Collaboration Knowledge Miningcited by 0
- 2026Beyond Known Objects: A Novel Framework for Open-Set Object Detection using Negative-Aware Normcited by 0
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videoscited by 0
- 2026WALDO: One-Shot Exemplar-Conditioned Object Detection in Cluttered Scenescited by 0
- 2026WALDO: One-Shot Exemplar-Conditioned Object Detection in Cluttered Scenes28 Aug 2026
- 2026DDStereo: Efficient Dual Decoder Transformers for Stereo 3D Road Anomaly Detection23 Jun 2026
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos15 Jun 2026
- 2026Beyond Known Objects: A Novel Framework for Open-Set Object Detection using Negative-Aware Norm4 May 2026
- 2026Towards Adaptive Open-Set Object Detection via Category-Level Collaboration Knowledge Mining13 Apr 2026
- 2026OOVDet: Low-Density Prior Learning for Zero-Shot Out-of-Vocabulary Object Detection30 Jan 2026
- 2025Three-Way Open-Set Detection for Robust Autonomous Navigation19 Nov 2025
- 2025Adapt, But Don't Forget: Fine-Tuning and Contrastive Routing for Lane Detection under Distribution Shift22 Jul 2025
- 2025FindMeIfYouCan: Bringing Open Set metrics to textitnear , textitfar and textitfarther Out-of-Distribution Object Detection16 Jun 2025
- 2025Deep Learning for Sports Video Event Detection: Tasks, Datasets, Methods, and Challenges6 May 2025
- 2025Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance28 Feb 2025
- 2024Open-Set Object Detection By Aligning Known Class Representations30 Dec 2024
26 more
- 2024UADet: A Remarkably Simple Yet Effective Uncertainty-Aware Open-Set Object Detection Framework12 Dec 2024
- 2024Collaborative Feature-Logits Contrastive Learning for Open-Set Semi-Supervised Object Detection20 Nov 2024
- 2024O1O: Grouping of Known Classes to Identify Unknown Objects as Odd-One-Out10 Oct 2024
- 2024Hierarchical Visual Categories Modeling: A Joint Representation Learning and Density Estimation Framework for Out-of-Distribution Detection28 Aug 2024
- 2024Class-balanced Open-set Semi-supervised Object Detection for Medical Images22 Aug 2024
- 2024Boosting Few-Shot Open-Set Object Detection via Prompt Learning and Robust Decision Boundary26 Jun 2024
- 2024OSR-ViT: A Simple and Modular Framework for Open-Set Object Detection and Discovery16 Apr 2024
- 2024YOLOOC: YOLO-based Open-Class Incremental Object Detection with Novel Class Discovery30 Mar 2024
- 2024Open-Set Recognition in the Age of Vision-Language Models25 Mar 2024
- 2024Open-Vocabulary Object Detection with Meta Prompt Representation and Instance Contrastive Optimization14 Mar 2024
- 2024Wasserstein Distance-based Expansion of Low-Density Latent Regions for Unknown Class Detection10 Jan 2024
- 2023Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discovery30 Oct 2023
- 2023Incremental Object Detection with CLIP13 Oct 2023
- 2023Activate and Reject: Towards Safe Domain Generalization under Category Shift7 Oct 2023
- 2023Unsupervised Recognition of Unknown Objects for Open-World Object Detection31 Aug 2023
- 2023Contrastive Conditional Latent Diffusion for Audio-visual Segmentation31 Jul 2023
- 2023Detecting Out-of-distribution Objects Using Neuron Activation Patterns31 Jul 2023
- 2023Generalized Open-World Semi-Supervised Object Detection28 Jul 2023
- 2023Rethinking Polyp Segmentation from an Out-of-Distribution Perspective13 Jun 2023
- 2023USD: Unknown Sensitive Detector Empowered by Decoupled Objectness and Segment Anything Model4 Jun 2023
- 2023Online Open-set Semi-supervised Object Detection with Dual Competing Head23 May 2023
- 2022Open-Set Object Detection Using Classification-free Object Proposal and Instance-level Contrastive Learning21 Nov 2022
- 2022Towards Generalized Few-Shot Open-Set Object Detection28 Oct 2022
- 2022Tunable Hybrid Proposal Networks for the Open World23 Aug 2022
- 2022Rethinking Open-Set Object Detection: Issues, a New Formulation, and Taxonomy20 Jul 2022
- 2022Dual Decision Improves Open-Set Panoptic Segmentation6 Jul 2022
- 2024Open-Set Recognition in the Age of Vision-Language Modelscited by 13
- 2024Open-Set Recognition in the Age of Vision-Language Models25 Mar 2024
- 2023Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discoverycited by 39
- 2023Activate and Reject: Towards Safe Domain Generalization under Category Shiftcited by 9
- 2022Dual Decision Improves Open-Set Panoptic Segmentationcited by 8
- 2022Towards Generalized Few-Shot Open-Set Object Detectioncited by 8
- 2022Open-Set Object Detection Using Classification-free Object Proposal and Instance-level Contrastive Learningcited by 7
- 2023Unsupervised Recognition of Unknown Objects for Open-World Object Detectioncited by 6
- 2025Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalancecited by 6
- 2023USD: Unknown Sensitive Detector Empowered by Decoupled Objectness and Segment Anything Modelcited by 4
- 2023Rethinking Polyp Segmentation from an Out-of-Distribution Perspectivecited by 4
- 2024Hierarchical Visual Categories Modeling: A Joint Representation Learning and Density Estimation Framework for Out-of-Distribution Detectioncited by 4
- 2024Open-Vocabulary Object Detection with Meta Prompt Representation and Instance Contrastive Optimizationcited by 3
- 2024Boosting Few-Shot Open-Set Object Detection via Prompt Learning and Robust Decision Boundarycited by 3
12 most cited of 35 All 35 (JSON)
- 2026DDStereo: Efficient Dual Decoder Transformers for Stereo 3D Road Anomaly Detection23 Jun 2026
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos15 Jun 2026
- 2026Beyond Known Objects: A Novel Framework for Open-Set Object Detection using Negative-Aware Norm4 May 2026
- 2026Towards Adaptive Open-Set Object Detection via Category-Level Collaboration Knowledge Mining13 Apr 2026
- 2026OOVDet: Low-Density Prior Learning for Zero-Shot Out-of-Vocabulary Object Detection30 Jan 2026
- 2025Three-Way Open-Set Detection for Robust Autonomous Navigation19 Nov 2025
- 2025Adapt, But Don't Forget: Fine-Tuning and Contrastive Routing for Lane Detection under Distribution Shift22 Jul 2025
- 2025FindMeIfYouCan: Bringing Open Set metrics to textitnear , textitfar and textitfarther Out-of-Distribution Object Detection16 Jun 2025
- 2025Deep Learning for Sports Video Event Detection: Tasks, Datasets, Methods, and Challenges6 May 2025
- 2025Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance28 Feb 2025
- 2024Open-Set Object Detection By Aligning Known Class Representations30 Dec 2024
- 2024UADet: A Remarkably Simple Yet Effective Uncertainty-Aware Open-Set Object Detection Framework12 Dec 2024
12 newest of 35 All 35 (JSON)