Learning Confidence for Out-of-Distribution Detection in Neural Networks
Not on the map. Why?
Abstract (arXiv)
Modern neural networks are very powerful predictive models, but they are often incapable of recognizing when their predictions may be wrong. Closely related to this is the task of out-of-distribution detection, where a network must determine whether or not an input is outside of the set on which it is expected to safely perform. To jointly address these issues, we propose a method of learning confidence estimates for neural networks that is simple to implement and produces intuitively interpretable outputs. We demonstrate that on the task of out-of-distribution detection, our technique surpasses recently proposed techniques which construct confidence based on the network's output distribution, without requiring any additional labels or access to out-of-distribution examples. Additionally, we address the problem of calibrating out-of-distribution detectors, where we demonstrate that misclassified in-distribution examples can be used as a proxy for out-of-distribution examples.
Key facts. Cited by 245 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 53; 2022: 55; 2023: 49; 2024: 39; 2025: 30; 2026: 19.
245 papers.
Sort:
By area:
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 256
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 216
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
- 2022How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?cited by 128
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
38 more
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 93
- 2021Soft Calibration Objectives for Neural Networkscited by 92
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Modelscited by 87
- 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
- 2024API Is Enough: Conformal Prediction for Large Language Models Without Logit-Accesscited by 69
- 2023Energy-based Out-of-Distribution Detection for Graph Neural Networkscited by 68
- 2022RbA: Segmenting Unknown Regions Rejected by Allcited by 67
- 2024Negative Label Guided OOD Detection with Pretrained Vision-Language Modelscited by 66
- 2022The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generationcited by 60
- 2021Hierarchical VAEs Know What They Don't Knowcited by 58
- 2021DOCTOR: A Simple Method for Detecting Misclassification Errorscited by 53
- 2022A Call to Reflect on Evaluation Practices for Failure Detection in Image Classificationcited by 52
- 2022A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibrationcited by 49
- 2023Fast Decision Boundary based Out-of-Distribution Detectorcited by 49
- 2021DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimationcited by 48
- 2021OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outlierscited by 43
- 2021Neural Mean Discrepancy for Efficient Out-of-Distribution Detectioncited by 42
- 2022DenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognitioncited by 42
- 2023NECO: NEural Collapse Based Out-of-distribution detectioncited by 42
- 2021Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentationcited by 40
- 2022Expanding Low-Density Latent Regions for Open-Set Object Detectioncited by 38
- 2023Trainable Projected Gradient Method for Robust Fine-tuningcited by 37
- 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systemscited by 37
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2021SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detectioncited by 34
- 2023LINe: Out-of-Distribution Detection by Leveraging Important Neuronscited by 34
- 2023Detecting Out-of-Distribution Through the Lens of Neural Collapsecited by 34
- 2024Outlier detection by ensembling uncertainty with negative objectnesscited by 34
- 2021Teaching Humans When To Defer to a Classifier via Exemplarscited by 29
- 2022Watermarking for Out-of-distribution Detectioncited by 28
- 2023Neuron Activation Coverage: Rethinking Out-of-distribution Detection and Generalizationcited by 28
- 2021Corner Cases for Visual Perception in Automated Driving: Some Guidance on Detection Approachescited by 27
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 25
- 2023Selective Knowledge Sharing for Privacy-Preserving Federated Distillation without A Good Teachercited by 25
- 2024Open-World Semantic Segmentation Including Class Similaritycited by 24
- 2022Few-shot Learning with Noisy Labelscited by 23
50 most cited of 245 All 245 (JSON)
- 2026FailSAE: Towards Interpretable Failure Prediction for Vision-Language Models via Sparse Autoencoders2 Sep 2026
- 2026Detecting Pose Estimation Failures via Keypoint Self-Consistency4 Aug 2026
- 2026Uncertainty quantification for trustworthy deep learning: Methods and measures30 Jul 2026
- 2026Exploiting Local Flatness for Efficient Out-of-Distribution Detection29 Jun 2026
- 2026Modality-Aware Out-of-Distribution Detection for Multi-Modal Action Recognition23 Jun 2026
- 2026Trust-Aware Predictive Emissions Monitoring for Gas Turbine Fleets with Limited Labelled Data4 Jun 2026
- 2026Dual Feature Decoupling for Fine-Grained OOD Detection4 Jun 2026
- 2026Knowing when to trust machine-learned interatomic potentials1 May 2026
- 2026Rethinking Uncertainty in Segmentation: From Estimation to Decision14 Apr 2026
- 2026A Clinical Point Cloud Paradigm for In-Hospital Mortality Prediction from Multi-Level Incomplete Multimodal EHRs6 Apr 2026
- 2026A deep learning pipeline for PAM50 subtype classification using histopathology images and multi-objective patch selection2 Apr 2026
- 2026Bounding Box Anomaly Scoring for simple and efficient Out-of-Distribution detection24 Mar 2026
38 more
- 2026Shaping Parameter Contribution Patterns for Out-of-Distribution Detection7 Mar 2026
- 2026How to Achieve Prototypical Birth and Death for OOD Detection?6 Mar 2026
- 2026Confidence-Uncertainty Boundary Calibration for Bayesian Deep Learning in Medical Image Analysis12 Feb 2026
- 2026Vendi Novelty Scores for Out-of-Distribution Detection10 Feb 2026
- 2026COMBOOD: A Semiparametric Approach for Detecting Out-of-distribution Data for Image Classification4 Feb 2026
- 2026JAF: Judge Agent Forest29 Jan 2026
- 2026Cognitive Fusion of ZC Sequences and Time-Frequency Images for Out-of-Distribution Detection of Drone Signals26 Jan 2026
- 2025Adjudicator: Correcting Noisy Labels with a KG-Informed Council of LLM Agents5 Dec 2025
- 2025RankOOD -- Class Ranking-based Out-of-Distribution Detection25 Nov 2025
- 2025BootOOD: Self-Supervised Out-of-Distribution Detection via Synthetic Sample Exposure under Neural Collapse17 Nov 2025
- 2025A Systematic Analysis of Out-of-Distribution Detection Under Representation and Training Paradigm Shifts14 Nov 2025
- 2025Out-of-Distribution Detection for Safety Assurance of AI and Autonomous Systems24 Oct 2025
- 2025GOOD: Training-Free Guided Diffusion Sampling for Out-of-Distribution Detection20 Oct 2025
- 2025Local Background Features Matter in Out-of-Distribution Detection14 Oct 2025
- 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detection7 Oct 2025
- 2025An Empirical Analysis of VLM-based OOD Detection: Mechanisms, Advantages, and Sensitivity16 Sep 2025
- 2025Pseudo-D: Informing Multi-View Uncertainty Estimation with Calibrated Neural Training Dynamics15 Sep 2025
- 2025How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy12 Aug 2025
- 2025Uncertainty-Aware Segmentation Quality Prediction via Deep Learning Bayesian Modeling: Comprehensive Evaluation and Interpretation on Skin Cancer and Liver Segmentation2 Aug 2025
- 2025Knowledge Regularized Negative Feature Tuning of Vision-Language Models for Out-of-Distribution Detection26 Jul 2025
- 2025Spurious-Aware Prototype Refinement for Reliable Out-of-Distribution Detection30 Jun 2025
- 2025An Information-Theoretic Framework for Feature Construction in Out-of-Distribution Detection17 Jun 2025
- 2025Improving Out-of-Distribution Detection via Dynamic Covariance Calibration11 Jun 2025
- 2025DIsoN: Decentralized Isolation Networks for Out-of-Distribution Detection in Medical Imaging10 Jun 2025
- 2025Enhancing Abnormality Identification: Robust Out-of-Distribution Strategies for Deepfake Detection3 Jun 2025
- 2025To Trust Or Not To Trust Your Vision-Language Model's Prediction29 May 2025
- 2025TULiP: Test-time Uncertainty Estimation via Linearization and Weight Perturbation22 May 2025
- 2025ASAT: Adaptive Scoring and Thresholding with Human Feedback for Robust Out-of-Distribution Detection5 May 2025
- 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attribution19 Apr 2025
- 2025STOOD-X methodology: using statistical nonparametric test for OOD Detection Large-Scale datasets enhanced with explainability3 Apr 2025
- 2025Evaluating ASR Confidence Scores for Automated Error Detection in User-Assisted Correction Interfaces19 Mar 2025
- 2025AdaSCALE: Adaptive Scaling for OOD Detection11 Mar 2025
- 2025Open-Insect: Benchmarking Open-Set Recognition of Novel Species in Biodiversity Monitoring3 Mar 2025
- 2025OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing28 Feb 2025
- 2025Multi-label out-of-distribution detection via evidential learning25 Feb 2025
- 2025Leveraging Intermediate Representations for Better Out-of-Distribution Detection18 Feb 2025
- 2025Mitigating the Modality Gap: Few-Shot Out-of-Distribution Detection with Multi-modal Prototypes and Image Bias Estimation2 Feb 2025
- 2024Open-World Panoptic Segmentation17 Dec 2024
50 newest of 245 All 245 (JSON)
- 2024Negative Label Guided OOD Detection with Pretrained Vision-Language Modelscited by 66
- 2024Conjugated Semantic Pool Improves OOD Detection with Pre-trained Vision-Language Modelscited by 13
- 2025Knowledge Regularized Negative Feature Tuning of Vision-Language Models for Out-of-Distribution Detectioncited by 4
- 2025Mitigating the Modality Gap: Few-Shot Out-of-Distribution Detection with Multi-modal Prototypes and Image Bias Estimationcited by 3
- 2025To Trust Or Not To Trust Your Vision-Language Model's Predictioncited by 3
- 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attributioncited by 1
- 2025An Empirical Analysis of VLM-based OOD Detection: Mechanisms, Advantages, and Sensitivitycited by 1
- 2026FailSAE: Towards Interpretable Failure Prediction for Vision-Language Models via Sparse Autoencoderscited by 0
- 2026FailSAE: Towards Interpretable Failure Prediction for Vision-Language Models via Sparse Autoencoders2 Sep 2026
- 2025An Empirical Analysis of VLM-based OOD Detection: Mechanisms, Advantages, and Sensitivity16 Sep 2025
- 2025Knowledge Regularized Negative Feature Tuning of Vision-Language Models for Out-of-Distribution Detection26 Jul 2025
- 2025To Trust Or Not To Trust Your Vision-Language Model's Prediction29 May 2025
- 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attribution19 Apr 2025
- 2025Mitigating the Modality Gap: Few-Shot Out-of-Distribution Detection with Multi-modal Prototypes and Image Bias Estimation2 Feb 2025
- 2024Conjugated Semantic Pool Improves OOD Detection with Pre-trained Vision-Language Models11 Oct 2024
- 2024Negative Label Guided OOD Detection with Pretrained Vision-Language Models29 Mar 2024
- 2026JAF: Judge Agent Forestcited by 1
- 2026JAF: Judge Agent Forest29 Jan 2026
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 256
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 216
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
- 2022How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?cited by 128
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
12 most cited of 229 All 229 (JSON)
- 2026Detecting Pose Estimation Failures via Keypoint Self-Consistency4 Aug 2026
- 2026Uncertainty quantification for trustworthy deep learning: Methods and measures30 Jul 2026
- 2026Exploiting Local Flatness for Efficient Out-of-Distribution Detection29 Jun 2026
- 2026Modality-Aware Out-of-Distribution Detection for Multi-Modal Action Recognition23 Jun 2026
- 2026Trust-Aware Predictive Emissions Monitoring for Gas Turbine Fleets with Limited Labelled Data4 Jun 2026
- 2026Dual Feature Decoupling for Fine-Grained OOD Detection4 Jun 2026
- 2026Knowing when to trust machine-learned interatomic potentials1 May 2026
- 2026Rethinking Uncertainty in Segmentation: From Estimation to Decision14 Apr 2026
- 2026A Clinical Point Cloud Paradigm for In-Hospital Mortality Prediction from Multi-Level Incomplete Multimodal EHRs6 Apr 2026
- 2026A deep learning pipeline for PAM50 subtype classification using histopathology images and multi-objective patch selection2 Apr 2026
- 2026Bounding Box Anomaly Scoring for simple and efficient Out-of-Distribution detection24 Mar 2026
- 2026Shaping Parameter Contribution Patterns for Out-of-Distribution Detection7 Mar 2026
12 newest of 229 All 229 (JSON)