# Effective Out-of-Distribution Detection in Classifier Based on PEDCC-Loss

arXiv: https://arxiv.org/abs/2204.04665 · HTML: https://mlsanity.com/paper/2204.04665/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 31 references that are in the map.
- First posted on arXiv 10 Apr 2022.

## Builds on (most cited first, 22 of 22)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016)
- [Wide Residual Networks](https://mlsanity.com/paper/1605.07146/) (2016)
- [A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks](https://mlsanity.com/paper/1610.02136/) (2016)
- [Concrete Problems in AI Safety](https://mlsanity.com/paper/1606.06565/) (2016)
- [A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks](https://mlsanity.com/paper/1807.03888/) (2018)
- [LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop](https://mlsanity.com/paper/1506.03365/) (2015)
- [Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks](https://mlsanity.com/paper/1706.02690/) (2017)
- [A Survey of Uncertainty in Deep Neural Networks](https://mlsanity.com/paper/2107.03342/) (2021)
- [Predictive Uncertainty Estimation via Prior Networks](https://mlsanity.com/paper/1802.10501/) (2018)
- [Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Data](https://mlsanity.com/paper/2002.11297/) (2020)
- [Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samples](https://mlsanity.com/paper/1711.09325/) (2017)
- [Additive Margin Softmax for Face Verification](https://mlsanity.com/paper/1801.05599/) (2018)
- [Deep Stable Learning for Out-Of-Distribution Generalization](https://mlsanity.com/paper/2104.07876/) (2021)
- [Reverse KL-Divergence Training of Prior Networks: Improved Uncertainty and Adversarial Robustness](https://mlsanity.com/paper/1905.13472/) (2019)
- [Metric Learning for Novelty and Anomaly Detection](https://mlsanity.com/paper/1808.05492/) (2018)
- [A New Loss Function for CNN Classifier Based on Pre-defined Evenly-Distributed Class Centroids](https://mlsanity.com/paper/1904.06008/) (2019)
- [A Classification Supervised Auto-Encoder Based on Predefined Evenly-Distributed Class Centroids](https://mlsanity.com/paper/1902.00220/) (2019)
- [An Image Clustering Auto-Encoder Based on Predefined Evenly-Distributed Class Centroids and MMD Distance](https://mlsanity.com/paper/1906.03905/) (2019)
- [Generation and frame characteristics of predefined evenly-distributed class centroids for pattern classification](https://mlsanity.com/paper/2105.00401/) (2021)
- [Incremental Classifier Learning Based on PEDCC-Loss and Cosine Distance](https://mlsanity.com/paper/1906.04734/) (2019)
- [Semi-supervised learning method based on predefined evenly-distributed class centroids](https://mlsanity.com/paper/2001.04092/) (2020)

## Built on by (most cited first, 3 of 3)

- [Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Data](https://mlsanity.com/paper/2212.09171/) (2022)
- [Classifier-head Informed Feature Masking and Prototype-based Logit Smoothing for Out-of-Distribution Detection](https://mlsanity.com/paper/2310.18104/) (2023)
- [Out-of-distribution detection based on subspace projection of high-dimensional features output by the last convolutional layer](https://mlsanity.com/paper/2405.01662/) (2024)

## Abstract (arXiv)

Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. Thus, it is an urgent and challenging task to detect these samples drawn far away from training distribution based on the security considerations of artificial intelligence. Many current methods based on neural networks mainly rely on complex processing strategies, such as temperature scaling and input preprocessing, to obtain satisfactory results. In this paper, we propose an effective algorithm for detecting out-of-distribution examples utilizing PEDCC-Loss. We mathematically analyze the nature of the confidence score output by the PEDCC (Predefined Evenly-Distribution Class Centroids) classifier, and then construct a more effective scoring function to distinguish in-distribution (ID) and out-of-distribution. In this method, there is no need to preprocess the input samples and the computational burden of the algorithm is reduced. Experiments demonstrate that our method can achieve better OOD detection performance.