Learning by Erasing: Conditional Entropy based Transferable Out-Of-Distribution Detection
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) detection is essential to handle the distribution shifts between training and test scenarios. For a new in-distribution (ID) dataset, existing methods require retraining to capture the dataset-specific feature representation or data distribution. In this paper, we propose a deep generative models (DGM) based transferable OOD detection method, which is unnecessary to retrain on a new ID dataset. We design an image erasing strategy to equip exclusive conditional entropy distribution for each ID dataset, which determines the discrepancy of DGM's posteriori ucertainty distribution on different ID datasets. Owing to the powerful representation capacity of convolutional neural networks, the proposed model trained on complex dataset can capture the above discrepancy between ID datasets without retraining and thus achieve transferable OOD detection. We validate the proposed method on five datasets and verity that ours achieves comparable performance to the state-of-the-art group based OOD detection methods that need to be retrained to deploy on new ID datasets. Our code is available at https://github.com/oOHCIOo/CETOOD.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 41 references that are in the map. First posted on arXiv 23 Apr 2022.
Builds on
26 of 41 references.
References · 26
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 417
14 more
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 221
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
- 2019Input complexity and out-of-distribution detection with likelihood-based generative modelscited by 186
- 2020Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encodercited by 145
- 2021MOOD: Multi-level Out-of-distribution Detectioncited by 94
- 2021Understanding Failures in Out-of-Distribution Detection with Deep Generative Modelscited by 89
- 2021XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanationscited by 73
- 2020Feature Space Singularity for Out-of-Distribution Detectioncited by 49
- 2018Discriminative out-of-distribution detection for semantic segmentationcited by 47
- 2016Natural-Parameter Networks: A Class of Probabilistic Neural Networkscited by 34
- 2019Detecting Out-of-Distribution Inputs to Deep Generative Models Using Typicalitycited by 31
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025EOOD: Entropy-based Out-of-distribution Detectioncited by 5
- 2025EOOD: Entropy-based Out-of-distribution Detection4 Apr 2025