On the Importance of Regularisation & Auxiliary Information in OOD Detection
Not on the map. Why?
Abstract (arXiv)
Neural networks are often utilised in critical domain applications (e.g. self-driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates a fundamental flaw indicating that neural networks often overfit on spurious correlations. To address this problem in this work we present two novel objectives that improve the ability of a network to detect out-of-distribution samples and therefore avoid overconfident predictions for ambiguous inputs. We empirically demonstrate that our methods outperform the baseline and perform better than the majority of existing approaches while still maintaining a competitive performance against the rest. Additionally, we empirically demonstrate the robustness of our approach against common corruptions and demonstrate the importance of regularisation and auxiliary information in out-of-distribution detection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 15 Jul 2021.
Builds on
36 of 49 references.
References · 36
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016Wide Residual Networkscited by 3,057
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
24 more
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
- 2020Overfitting in adversarially robust deep learningcited by 504
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
- 2020Contrastive Training for Improved Out-of-Distribution Detectioncited by 186
- 2020Density of States Estimation for Out-of-Distribution Detectioncited by 74
- 2020The Implicit and Explicit Regularization Effects of Dropoutcited by 71
- 2020Removing Spurious Features can Hurt Accuracy and Affect Groups Disproportionatelycited by 52
- 2019Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution Taskscited by 48
- 2020Towards Maximizing the Representation Gap between In-Domain & Out-of-Distribution Examplescited by 40
- 2019Can You Trust This Prediction? Auditing Pointwise Reliability After Learningcited by 28
- 2020Boundary thickness and robustness in learning modelscited by 26
- 2018Out-of-Distribution Detection using Multiple Semantic Label Representationscited by 22
- 2020Anomalous Example Detection in Deep Learning: A Surveycited by 16
- 2018A Less Biased Evaluation of Out-of-distribution Sample Detectorscited by 14
- 2020Ramifications of Approximate Posterior Inference for Bayesian Deep Learning in Adversarial and Out-of-Distribution Settingscited by 2
Built on by
Not cited yet.