Introducing 'Inside' Out of Distribution
Not on the map. Why?
Abstract (arXiv)
Detecting and understanding out-of-distribution (OOD) samples is crucial in machine learning (ML) to ensure reliable model performance. Current OOD studies primarily focus on extrapolatory (outside) OOD, neglecting potential cases of interpolatory (inside) OOD. In this study, we introduce a novel perspective on OOD by suggesting it can be divided into inside and outside cases. We examine the inside-outside OOD profiles of datasets and their impact on ML model performance, using normalized Root Mean Squared Error (RMSE) and F1 score as the performance metrics on syntetically-generated datasets with both inside and outside OOD. Our analysis demonstrates that different inside-outside OOD profiles lead to unique effects on ML model performance, with outside OOD generally causing greater performance degradation, on average. These findings highlight the importance of distinguishing between inside and outside OOD for developing effective counter-OOD methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 81 references that are in the map. First posted on arXiv 5 Jul 2024.
Builds on
35 of 81 references.
References · 35
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2019AutoML: A Survey of the State-of-the-Artcited by 388
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2014Towards Open World Recognitioncited by 226
23 more
- 2020A Survey on the Explainability of Supervised Machine Learningcited by 225
- 2023When Do Neural Nets Outperform Boosted Trees on Tabular Data?cited by 218
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2022Improving Out-of-Distribution Robustness via Selective Augmentationcited by 202
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2021Reinforcement learning based recommender systems: A surveycited by 187
- 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
- 2023Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detectioncited by 57
- 2020Interpretability and Explainability: A Machine Learning Zoo Mini-tourcited by 55
- 2022Assaying Out-Of-Distribution Generalization in Transfer Learningcited by 53
- 2021Anomaly Detection in Medical Imaging -- A Mini Reviewcited by 44
- 2019One-Class Convolutional Neural Networkcited by 37
- 2022DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptationcited by 36
- 2022A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledgecited by 31
- 2017An Empirical Analysis of Feature Engineering for Predictive Modelingcited by 29
- 2017Ease.ml: Towards Multi-tenant Resource Sharing for Machine Learning Workloadscited by 16
- 2021Anomaly Detection: How to Artificially Increase your F1-Score with a Biased Evaluation Protocolcited by 9
- 2022SubStrat: A Subset-Based Strategy for Faster AutoMLcited by 8
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detectioncited by 5
- 2023Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Taskscited by 5
- 2020Kullback-Leibler Divergence-Based Out-of-Distribution Detection with Flow-Based Generative Modelscited by 4
- 2023Experts' cognition-driven ensemble deep learning for external validation of predicting pathological complete response to neoadjuvant chemotherapy from histological images in breast cancercited by 2
- 2022Multivariate outlier explanations using Shapley values and Mahalanobis distancescited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.