mlsanityData to 7 Oct 2026

Introducing 'Inside' Out of Distribution

arXiv 2407.04534 ↗First posted 5 Jul 2024cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Detecting and understanding out-of-distribution (OOD) samples is crucial in machine learning (ML) to ensure reliable model performance. Current OOD studies primarily focus on extrapolatory (outside) OOD, neglecting potential cases of interpolatory (inside) OOD. In this study, we introduce a novel perspective on OOD by suggesting it can be divided into inside and outside cases. We examine the inside-outside OOD profiles of datasets and their impact on ML model performance, using normalized Root Mean Squared Error (RMSE) and F1 score as the performance metrics on syntetically-generated datasets with both inside and outside OOD. Our analysis demonstrates that different inside-outside OOD profiles lead to unique effects on ML model performance, with outside OOD generally causing greater performance degradation, on average. These findings highlight the importance of distinguishing between inside and outside OOD for developing effective counter-OOD methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 81 references that are in the map. First posted on arXiv 5 Jul 2024.

Builds on

35 of 81 references.

References · 35

  1. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  2. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  3. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  4. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  5. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  6. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
  7. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  8. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  9. 2019AutoML: A Survey of the State-of-the-Artcited by 388
  10. 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
  11. 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
  12. 2014Towards Open World Recognitioncited by 226
23 more
  1. 2020A Survey on the Explainability of Supervised Machine Learningcited by 225
  2. 2023When Do Neural Nets Outperform Boosted Trees on Tabular Data?cited by 218
  3. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  4. 2022Improving Out-of-Distribution Robustness via Selective Augmentationcited by 202
  5. 2021Data Augmentation Can Improve Robustnesscited by 193
  6. 2021Reinforcement learning based recommender systems: A surveycited by 187
  7. 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
  8. 2023Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detectioncited by 57
  9. 2020Interpretability and Explainability: A Machine Learning Zoo Mini-tourcited by 55
  10. 2022Assaying Out-Of-Distribution Generalization in Transfer Learningcited by 53
  11. 2021Anomaly Detection in Medical Imaging -- A Mini Reviewcited by 44
  12. 2019One-Class Convolutional Neural Networkcited by 37
  13. 2022DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptationcited by 36
  14. 2022A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledgecited by 31
  15. 2017An Empirical Analysis of Feature Engineering for Predictive Modelingcited by 29
  16. 2017Ease.ml: Towards Multi-tenant Resource Sharing for Machine Learning Workloadscited by 16
  17. 2021Anomaly Detection: How to Artificially Increase your F1-Score with a Biased Evaluation Protocolcited by 9
  18. 2022SubStrat: A Subset-Based Strategy for Faster AutoMLcited by 8
  19. 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detectioncited by 5
  20. 2023Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Taskscited by 5
  21. 2020Kullback-Leibler Divergence-Based Out-of-Distribution Detection with Flow-Based Generative Modelscited by 4
  22. 2023Experts' cognition-driven ensemble deep learning for external validation of predicting pathological complete response to neoadjuvant chemotherapy from histological images in breast cancercited by 2
  23. 2022Multivariate outlier explanations using Shapley values and Mahalanobis distancescited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.