mlsanityData to 14 Oct 2026

Exploiting Local Flatness for Efficient Out-of-Distribution Detection

arXiv 2606.29952 ↗First posted 29 Jun 2026cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Detecting out-of-distribution (OOD) data is crucial for reliable machine learning deployment. Among detection strategies, post-hoc methods are particularly attractive due to their efficiency, as they operate directly on pre-trained networks without requiring retraining. Within this paradigm, one promising direction exploits loss-landscape curvature to estimate model uncertainty; however, such methods incur substantial computational cost and rely on implicit assumptions about how landscape flatness differs between in-distribution (ID) and OOD data. In this work, we provide the first systematic investigation of this curvature discrepancy and show that OOD inputs exhibit larger Hessian curvature than ID data, with the gap widening under stronger distributional shifts. Motivated by these observations, we propose Fold, a lightweight flatness-modulated OOD detector that leverages the feature Hessian and partial feature normalization to improve ID-OOD separability while avoiding costly parameter-space curvature approximations. To optimally adapt this normalization across diverse datasets, we further introduce AutoFold, a self-supervised tuning scheme that synthesizes pseudo-OOD samples via ID logit masking for automatic calibration without requiring external data. Experiments on OOD benchmarks show that Fold outperforms prior methods, improving the average AUROC by 1.63% and reducing FPR95 by 2.30%, while maintaining computational efficiency comparable to a standard forward pass. Supported by theoretical analysis and extensive ablations, Fold provides a principled and practical solution for robust real-world deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 72 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

54 of 72 references.

References · 54

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016Densely Connected Convolutional Networkscited by 6,720
  3. 2013Intriguing properties of neural networkscited by 5,155
  4. 2017On Calibration of Modern Neural Networkscited by 4,960
  5. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  6. 2016Wide Residual Networkscited by 3,070
  7. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  8. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  9. 2013Describing Textures in the Wildcited by 2,125
  10. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  11. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  12. 2020Energy-based Out-of-distribution Detectioncited by 1,299
38 more
  1. 2020Designing Network Design Spacescited by 960
  2. 2018Deep Anomaly Detection with Outlier Exposurecited by 942
  3. 2016Universal adversarial perturbationscited by 784
  4. 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
  5. 2017The Implicit Bias of Gradient Descent on Separable Datacited by 655
  6. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  7. 2015Towards Open Set Deep Networkscited by 538
  8. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  9. 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
  10. 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
  11. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  12. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
  13. 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
  14. 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
  15. 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
  16. 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
  17. 2019PyHessian: Neural Networks Through the Lens of the Hessiancited by 292
  18. 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
  19. 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 252
  20. 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
  21. 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 231
  22. 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
  23. 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
  24. 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
  25. 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
  26. 2018Reducing Network Agnostophobiacited by 165
  27. 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 134
  28. 2023Non-Parametric Outlier Synthesiscited by 129
  29. 2018Out-of-Distribution Detection Using an Ensemble of Self Supervised Leave-out Classifierscited by 126
  30. 2019Unsupervised Out-of-Distribution Detection by Maximum Classifier Discrepancycited by 112
  31. 2018Stochastic Gradient Descent on Separable Data: Exact Convergence with a Fixed Learning Ratecited by 64
  32. 2019Detecting semantic anomaliescited by 50
  33. 2021Sketching Curvature for Efficient Out-of-Distribution Detection for Deep Neural Networkscited by 32
  34. 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 32
  35. 2023Neuron Activation Coverage: Rethinking Out-of-distribution Detection and Generalizationcited by 28
  36. 2023Understanding the Feature Norm for Out-of-Distribution Detectioncited by 27
  37. 2024Kernel PCA for Out-of-Distribution Detectioncited by 24
  38. 2023Provable Benefit of Mixup for Finding Optimal Decision Boundariescited by 6

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.