Multi-layer Radial Basis Function Networks for Out-of-distribution Detection
Not on the map. Why?
Abstract (arXiv)
Existing methods for out-of-distribution (OOD) detection use various techniques to produce a score, separate from classification, that determines how ``OOD'' an input is. Our insight is that OOD detection can be simplified by using a neural network architecture which can effectively merge classification and OOD detection into a single step. Radial basis function networks (RBFNs) inherently link classification confidence and OOD detection; however, these networks have lost popularity due to the difficult of training them in a multi-layer fashion. In this work, we develop a multi-layer radial basis function network (MLRBFN) which can be easily trained. To ensure that these networks are also effective for OOD detection, we develop a novel depression mechanism. We apply MLRBFNs as standalone classifiers and as heads on top of pretrained feature extractors, and find that they are competitive with commonly used methods for OOD detection. Our MLRBFN architecture demonstrates a promising new direction for OOD detection methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 52 references that are in the map. First posted on arXiv 5 Jan 2025.
Builds on
31 of 52 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 719
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
19 more
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2021A Geometric Analysis of Neural Collapse with Unconstrained Featurescited by 227
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
- 2023OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detectioncited by 179
- 2023Non-Parametric Outlier Synthesiscited by 129
- 2022How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?cited by 128
- 2022Neural Collapse: A Review on Modelling Principles and Generalizationcited by 95
- 2021On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertaintycited by 87
- 2022Are All Losses Created Equal: A Neural Collapse Perspectivecited by 78
- 2023Calibration in Deep Learning: A Survey of the State-of-the-Artcited by 75
- 2023When Does Optimizing a Proper Loss Yield Calibration?cited by 36
- 2023Neural Collapse in the Intermediate Hidden Layers of Classification Neural Networkscited by 21
- 2018Deep-RBF Networks Revisited: Robust Classification with Rejectioncited by 10
- 2018Deep RBFNet: Point Cloud Feature Learning using Radial Basis Functionscited by 7
- 2023Feature Collapsecited by 6
- 2019DeepLABNet: End-to-end Learning of Deep Radial Basis Networks with Fully Learnable Basis Functionscited by 4
Built on by
Not cited yet.