Uncertainty Estimation based on Geometric Separation
Not on the map. Why?
Abstract (arXiv)
In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical applications such as autonomous driving. In this work, we put forward a novel geometric-based approach for improving uncertainty estimations in machine learning models. Our approach involves using the geometric distance of the current input from existing training inputs as a signal for estimating uncertainty, and then calibrating this signal using standard post-hoc techniques. We demonstrate that our method leads to more accurate uncertainty estimations than recently proposed approaches through extensive evaluation on a variety of datasets and models. Additionally, we optimize our approach so that it can be implemented on large datasets in near real-time applications, making it suitable for time-sensitive scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 60 references that are in the map. First posted on arXiv 11 Jan 2023.
Builds on
34 of 60 references.
References · 34
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019When Does Label Smoothing Help?cited by 985
- 2016Universal adversarial perturbationscited by 774
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 585
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
- 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 359
22 more
- 2017Snapshot Ensembles: Train 1, get M for freecited by 349
- 2019Verified Uncertainty Calibrationcited by 307
- 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 304
- 2016Safety Verification of Deep Neural Networkscited by 262
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
- 2017Concrete Dropoutcited by 227
- 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
- 2020Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learningcited by 190
- 2020Improving model calibration with accuracy versus uncertainty optimizationcited by 123
- 2020Multivariate Confidence Calibration for Object Detectioncited by 98
- 2020Local Temperature Scaling for Probability Calibrationcited by 95
- 2017Verifying Properties of Binarized Deep Neural Networkscited by 77
- 2019Non-Parametric Calibration for Classificationcited by 57
- 2021Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibrationcited by 48
- 2021Distribution-free calibration guarantees for histogram binning without sample splittingcited by 44
- 2021Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibrationcited by 40
- 2022Beyond calibration: estimating the grouping loss of modern neural networkscited by 32
- 2019Distance-Based Learning from Errors for Confidence Calibrationcited by 23
- 2015Binary Classifier Calibration using an Ensemble of Near Isotonic Regression Modelscited by 21
- 2018Attended Temperature Scaling: A Practical Approach for Calibrating Deep Neural Networkscited by 21
- 2019Verifying Robustness of Gradient Boosted Modelscited by 13
- 2021Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimizationcited by 11
Built on by
Not cited yet.