mlsanityData to 7 Oct 2026

Uncertainty Estimation based on Geometric Separation

arXiv 2301.04452 ↗First posted 11 Jan 2023cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical applications such as autonomous driving. In this work, we put forward a novel geometric-based approach for improving uncertainty estimations in machine learning models. Our approach involves using the geometric distance of the current input from existing training inputs as a signal for estimating uncertainty, and then calibrating this signal using standard post-hoc techniques. We demonstrate that our method leads to more accurate uncertainty estimations than recently proposed approaches through extensive evaluation on a variety of datasets and models. Additionally, we optimize our approach so that it can be implemented on large datasets in near real-time applications, making it suitable for time-sensitive scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 60 references that are in the map. First posted on arXiv 11 Jan 2023.

Builds on

34 of 60 references.

References · 34

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  5. 2019When Does Label Smoothing Help?cited by 985
  6. 2016Universal adversarial perturbationscited by 774
  7. 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
  8. 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 585
  9. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
  10. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
  11. 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
  12. 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 359
22 more
  1. 2017Snapshot Ensembles: Train 1, get M for freecited by 349
  2. 2019Verified Uncertainty Calibrationcited by 307
  3. 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 304
  4. 2016Safety Verification of Deep Neural Networkscited by 262
  5. 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
  6. 2017Concrete Dropoutcited by 227
  7. 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
  8. 2020Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learningcited by 190
  9. 2020Improving model calibration with accuracy versus uncertainty optimizationcited by 123
  10. 2020Multivariate Confidence Calibration for Object Detectioncited by 98
  11. 2020Local Temperature Scaling for Probability Calibrationcited by 95
  12. 2017Verifying Properties of Binarized Deep Neural Networkscited by 77
  13. 2019Non-Parametric Calibration for Classificationcited by 57
  14. 2021Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibrationcited by 48
  15. 2021Distribution-free calibration guarantees for histogram binning without sample splittingcited by 44
  16. 2021Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibrationcited by 40
  17. 2022Beyond calibration: estimating the grouping loss of modern neural networkscited by 32
  18. 2019Distance-Based Learning from Errors for Confidence Calibrationcited by 23
  19. 2015Binary Classifier Calibration using an Ensemble of Near Isotonic Regression Modelscited by 21
  20. 2018Attended Temperature Scaling: A Practical Approach for Calibrating Deep Neural Networkscited by 21
  21. 2019Verifying Robustness of Gradient Boosted Modelscited by 13
  22. 2021Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimizationcited by 11

Built on by

Not cited yet.