I Find Your Lack of Uncertainty in Computer Vision Disturbing
Not on the map. Why?
Abstract (arXiv)
Neural networks are used for many real world applications, but often they have problems estimating their own confidence. This is particularly problematic for computer vision applications aimed at making high stakes decisions with humans and their lives. In this paper we make a meta-analysis of the literature, showing that most if not all computer vision applications do not use proper epistemic uncertainty quantification, which means that these models ignore their own limitations. We describe the consequences of using models without proper uncertainty quantification, and motivate the community to adopt versions of the models they use that have proper calibrated epistemic uncertainty, in order to enable out of distribution detection. We close the paper with a summary of challenges on estimating uncertainty for computer vision applications and recommendations.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 28 of its 52 references that are in the map. First posted on arXiv 16 Apr 2021.
Builds on
28 of 52 references.
References · 28
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 422
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
16 more
- 2019Human uncertainty makes classification more robustcited by 235
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
- 2019Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Visioncited by 182
- 2016Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distributioncited by 158
- 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
- 2018Bounding Box Regression with Uncertainty for Accurate Object Detectioncited by 143
- 2020A Review and Comparative Study on Probabilistic Object Detection in Autonomous Drivingcited by 115
- 2019Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Drivingcited by 105
- 2020Sim-to-Real Transfer for Vision-and-Language Navigationcited by 89
- 2020SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimatescited by 75
- 2019BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectorscited by 68
- 2019Reliable training and estimation of variance networkscited by 63
- 2018Probabilistic Object Detection: Definition and Evaluationcited by 55
- 2020Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural networkcited by 43
- 2017Real-time Convolutional Neural Networks for Emotion and Gender Classificationcited by 24
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 3; 2024: 3; 2025: 4; 2026: 2.
16 papers.
Sort:
By area:
- 2024Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Modelscited by 54
- 2023UGainS: Uncertainty Guided Anomaly Instance Segmentationcited by 15
- 2021An Uncertainty-aware Loss Function for Training Neural Networks with Calibrated Predictionscited by 6
- 2025Know What You do Not Know: Verbalized Uncertainty Estimation Robustness on Corrupted Images in Vision-Language Modelscited by 6
- 2023Unified Open-Vocabulary Dense Visual Predictioncited by 4
- 2022Object Detection as Probabilistic Set Predictioncited by 3
- 2022Comparison of Uncertainty Quantification with Deep Learning in Time Series Regressioncited by 3
- 2024Bayesian Inverse Graphics for Few-Shot Concept Learningcited by 2
- 2025An Analysis of Temporal Dropout in Earth Observation Time Series for Regression Taskscited by 2
- 2025Can Bayesian Neural Networks Explicitly Model Input Uncertainty?cited by 1
- 2021Teaching Uncertainty Quantification in Machine Learning through Use Casescited by 0
- 2023High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusioncited by 0
4 more
- 2024Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learningcited by 0
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learningcited by 0
- 2026Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?cited by 0
- 2026ByteTraX: Enhancing the ByteTrack Architecture with Optimised Thresholdingcited by 0
- 2026ByteTraX: Enhancing the ByteTrack Architecture with Optimised Thresholding29 Sep 2026
- 2026Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?30 Jun 2026
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learning10 Jun 2025
- 2025An Analysis of Temporal Dropout in Earth Observation Time Series for Regression Tasks9 Apr 2025
- 2025Know What You do Not Know: Verbalized Uncertainty Estimation Robustness on Corrupted Images in Vision-Language Models4 Apr 2025
- 2025Can Bayesian Neural Networks Explicitly Model Input Uncertainty?14 Jan 2025
- 2024Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learning19 Dec 2024
- 2024Bayesian Inverse Graphics for Few-Shot Concept Learning12 Sep 2024
- 2024Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Models5 May 2024
- 2023UGainS: Uncertainty Guided Anomaly Instance Segmentation3 Aug 2023
- 2023Unified Open-Vocabulary Dense Visual Prediction17 Jul 2023
- 2023High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion17 Mar 2023
4 more
- 2022Comparison of Uncertainty Quantification with Deep Learning in Time Series Regression11 Nov 2022
- 2022Object Detection as Probabilistic Set Prediction15 Mar 2022
- 2021An Uncertainty-aware Loss Function for Training Neural Networks with Calibrated Predictions7 Oct 2021
- 2021Teaching Uncertainty Quantification in Machine Learning through Use Cases19 Aug 2021
- 2024Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Modelscited by 54
- 2025Know What You do Not Know: Verbalized Uncertainty Estimation Robustness on Corrupted Images in Vision-Language Modelscited by 6
- 2026Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?cited by 0
- 2026Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?30 Jun 2026
- 2025Know What You do Not Know: Verbalized Uncertainty Estimation Robustness on Corrupted Images in Vision-Language Models4 Apr 2025
- 2024Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Models5 May 2024
- 2023UGainS: Uncertainty Guided Anomaly Instance Segmentationcited by 15
- 2021An Uncertainty-aware Loss Function for Training Neural Networks with Calibrated Predictionscited by 6
- 2023Unified Open-Vocabulary Dense Visual Predictioncited by 4
- 2022Object Detection as Probabilistic Set Predictioncited by 3
- 2022Comparison of Uncertainty Quantification with Deep Learning in Time Series Regressioncited by 3
- 2024Bayesian Inverse Graphics for Few-Shot Concept Learningcited by 2
- 2025An Analysis of Temporal Dropout in Earth Observation Time Series for Regression Taskscited by 2
- 2025Can Bayesian Neural Networks Explicitly Model Input Uncertainty?cited by 1
- 2021Teaching Uncertainty Quantification in Machine Learning through Use Casescited by 0
- 2023High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusioncited by 0
- 2024Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learningcited by 0
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026ByteTraX: Enhancing the ByteTrack Architecture with Optimised Thresholding29 Sep 2026
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learning10 Jun 2025
- 2025An Analysis of Temporal Dropout in Earth Observation Time Series for Regression Tasks9 Apr 2025
- 2025Can Bayesian Neural Networks Explicitly Model Input Uncertainty?14 Jan 2025
- 2024Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learning19 Dec 2024
- 2024Bayesian Inverse Graphics for Few-Shot Concept Learning12 Sep 2024
- 2023UGainS: Uncertainty Guided Anomaly Instance Segmentation3 Aug 2023
- 2023Unified Open-Vocabulary Dense Visual Prediction17 Jul 2023
- 2023High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion17 Mar 2023
- 2022Comparison of Uncertainty Quantification with Deep Learning in Time Series Regression11 Nov 2022
- 2022Object Detection as Probabilistic Set Prediction15 Mar 2022
- 2021An Uncertainty-aware Loss Function for Training Neural Networks with Calibrated Predictions7 Oct 2021
12 newest of 13 All 13 (JSON)