Visualizing Uncertainty: Spatial Maps of Missing and Conflicting Evidence in Deep Learning
Not on the map. Why?
Abstract (arXiv)
Understanding when and why deep neural networks are uncertain is crucial for deploying reliable machine learning systems in safety-critical domains. While existing uncertainty quantification methods provide scalar measures of model confidence, they offer limited insight into which spatial regions of an input contribute to different types of uncertainty. We propose a novel visualization framework, Uncertainty Activation Map (UAM), that combines Evidential Deep Learning (EDL) with Full-Gradient Class Activation Mapping (FullGrad) to generate interpretable spatial uncertainty activation maps. Our approach distinguishes between two fundamental types of uncertainty: vacuity, representing lack of evidence, and dissonance, capturing conflicting evidence between competing hypotheses. By leveraging the complete gradient decomposition property of FullGrad and the principled uncertainty quantification of Subjective Logic, our method produces theoretically grounded visualizations that highlight specific image regions responsible for model uncertainty. With this framework, vacuity and dissonance activation maps are generated by computing belief-weighted attributions, enabling identification of where models lack knowledge versus where they encounter ambiguous evidence. Extensive evaluations across multiple benchmark datasets demonstrate that the proposed framework effectively addresses the critical gap between uncertainty quantification and explainability, providing intuitive visual feedback to assess model reliability in complex visual recognition tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
29 of 47 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
17 more
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
- 2019Deep Ensembles: A Loss Landscape Perspectivecited by 443
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
- 2021Revisiting the Calibration of Modern Neural Networkscited by 390
- 2019Verified Uncertainty Calibrationcited by 309
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2019Full-Gradient Representation for Neural Network Visualizationcited by 191
- 2018Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detectioncited by 82
- 2020Multidimensional Uncertainty-Aware Evidential Neural Networkscited by 16
- 2023Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learningcited by 8
Built on by
Not cited yet.