Attribution of Predictive Uncertainties in Classification Models
Not on the map. Why?
Abstract (arXiv)
Predictive uncertainties in classification tasks are often a consequence of model inadequacy or insufficient training data. In popular applications, such as image processing, we are often required to scrutinise these uncertainties by meaningfully attributing them to input features. This helps to improve interpretability assessments. However, there exist few effective frameworks for this purpose. Vanilla forms of popular methods for the provision of saliency masks, such as SHAP or integrated gradients, adapt poorly to target measures of uncertainty. Thus, state-of-the-art tools instead proceed by creating counterfactual or adversarial feature vectors, and assign attributions by direct comparison to original images. In this paper, we present a novel framework that combines path integrals, counterfactual explanations and generative models, in order to procure attributions that contain few observable artefacts or noise. We evidence that this outperforms existing alternatives through quantitative evaluations with popular benchmarking methods and data sets of varying complexity.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 19 Jul 2021.
Builds on
27 of 41 references.
References · 27
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2016Conditional Image Generation with PixelCNN Decoderscited by 859
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2017Generative Adversarial Networks: An Overviewcited by 588
15 more
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
- 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
- 2018Understanding Measures of Uncertainty for Adversarial Example Detectioncited by 177
- 2020Debugging Tests for Model Explanationscited by 146
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2019XRAI: Better Attributions Through Regionscited by 116
- 2021Guided Integrated Gradients: An Adaptive Path Method for Removing Noisecited by 102
- 2020Getting a CLUE: A Method for Explaining Uncertainty Estimatescited by 92
- 2018Quantifying Uncertainties in Natural Language Processing Taskscited by 79
- 2020Attribution in Scale and Spacecited by 61
- 2021Have We Learned to Explain?: How Interpretability Methods Can Learn to Encode Predictions in their Interpretationscited by 59
- 2021Generating Interpretable Counterfactual Explanations By Implicit Minimisation of Epistemic and Aleatoric Uncertaintiescited by 41
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Informationcited by 33
- 2020Feature Removal Is a Unifying Principle for Model Explanation Methodscited by 21
- 2021Exploiting epistemic uncertainty of the deep learning models to generate adversarial samplescited by 12
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 1; 2026: 3.
8 papers.
- 2023Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learningcited by 8
- 2023Identifying Drivers of Predictive Aleatoric Uncertaintycited by 4
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervalscited by 4
- 2022Explaining Predictive Uncertainty by Looking Back at Model Explanationscited by 2
- 2024Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systemscited by 1
- 2026No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributionscited by 0
- 2026Rethinking XAI Evaluation: A Human-Centered Audit of Shapley Benchmarks in High-Stakes Settingscited by 0
- 2026XU-RS: Explaining Credal Width in Random-Set Language Modelscited by 0
- 2026XU-RS: Explaining Credal Width in Random-Set Language Models29 Sep 2026
- 2026Rethinking XAI Evaluation: A Human-Centered Audit of Shapley Benchmarks in High-Stakes Settings24 Apr 2026
- 2026No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributions25 Mar 2026
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervals19 May 2025
- 2024Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systems3 Jan 2024
- 2023Identifying Drivers of Predictive Aleatoric Uncertainty12 Dec 2023
- 2023Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learning10 Apr 2023
- 2022Explaining Predictive Uncertainty by Looking Back at Model Explanations11 Jan 2022