mlsanityData to 7 Oct 2026

Attribution of Predictive Uncertainties in Classification Models

arXiv 2107.08756 ↗First posted 19 Jul 2021cs.LG cs.CV stat.MLcited by 8

Not on the map. Why?

Abstract (arXiv)

Predictive uncertainties in classification tasks are often a consequence of model inadequacy or insufficient training data. In popular applications, such as image processing, we are often required to scrutinise these uncertainties by meaningfully attributing them to input features. This helps to improve interpretability assessments. However, there exist few effective frameworks for this purpose. Vanilla forms of popular methods for the provision of saliency masks, such as SHAP or integrated gradients, adapt poorly to target measures of uncertainty. Thus, state-of-the-art tools instead proceed by creating counterfactual or adversarial feature vectors, and assign attributions by direct comparison to original images. In this paper, we present a novel framework that combines path integrals, counterfactual explanations and generative models, in order to procure attributions that contain few observable artefacts or noise. We evidence that this outperforms existing alternatives through quantitative evaluations with popular benchmarking methods and data sets of varying complexity.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 19 Jul 2021.

Builds on

27 of 41 references.

References · 27

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  4. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  6. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  7. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
  8. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  9. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
  10. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
  11. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  12. 2017Generative Adversarial Networks: An Overviewcited by 588
15 more
  1. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
  2. 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
  3. 2018Understanding Measures of Uncertainty for Adversarial Example Detectioncited by 177
  4. 2020Debugging Tests for Model Explanationscited by 146
  5. 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
  6. 2019XRAI: Better Attributions Through Regionscited by 116
  7. 2021Guided Integrated Gradients: An Adaptive Path Method for Removing Noisecited by 102
  8. 2020Getting a CLUE: A Method for Explaining Uncertainty Estimatescited by 92
  9. 2018Quantifying Uncertainties in Natural Language Processing Taskscited by 79
  10. 2020Attribution in Scale and Spacecited by 61
  11. 2021Have We Learned to Explain?: How Interpretability Methods Can Learn to Encode Predictions in their Interpretationscited by 59
  12. 2021Generating Interpretable Counterfactual Explanations By Implicit Minimisation of Epistemic and Aleatoric Uncertaintiescited by 41
  13. 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Informationcited by 33
  14. 2020Feature Removal Is a Unifying Principle for Model Explanation Methodscited by 21
  15. 2021Exploiting epistemic uncertainty of the deep learning models to generate adversarial samplescited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 1; 2026: 3.

8 papers.