Getting a CLUE: A Method for Explaining Uncertainty Estimates
Not on the map. Why?
Abstract (arXiv)
Both uncertainty estimation and interpretability are important factors for trustworthy machine learning systems. However, there is little work at the intersection of these two areas. We address this gap by proposing a novel method for interpreting uncertainty estimates from differentiable probabilistic models, like Bayesian Neural Networks (BNNs). Our method, Counterfactual Latent Uncertainty Explanations (CLUE), indicates how to change an input, while keeping it on the data manifold, such that a BNN becomes more confident about the input's prediction. We validate CLUE through 1) a novel framework for evaluating counterfactual explanations of uncertainty, 2) a series of ablation experiments, and 3) a user study. Our experiments show that CLUE outperforms baselines and enables practitioners to better understand which input patterns are responsible for predictive uncertainty.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 17; 2023: 18; 2024: 18; 2025: 15; 2026: 9.
92 papers.
Sort:
By area:
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2022Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysiscited by 104
- 2021CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithmscited by 85
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 60
- 2022Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recoursecited by 40
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2022On the Privacy Risks of Algorithmic Recoursecited by 32
38 more
- 2022Adapting the Linearised Laplace Model Evidence for Modern Deep Learningcited by 29
- 2022On the Trade-Off between Actionable Explanations and the Right to be Forgottencited by 20
- 2021Diverse, Global and Amortised Counterfactual Explanations for Uncertainty Estimatescited by 19
- 2023Calibrated Explanations: with Uncertainty Information and Counterfactualscited by 16
- 2023Efficient XAI Techniques: A Taxonomic Surveycited by 14
- 2023Learning Personalized Decision Support Policiescited by 13
- 2021RELAX: Representation Learning Explainabilitycited by 12
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Surveycited by 11
- 2022Uncertainty Estimation for Computed Tomography with a Linearised Deep Image Priorcited by 10
- 2023Quantifying and Explaining Machine Learning Uncertainty in Predictive Process Monitoring: An Operations Research Perspectivecited by 10
- 2022Provable concept learning for interpretable predictions using variational autoencoderscited by 9
- 2023Endogenous Macrodynamics in Algorithmic Recoursecited by 9
- 2024Explaining Predictive Uncertainty by Exposing Second-Order Effectscited by 9
- 2024A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learningcited by 9
- 2024Counterfactual Explanations via Riemannian Latent Space Traversalcited by 9
- 2021Attribution of Predictive Uncertainties in Classification Modelscited by 8
- 2023Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learningcited by 8
- 2024TABCF: Counterfactual Explanations for Tabular Data Using a Transformer-Based VAEcited by 8
- 2021Shapley variable importance clouds for interpretable machine learningcited by 7
- 2021MCCE: Monte Carlo sampling of realistic counterfactual explanationscited by 7
- 2022Bayesian Experimental Design for Computed Tomography with the Linearised Deep Image Priorcited by 7
- 2021Uncertainty Quantification of Surrogate Explanations: an Ordinal Consensus Approachcited by 6
- 2023Model-agnostic variable importance for predictive uncertainty: an entropy-based approachcited by 6
- 2021To Trust or Not to Trust a Regressor: Estimating and Explaining Trustworthiness of Regression Predictionscited by 5
- 2024"What is Different Between These Datasets?" A Framework for Explaining Data Distribution Shiftscited by 5
- 2025From Search To Sampling: Generative Models For Robust Algorithmic Recoursecited by 5
- 2021δ-CLUE: Diverse Sets of Explanations for Uncertainty Estimatescited by 4
- 2022Improving Model Understanding and Trust with Counterfactual Explanations of Model Confidencecited by 4
- 2022Computing Rule-Based Explanations by Leveraging Counterfactualscited by 4
- 2023Explaining Model Confidence Using Counterfactualscited by 4
- 2023Explaining Black-Box Models through Counterfactualscited by 4
- 2023Identifying Drivers of Predictive Aleatoric Uncertaintycited by 4
- 2024QUCE: The Minimisation and Quantification of Path-Based Uncertainty for Generative Counterfactual Explanationscited by 4
- 2024Generating Feasible and Plausible Counterfactual Explanations for Outcome Prediction of Business Processescited by 4
- 2024Enhancing Counterfactual Explanation Search with Diffusion Distance and Directional Coherencecited by 4
- 2024X-Fake: Juggling Utility Evaluation and Explanation of Simulated SAR Imagescited by 4
- 2025Trustworthy AI Must Account for Interactionscited by 4
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervalscited by 4
50 most cited of 92 All 92 (JSON)
- 2026XU-RS: Explaining Credal Width in Random-Set Language Models29 Sep 2026
- 2026Explainable Uncertainty Estimation for Reliable Medical AI28 Aug 2026
- 2026Uncertainty quantification for trustworthy deep learning: Methods and measures30 Jul 2026
- 2026Optimized Instance Alteration for Explaining and Assessing Robustness of Classifiers7 Jul 2026
- 2026Target-confidence Recourse Using tSeTlin machines: TRUST17 Jun 2026
- 2026RecourseBench: A Modular Framework for Reproducible Algorithmic Recourse Evaluation15 Jun 2026
- 2026No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributions25 Mar 2026
- 2026Informative Perturbation Selection for Uncertainty-Aware Post-hoc Explanations16 Mar 2026
- 2026EvoMorph: Counterfactual Explanations for Continuous Time-Series Extrinsic Regression Applied to Photoplethysmography15 Jan 2026
- 2025CONFEX: Uncertainty-Aware Counterfactual Explanations with Conformal Guarantees22 Oct 2025
- 2025Uncertainty Awareness and Trust in Explainable AI- On Trust Calibration using Local and Global Explanations10 Sep 2025
- 2025An Explainable Gaussian Process Auto-encoder for Tabular Data31 Aug 2025
38 more
- 2025Tabular Diffusion Counterfactual Explanations31 Aug 2025
- 2025TCUQ: Single-Pass Uncertainty Quantification from Temporal Consistency with Streaming Conformal Calibration for TinyML18 Aug 2025
- 2025DiCoFlex: Model-agnostic diverse counterfactuals with flexible control29 May 2025
- 2025Individualised Counterfactual Examples Using Conformal Prediction Intervals28 May 2025
- 2025Do you see what I see? An Ambiguous Optical Illusion Dataset exposing limitations of Explainable AI27 May 2025
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervals19 May 2025
- 2025From Search To Sampling: Generative Models For Robust Algorithmic Recourse12 May 2025
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Survey4 May 2025
- 2025Trustworthy AI Must Account for Interactions9 Apr 2025
- 2025Improving Counterfactual Truthfulness for Molecular Property Prediction through Uncertainty Quantification3 Apr 2025
- 2025Conceptualizing Uncertainty: A Concept-based Approach to Explaining Uncertainty5 Mar 2025
- 2025Uncertainty Quantification as a Principled Foundation for Explainable Artificial Intelligence: A Case Study of Counterfactual Explanations24 Feb 2025
- 2024Pathway-Guided Optimization of Deep Generative Molecular Design Models for Cancer Therapy5 Nov 2024
- 2024Counterfactual Explanations via Riemannian Latent Space Traversal4 Nov 2024
- 2024TABCF: Counterfactual Explanations for Tabular Data Using a Transformer-Based VAE14 Oct 2024
- 2024Neural Networks Decoded: Targeted and Robust Analysis of Neural Network Decisions via Causal Explanations and Reasoning7 Oct 2024
- 2024When Explanations Compete: Policy-Aware Selection Under Uncertainty7 Oct 2024
- 2024TACE: Tumor-Aware Counterfactual Explanations19 Sep 2024
- 2024X-Fake: Juggling Utility Evaluation and Explanation of Simulated SAR Images28 Jul 2024
- 2024Trustworthy Artificial Intelligence in the Context of Metrology14 Jun 2024
- 2024A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learning1 Jun 2024
- 2024Overlap Number of Balls Model-Agnostic CounterFactuals (ONB-MACF): A Data-Morphology-based Counterfactual Generation Method for Trustworthy Artificial Intelligence20 May 2024
- 2024Enhancing Counterfactual Explanation Search with Diffusion Distance and Directional Coherence19 Apr 2024
- 2024Generating Feasible and Plausible Counterfactual Explanations for Outcome Prediction of Business Processes14 Mar 2024
- 2024"What is Different Between These Datasets?" A Framework for Explaining Data Distribution Shifts8 Mar 2024
- 2024QUCE: The Minimisation and Quantification of Path-Based Uncertainty for Generative Counterfactual Explanations27 Feb 2024
- 2024A Framework for Variational Inference of Lightweight Bayesian Neural Networks with Heteroscedastic Uncertainties22 Feb 2024
- 2024Collective Counterfactual Explanations: Balancing Individual Goals and Collective Dynamics7 Feb 2024
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI1 Feb 2024
- 2024Explaining Predictive Uncertainty by Exposing Second-Order Effects30 Jan 2024
- 2023Identifying Drivers of Predictive Aleatoric Uncertainty12 Dec 2023
- 2023Model-agnostic variable importance for predictive uncertainty: an entropy-based approach19 Oct 2023
- 2023A PSO Based Method to Generate Actionable Counterfactuals for High Dimensional Data30 Sep 2023
- 2023Towards User Guided Actionable Recourse5 Sep 2023
- 2023Endogenous Macrodynamics in Algorithmic Recourse16 Aug 2023
- 2023Explaining Black-Box Models through Counterfactuals14 Aug 2023
- 2023MoleCLUEs: Molecular Conformers Maximally In-Distribution for Predictive Models20 Jun 2023
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Values9 Jun 2023
50 newest of 92 All 92 (JSON)
- 2022On the Privacy Risks of Algorithmic Recoursecited by 32
- 2022On the Privacy Risks of Algorithmic Recourse10 Nov 2022
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2022Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysiscited by 104
- 2021CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithmscited by 85
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 60
- 2022Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recoursecited by 40
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2022Adapting the Linearised Laplace Model Evidence for Modern Deep Learningcited by 29
12 most cited of 91 All 91 (JSON)
- 2026XU-RS: Explaining Credal Width in Random-Set Language Models29 Sep 2026
- 2026Explainable Uncertainty Estimation for Reliable Medical AI28 Aug 2026
- 2026Uncertainty quantification for trustworthy deep learning: Methods and measures30 Jul 2026
- 2026Optimized Instance Alteration for Explaining and Assessing Robustness of Classifiers7 Jul 2026
- 2026Target-confidence Recourse Using tSeTlin machines: TRUST17 Jun 2026
- 2026RecourseBench: A Modular Framework for Reproducible Algorithmic Recourse Evaluation15 Jun 2026
- 2026No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributions25 Mar 2026
- 2026Informative Perturbation Selection for Uncertainty-Aware Post-hoc Explanations16 Mar 2026
- 2026EvoMorph: Counterfactual Explanations for Continuous Time-Series Extrinsic Regression Applied to Photoplethysmography15 Jan 2026
- 2025CONFEX: Uncertainty-Aware Counterfactual Explanations with Conformal Guarantees22 Oct 2025
- 2025Uncertainty Awareness and Trust in Explainable AI- On Trust Calibration using Local and Global Explanations10 Sep 2025
- 2025An Explainable Gaussian Process Auto-encoder for Tabular Data31 Aug 2025
12 newest of 91 All 91 (JSON)