Explainable AI does not provide the explanations end-users are asking for
Not on the map. Why?
Abstract (arXiv)
Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks during development, their adoption by organisations to enhance trust in machine learning systems has unintended consequences. In this paper we discuss XAI's limitations in deployment and conclude that transparency alongside with rigorous validation are better suited to gaining trust in AI systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 25 Jan 2023.
Builds on
16 of 20 references.
References · 16
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
- 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
4 more
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 156
- 2019Fairwashing: the risk of rationalizationcited by 81
- 2021Synthetic Benchmarks for Scientific Research in Explainable Machine Learningcited by 59
- 2019Global Aggregations of Local Explanations for Black Box modelscited by 30
Built on by
Citing papers per year: 2025: 1.
1 paper.