Defining Explainable AI for Requirements Analysis
Not on the map. Why?
Abstract (arXiv)
Explainable Artificial Intelligence (XAI) has become popular in the last few years. The Artificial Intelligence (AI) community in general, and the Machine Learning (ML) community in particular, is coming to the realisation that in many applications, for AI to be trusted, it must not only demonstrate good performance in its decisionmaking, but it also must explain these decisions and convince us that it is making the decisions for the right reasons. However, different applications have different requirements on the information required of the underlying AI system in order to convince us that it is worthy of our trust. How do we define these requirements? In this paper, we present three dimensions for categorising the explanatory requirements of different applications. These are Source, Depth and Scope. We focus on the problem of matching up the explanatory requirements of different applications with the capabilities of underlying ML techniques to provide them. We deliberately avoid including aspects of explanation that are already well-covered by the existing literature and we focus our discussion on ML although the principles apply to AI more broadly.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 33 references that are in the map. First posted on arXiv 22 Feb 2026.
Builds on
14 of 33 references.
References · 14
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2014Deep Learning in Neural Networks: An Overviewcited by 770
- 2017One pixel attack for fooling deep neural networkscited by 582
- 2017Adversarial Patchcited by 517
- 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 345
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 344
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
- 2016Safety Verification of Deep Neural Networkscited by 263
- 2016Generating Visual Explanationscited by 158
- 2017Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciencescited by 85
- 2017What Does Explainable AI Really Mean? A New Conceptualization of Perspectivescited by 72
2 more
- 2017Synthesizing Robust Adversarial Examplescited by 39
- 2018Plan Explanations as Model Reconciliation -- An Empirical Studycited by 7
Built on by
Not cited yet.