mlsanityData to 14 Oct 2026

XAI Handbook: Towards a Unified Framework for Explainable AI

arXiv 2105.06677 ↗First posted 14 May 2021cs.AI cs.CV cs.HCcited by 14

Not on the map. Why?

Abstract (arXiv)

The field of explainable AI (XAI) has quickly become a thriving and prolific community. However, a silent, recurrent and acknowledged issue in this area is the lack of consensus regarding its terminology. In particular, each new contribution seems to rely on its own (and often intuitive) version of terms like "explanation" and "interpretation". Such disarray encumbers the consolidation of advances in the field towards the fulfillment of scientific and regulatory demands e.g., when comparing methods or establishing their compliance with respect to biases and fairness constraints. We propose a theoretical framework that not only provides concrete definitions for these terms, but it also outlines all steps necessary to produce explanations and interpretations. The framework also allows for existing contributions to be re-contextualized such that their scope can be measured, thus making them comparable to other methods. We show that this framework is compliant with desiderata on explanations, on interpretability and on evaluation metrics. We present a use-case showing how the framework can be used to compare LIME, SHAP and MDNet, establishing their advantages and shortcomings. Finally, we discuss relevant trends in XAI as well as recommendations for future work, all from the standpoint of our framework.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 35 of its 60 references that are in the map. First posted on arXiv 14 May 2021.

Builds on

35 of 60 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  5. 2013Intriguing properties of neural networkscited by 5,155
  6. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  7. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  8. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  9. 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
  10. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  11. 2019Attention is not Explanationcited by 929
  12. 2016The Mythos of Model Interpretabilitycited by 721
23 more
  1. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
  2. 2019Attention is not not Explanationcited by 636
  3. 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
  4. 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
  5. 2019On Evaluating Adversarial Robustnesscited by 447
  6. 2017Interpretation of Neural Networks is Fragilecited by 444
  7. 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
  8. 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 345
  9. 2019Explanations can be manipulated and geometry is to blamecited by 216
  10. 2018Explaining Image Classifiers by Counterfactual Generationcited by 144
  11. 2020Explainable Deep Learning: A Field Guide for the Uninitiatedcited by 127
  12. 2019Explainability Fact Sheets: A Framework for Systematic Assessment of Explainable Approachescited by 101
  13. 2017Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciencescited by 85
  14. 2016Discovering Causal Signals in Imagescited by 79
  15. 2020Explainable Artificial Intelligence: a Systematic Reviewcited by 79
  16. 2020A Disentangling Invertible Interpretation Network for Explaining Latent Representationscited by 57
  17. 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
  18. 2020Towards falsifiable interpretability researchcited by 53
  19. 2018Explanation Methods in Deep Learning: Users, Values, Concerns and Challengescited by 49
  20. 2017Contextual Explanation Networkscited by 21
  21. 2018Explainable Software Analyticscited by 15
  22. 2018What do Deep Networks Like to See?cited by 4
  23. 2020Evolved Explainable Classifications for Lymph Node Metastasescited by 2

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 1; 2023: 4; 2024: 4; 2025: 4.

14 papers.

Sort:

By area: