mlsanityData to 7 Oct 2026

A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Concepts

arXiv 2105.07190 ↗First posted 15 May 2021cs.LG cs.AIcited by 90

Not on the map. Why?

Abstract (arXiv)

In the meantime, a wide variety of terminologies, motivations, approaches, and evaluation criteria have been developed within the research field of explainable artificial intelligence (XAI). With the amount of XAI methods vastly growing, a taxonomy of methods is needed by researchers as well as practitioners: To grasp the breadth of the topic, compare methods, and to select the right XAI method based on traits required by a specific use-case context. Many taxonomies for XAI methods of varying level of detail and depth can be found in the literature. While they often have a different focus, they also exhibit many points of overlap. This paper unifies these efforts and provides a complete taxonomy of XAI methods with respect to notions present in the current state of research. In a structured literature analysis and meta-study, we identified and reviewed more than 50 of the most cited and current surveys on XAI methods, metrics, and method traits. After summarizing them in a survey of surveys, we merge terminologies and concepts of the articles into a unified structured taxonomy. Single concepts therein are illustrated by more than 50 diverse selected example methods in total, which we categorize accordingly. The taxonomy may serve both beginners, researchers, and practitioners as a reference and wide-ranging overview of XAI method traits and aspects. Hence, it provides foundations for targeted, use-case-oriented, and context-sensitive future research.

Key facts. Cited by 90 papers in the map (data through 7 Oct 2026). Builds on 87 of its 172 references that are in the map. First posted on arXiv 15 May 2021.

Builds on

87 of 172 references.

References · 87

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  5. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  6. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  8. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  9. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  10. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  11. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  12. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
38 more
  1. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  2. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  3. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  4. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  5. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  6. 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 731
  7. 2016The Mythos of Model Interpretabilitycited by 716
  8. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
  9. 2017Dynamic Routing Between Capsulescited by 689
  10. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  11. 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
  12. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
  13. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
  14. 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
  15. 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
  16. 2019Interpretable machine learning: definitions, methods, and applicationscited by 303
  17. 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 261
  18. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
  19. 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 243
  20. 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
  21. 2018Techniques for Interpretable Machine Learningcited by 237
  22. 2018Textual Explanations for Self-Driving Vehiclescited by 226
  23. 2020Concept Whitening for Interpretable Image Recognitioncited by 225
  24. 2020A Survey on the Explainability of Supervised Machine Learningcited by 225
  25. 2018Explainable Recommendation: A Survey and New Perspectivescited by 210
  26. 2020A Survey of the State of Explainable AI for Natural Language Processingcited by 206
  27. 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
  28. 2016Generating Visual Explanationscited by 156
  29. 2018Visual Interpretability for Deep Learning: a Surveycited by 155
  30. 2020Explainable Reinforcement Learning: A Surveycited by 139
  31. 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
  32. 2018Net2Vec: Quantifying and Explaining how Concepts are Encoded by Filters in Deep Neural Networkscited by 128
  33. 2020Explainable Deep Learning: A Field Guide for the Uninitiatedcited by 127
  34. 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
  35. 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
  36. 2020Explainable deep learning models in medical image analysiscited by 111
  37. 2017Interpretable Learning for Self-Driving Cars by Visualizing Causal Attentioncited by 106
  38. 2019Towards Explainable Artificial Intelligencecited by 106

50 most cited of 87 All 87 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 3; 2023: 19; 2024: 34; 2025: 24; 2026: 9.

90 papers.

Sort:

By area:

  1. 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
  2. 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
  3. 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
  4. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  5. 2024Evaluating Human-AI Collaboration: A Review and Methodological Frameworkcited by 25
  6. 2024Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agendacited by 22
  7. 2022What Makes a Good Explanation?: A Harmonized View of Properties of Explanationscited by 21
  8. 2023Pixel-Grounded Prototypical Part Networkscited by 18
  9. 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 17
  10. 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainabilitycited by 15
  11. 2023Explaining Deep Learning for ECG Analysis: Building Blocks for Auditing and Knowledge Discoverycited by 15
  12. 2025CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Surveycited by 15
38 more
  1. 2024Explainable Artificial Intelligence for Medical Applications: A Reviewcited by 12
  2. 2023Evaluating the Stability of Semantic Concept Representations in CNNs for Robust Explainabilitycited by 11
  3. 2024Explainable AI (XAI) in Image Segmentation in Medicine, Industry, and Beyond: A Surveycited by 11
  4. 2023Bridging the Transparency Gap: What Can Explainable AI Learn From the AI Act?cited by 10
  5. 2024Intrinsic User-Centric Interpretability through Global Mixture of Expertscited by 9
  6. 2024Causal Explanations for Image Classifierscited by 9
  7. 2025Probabilistic Stability Guarantees for Feature Attributionscited by 9
  8. 2024Explainable Bayesian Optimizationcited by 8
  9. 2024Comprehensible Artificial Intelligence on Knowledge Graphs: A surveycited by 8
  10. 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spacescited by 7
  11. 20233VL: Using Trees to Improve Vision-Language Models' Interpretabilitycited by 7
  12. 2024Unpacking Human-AI interactions: From interaction primitives to a design spacecited by 7
  13. 2024Post-hoc Part-prototype Networkscited by 7
  14. 2025Which LIME should I trust? Concepts, Challenges, and Solutionscited by 7
  15. 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
  16. 2024Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Modelscited by 6
  17. 2025Unboxing the Black Box: Mechanistic Interpretability for Algorithmic Understanding of Neural Networkscited by 6
  18. 2023The Effect of Balancing Methods on Model Behavior in Imbalanced Classification Problemscited by 5
  19. 2024Investigating Calibration and Corruption Robustness of Post-hoc Pruned Perception CNNs: An Image Classification Benchmark Studycited by 5
  20. 2022Towards Human-Interpretable Prototypes for Visual Assessment of Image Classification Modelscited by 4
  21. 2023Revealing Similar Semantics Inside CNNs: An Interpretable Concept-based Comparison of Feature Spacescited by 4
  22. 2023Identifying Drivers of Predictive Aleatoric Uncertaintycited by 4
  23. 2025Towards Human-Understandable Multi-Dimensional Concept Discoverycited by 4
  24. 2025Explainable AI-Based Interface System for Weather Forecasting Modelcited by 4
  25. 2023Extracting human interpretable structure-property relationships in chemistry using XAI and large language modelscited by 3
  26. 2024Engineering Trustworthy AI: A Developer Guide for Empirical Risk Minimizationcited by 3
  27. 2024Neuron Abandoning Attention Flow: Visual Explanation of Dynamics inside CNN Modelscited by 3
  28. 2025C-SHAP for time series: An approach to high-level temporal explanationscited by 3
  29. 2025On the Effectiveness of Methods and Metrics for Explainable AI in Remote Sensing Image Scene Classificationcited by 3
  30. 2022EVOTER: Evolution of Transparent Explainable Rule-setscited by 2
  31. 2023Automatic Textual Explanations of Concept Latticescited by 2
  32. 2023Explaining and visualizing black-box models through counterfactual pathscited by 2
  33. 2023Unsupervised discovery of Interpretable Visual Conceptscited by 2
  34. 2023How Well Do Feature-Additive Explainers Explain Feature-Additive Predictors?cited by 2
  35. 2024Multi-Excitation Projective Simulation with a Many-Body Physics Inspired Inductive Biascited by 2
  36. 2024People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior: Insights from Cognitive Science for Explainable AIcited by 2
  37. 2024Locally Testing Model Detections for Semantic Global Conceptscited by 2
  38. 2024On the Robustness of Global Feature Effect Explanationscited by 2

50 most cited of 90 All 90 (JSON)