mlsanityData to 7 Oct 2026

Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models

arXiv 1708.08296 ↗First posted 28 Aug 2017cs.AI cs.CY cs.NEcited by 202

Not on the map. Why?

Abstract (arXiv)

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this development can be found in domains such as image classification, sentiment analysis, speech understanding or strategic game playing. However, because of their nested non-linear structure, these highly successful machine learning and artificial intelligence models are usually applied in a black box manner, i.e., no information is provided about what exactly makes them arrive at their predictions. Since this lack of transparency can be a major drawback, e.g., in medical applications, the development of methods for visualizing, explaining and interpreting deep learning models has recently attracted increasing attention. This paper summarizes recent developments in this field and makes a plea for more interpretability in artificial intelligence. Furthermore, it presents two approaches to explaining predictions of deep learning models, one method which computes the sensitivity of the prediction with respect to changes in the input and one approach which meaningfully decomposes the decision in terms of the input variables. These methods are evaluated on three classification tasks.

Key facts. Cited by 202 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Aug 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 2; 2021: 37; 2022: 53; 2023: 36; 2024: 26; 2025: 34; 2026: 14.

202 papers.

Sort:

By area:

  1. 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
  2. 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
  3. 2021Explanations in Autonomous Driving: A Surveycited by 80
  4. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  5. 2021Evaluating Robustness of Counterfactual Explanationscited by 41
  6. 2021Explainable Artificial Intelligence Approaches: A Surveycited by 40
  7. 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directionscited by 34
  8. 2024Gradient based Feature Attribution in Explainable AI: A Technical Reviewcited by 34
  9. 2024Backward Lens: Projecting Language Model Gradients into the Vocabulary Spacecited by 30
  10. 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
  11. 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
  12. 2022WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Valuescited by 24
38 more
  1. 2025Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Modelscited by 23
  2. 2022The Role of Machine Learning in Cybersecuritycited by 21
  3. 2022Machine Learning Security in Industry: A Quantitative Surveycited by 21
  4. 2021A Framework and Benchmarking Study for Counterfactual Generating Methods on Tabular Datacited by 19
  5. 2022Learning When to Advise Human Decision Makerscited by 18
  6. 2022Interpreting Unfairness in Graph Neural Networks via Training Node Attributioncited by 18
  7. 2023XAIR: A Framework of Explainable AI in Augmented Realitycited by 17
  8. 2021Can Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AIcited by 16
  9. 2022Attribution-based XAI Methods in Computer Vision: A Reviewcited by 16
  10. 2021Explainable Autonomous Robots: A Survey and Perspectivecited by 15
  11. 2022Towards Explainable Evaluation Metrics for Natural Language Generationcited by 15
  12. 2023Towards Explainable Evaluation Metrics for Machine Translationcited by 15
  13. 2021A Survey on Understanding, Visualizations, and Explanation of Deep Neural Networkscited by 14
  14. 2021Explainable Machine Learning with Prior Knowledge: An Overviewcited by 14
  15. 2021Explainable Artificial Intelligence for Human Decision-Support System in Medical Domaincited by 12
  16. 2024Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithmscited by 12
  17. 2021Expressive Explanations of DNNs by Combining Concept Analysis with ILPcited by 11
  18. 2021Unifying Model Explainability and Robustness for Joint Text Classification and Rationale Extractioncited by 11
  19. 2021Interpretable Approximation of High-Dimensional Datacited by 10
  20. 2022A Measure of the Complexity of Neural Representations based on Partial Information Decompositioncited by 10
  21. 2022SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevancecited by 9
  22. 2022Causality-Inspired Taxonomy for Explainable Artificial Intelligencecited by 9
  23. 2022Symbolic Visual Reinforcement Learning: A Scalable Framework with Object-Level Abstraction and Differentiable Expression Searchcited by 9
  24. 2023Concept Distillation: Leveraging Human-Centered Explanations for Model Improvementcited by 9
  25. 2025Artificial intelligence for representing and characterizing quantum systemscited by 9
  26. 2021Interpreting Deep Learning based Cerebral Palsy Prediction with Channel Attentioncited by 8
  27. 2021Generating Contrastive Explanations for Inductive Logic Programming Based on a Near Miss Approachcited by 8
  28. 2022Scenario-Assisted Deep Reinforcement Learningcited by 8
  29. 2022Explainable Artificial Intelligence (XAI) for Internet of Things: A Surveycited by 8
  30. 2022Ask to Know More: Generating Counterfactual Explanations for Fake Claimscited by 8
  31. 2022Generating and Detecting True Ambiguity: A Forgotten Danger in DNN Supervision Testingcited by 8
  32. 2023A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functionscited by 8
  33. 2023An Attribution Method for Siamese Encoderscited by 8
  34. 2024KAN You See It? KANs and Sentinel for Effective and Explainable Crop Field Segmentationcited by 8
  35. 2024Bridging Interpretability and Robustness Using LIME-Guided Model Refinementcited by 8
  36. 2021Feature selection revisited in the single-cell eracited by 7
  37. 2022Explaining Reject Options of Learning Vector Quantization Classifierscited by 7
  38. 2022Explain to Not Forget: Defending Against Catastrophic Forgetting with XAIcited by 7

50 most cited of 202 All 202 (JSON)