Towards Explainable Artificial Intelligence
Not on the map. Why?
Abstract (arXiv)
In recent years, machine learning (ML) has become a key enabling technology for the sciences and industry. Especially through improvements in methodology, the availability of large databases and increased computational power, today's ML algorithms are able to achieve excellent performance (at times even exceeding the human level) on an increasing number of complex tasks. Deep learning models are at the forefront of this development. However, due to their nested non-linear structure, these powerful models have been generally considered "black boxes", not providing any information about what exactly makes them arrive at their predictions. Since in many applications, e.g., in the medical domain, such lack of transparency may be not acceptable, the development of methods for visualizing, explaining and interpreting deep learning models has recently attracted increasing attention. This introductory paper presents recent developments and applications in this field and makes a plea for a wider use of explainable learning algorithms in practice.
Key facts. Cited by 106 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 24; 2023: 23; 2024: 17; 2025: 13; 2026: 5.
106 papers.
Sort:
By area:
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 75
- 2021This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networkscited by 65
- 2023Backdoor Attacks and Defenses in Federated Learning: Survey, Challenges and Future Research Directionscited by 33
- 2024A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applicationscited by 25
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2021Focus! Rating XAI Methods and Finding Biasescited by 20
- 2022On Computing Probabilistic Abductive Explanationscited by 18
- 2023XAIR: A Framework of Explainable AI in Augmented Realitycited by 17
38 more
- 2024CoSy: Evaluating Textual Explanations of Neuronscited by 17
- 2023Delivering Inflated Explanationscited by 16
- 2024IFViT: Interpretable Fixed-Length Representation for Fingerprint Matching via Vision Transformercited by 16
- 2022Assessing the communication gap between AI models and healthcare professionals: explainability, utility and trust in AI-driven clinical decision-makingcited by 14
- 2022Explainable AI via Learning to Optimizecited by 14
- 2023Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UKcited by 13
- 2023A Review of ChatGPT Applications in Education, Marketing, Software Engineering, and Healthcare: Benefits, Drawbacks, and Research Directionscited by 12
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'ancited by 12
- 2022Human-Centric Artificial Intelligence Architecture for Industry 5.0 Applicationscited by 11
- 2021Tracing Back Music Emotion Predictions to Sound Sources and Intuitive Perceptual Qualitiescited by 9
- 2021Efficient Explanations for Knowledge Compilation Languagescited by 9
- 2021How to choose an Explainability Method? Towards a Methodical Implementation of XAI in Practicecited by 9
- 2022From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathologycited by 9
- 2024XAI-Based Detection of Adversarial Attacks on Deepfake Detectorscited by 9
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunitiescited by 8
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depressioncited by 8
- 2024Generative AI and Process Systems Engineering: The Next Frontiercited by 8
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2022Neural network fragile watermarking with no model performance degradationcited by 7
- 2023Interpretable Machine Learning for Discovery: Statistical Challenges & Opportunitiescited by 7
- 2021Versatile modular neural locomotion control with fast learningcited by 6
- 2024Enabling MCTS Explainability for Sequential Planning Through Computation Tree Logiccited by 6
- 2024SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generationcited by 6
- 2021Applications of Explainable AI for 6G: Technical Aspects, Use Cases, and Research Challengescited by 5
- 2022A systematic review of biologically-informed deep learning models for cancer: fundamental trends for encoding and interpreting oncology datacited by 5
- 2022On Computing Relevant Features for Explaining NBCscited by 5
- 2022PAGE: Prototype-Based Model-Level Explanations for Graph Neural Networkscited by 5
- 2023Human-Centered Evaluation of XAI Methodscited by 5
- 2024Unifying Perspectives: Plausible Counterfactual Explanations on Global, Group-wise, and Local Levelscited by 5
- 2021Jane Jacobs in the Sky: Predicting Urban Vitality with Open Satellite Datacited by 4
- 2021Contrastive Explanations for Argumentation-Based Conclusionscited by 4
- 2021Subtyping patients with chronic disease using longitudinal BMI patternscited by 4
- 2022Towards Human-Interpretable Prototypes for Visual Assessment of Image Classification Modelscited by 4
- 2023Fixed-kinetic Neural Hamiltonian Flows for enhanced interpretability and reduced complexitycited by 4
- 2023The Problem of Coherence in Natural Language Explanations of Recommendationscited by 4
- 2024Explainable AI needs formalizationcited by 4
- 2021A Taxonomy of Explainable Bayesian Networkscited by 3
50 most cited of 106 All 106 (JSON)
- 2026On the Disagreement in Perturbation-based xAI -- Benchmarking Perturbation Choices for Flood Detection from SAR Images16 Jul 2026
- 2026Generalizing Logic-based Explanations for Machine Learning Classifiers via Optimization2 Mar 2026
- 2026cc-Shapley: Measuring Multivariate Feature Importance Needs Causal Context23 Feb 2026
- 2026Community Concealment from Graph Neural Networks12 Feb 2026
- 2026xDNN(ASP): Explanation Generation System for Deep Neural Networks powered by Answer Set Programming7 Jan 2026
- 2025Rethinking Saliency Maps: A Cognitive Human Aligned Taxonomy and Evaluation Framework for Explanations17 Nov 2025
- 2025Explainable Deep Learning-based Classification of Wolff-Parkinson-White Electrocardiographic Signals8 Nov 2025
- 2025Embedding Explainable AI in NHS Clinical Safety: The Explainability-Enabled Clinical Safety Framework (ECSF)24 Oct 2025
- 2025Restricted Receptive Fields for Face Verification12 Oct 2025
- 2025Concise and Sufficient Sub-Sentence Citations for Retrieval-Augmented Generation25 Sep 2025
- 2025Database Views as Explanations for Relational Deep Learning11 Sep 2025
- 2025Exploiting Constraint Reasoning to Build Graphical Explanations for Mixed-Integer Linear Programming17 Jul 2025
38 more
- 2025Aggregating Local Saliency Maps for Semi-Global Explainable Image Classification29 Jun 2025
- 2025Transparency Techniques for Neural Networks trained on Writer Identification and Writer Verification19 Jun 2025
- 2025PiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis12 Jun 2025
- 2025Minimizing False-Positive Attributions in Explanations of Non-Linear Models16 May 2025
- 2025What Do People Want to Know About Artificial Intelligence (AI)? The Importance of Answering End-User Questions to Explain Autonomous Vehicle (AV) Decisions9 May 2025
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Review16 Feb 2025
- 2024Neural network interpretability with layer-wise relevance propagation: novel techniques for neuron selection and visualization7 Dec 2024
- 2024SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generation3 Nov 2024
- 2024Explainable AI needs formalization22 Sep 2024
- 2024A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applications2 Aug 2024
- 2024Enabling MCTS Explainability for Sequential Planning Through Computation Tree Logic15 Jul 2024
- 2024Explainable bank failure prediction models: Counterfactual explanations to reduce the failure risk14 Jul 2024
- 2024Directly Handling Missing Data in Linear Discriminant Analysis for Enhancing Classification Accuracy and Interpretability30 Jun 2024
- 2024Standardness Clouds Meaning: A Position Regarding the Informed Usage of Standard Datasets19 Jun 2024
- 2024Linguistic Fingerprint in Transformer Models: How Language Variation Influences Parameter Selection in Irony Detection4 Jun 2024
- 2024CoSy: Evaluating Textual Explanations of Neurons30 May 2024
- 2024Unifying Perspectives: Plausible Counterfactual Explanations on Global, Group-wise, and Local Levels27 May 2024
- 2024IFViT: Interpretable Fixed-Length Representation for Fingerprint Matching via Vision Transformer12 Apr 2024
- 2024Enhancing Interpretability of Vertebrae Fracture Grading using Human-interpretable Prototypes3 Apr 2024
- 2024"It is there, and you need it, so why do you not use it?" Achieving better adoption of AI systems by domain experts, in the case study of natural science research25 Mar 2024
- 2024The Anatomy of Adversarial Attacks: Concept-based XAI Dissection25 Mar 2024
- 2024XAI-Based Detection of Adversarial Attacks on Deepfake Detectors5 Mar 2024
- 2024Generative AI and Process Systems Engineering: The Next Frontier15 Feb 2024
- 2023The Problem of Coherence in Natural Language Explanations of Recommendations18 Dec 2023
- 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'an5 Dec 2023
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression23 Nov 2023
- 2023Notion of Explainable Artificial Intelligence -- An Empirical Investigation from A Users Perspective1 Nov 2023
- 2023Human-Centered Evaluation of XAI Methods11 Oct 2023
- 2023Fair Feature Importance Scores for Interpreting Tree-Based Methods and Surrogates6 Oct 2023
- 2023A Framework for Data-Driven Explainability in Mathematical Optimization16 Aug 2023
- 2023Interpretable Machine Learning for Discovery: Statistical Challenges & Opportunities2 Aug 2023
- 2023Two Approaches to Supervised Image Segmentation19 Jul 2023
- 2023A User Study on Explainable Online Reinforcement Learning for Adaptive Systems9 Jul 2023
- 2023Delivering Inflated Explanations27 Jun 2023
- 2023Towards Regulatable AI Systems: Technical Gaps and Policy Opportunities22 Jun 2023
- 2023Disproving XAI Myths with Formal Methods -- Initial Results13 May 2023
- 2023Why Don't You Do Something About It? Outlining Connections between AI Explanations and User Actions10 May 2023
- 2023A Review of ChatGPT Applications in Education, Marketing, Software Engineering, and Healthcare: Benefits, Drawbacks, and Research Directions29 Apr 2023
50 newest of 106 All 106 (JSON)
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 75
- 2021This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networkscited by 65
- 2023Backdoor Attacks and Defenses in Federated Learning: Survey, Challenges and Future Research Directionscited by 33
- 2024A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applicationscited by 25
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2021Focus! Rating XAI Methods and Finding Biasescited by 20
- 2022On Computing Probabilistic Abductive Explanationscited by 18
- 2023XAIR: A Framework of Explainable AI in Augmented Realitycited by 17
12 most cited of 104 All 104 (JSON)
- 2026On the Disagreement in Perturbation-based xAI -- Benchmarking Perturbation Choices for Flood Detection from SAR Images16 Jul 2026
- 2026Generalizing Logic-based Explanations for Machine Learning Classifiers via Optimization2 Mar 2026
- 2026cc-Shapley: Measuring Multivariate Feature Importance Needs Causal Context23 Feb 2026
- 2026Community Concealment from Graph Neural Networks12 Feb 2026
- 2026xDNN(ASP): Explanation Generation System for Deep Neural Networks powered by Answer Set Programming7 Jan 2026
- 2025Rethinking Saliency Maps: A Cognitive Human Aligned Taxonomy and Evaluation Framework for Explanations17 Nov 2025
- 2025Explainable Deep Learning-based Classification of Wolff-Parkinson-White Electrocardiographic Signals8 Nov 2025
- 2025Embedding Explainable AI in NHS Clinical Safety: The Explainability-Enabled Clinical Safety Framework (ECSF)24 Oct 2025
- 2025Restricted Receptive Fields for Face Verification12 Oct 2025
- 2025Database Views as Explanations for Relational Deep Learning11 Sep 2025
- 2025Exploiting Constraint Reasoning to Build Graphical Explanations for Mixed-Integer Linear Programming17 Jul 2025
- 2025Aggregating Local Saliency Maps for Semi-Global Explainable Image Classification29 Jun 2025
12 newest of 104 All 104 (JSON)