Explainable Artificial Intelligence: a Systematic Review
Not on the map. Why?
Abstract (arXiv)
Explainable Artificial Intelligence (XAI) has experienced a significant growth over the last few years. This is due to the widespread application of machine learning, particularly deep learning, that has led to the development of highly accurate models but lack explainability and interpretability. A plethora of methods to tackle this problem have been proposed, developed and tested. This systematic review contributes to the body of knowledge by clustering these methods with a hierarchical classification system with four main clusters: review articles, theories and notions, methods and their evaluation. It also summarises the state-of-the-art in XAI and recommends future research directions.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 19; 2023: 14; 2024: 17; 2025: 5; 2026: 3.
79 papers.
Sort:
By area:
- 2023Large Language Model Alignment: A Surveycited by 241
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
- 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
- 2021A Review on Explainability in Multimodal Deep Neural Netscited by 46
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2021What to Learn, and How: Toward Effective Learning from Rationalescited by 25
- 2022Concept Embedding Analysis: A Reviewcited by 20
- 2021A Framework and Benchmarking Study for Counterfactual Generating Methods on Tabular Datacited by 19
38 more
- 2023Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterraneancited by 18
- 2022Lorentz group equivariant autoencoderscited by 15
- 2021XAI Handbook: Towards a Unified Framework for Explainable AIcited by 14
- 2021Explainability Is in the Mind of the Beholder: Establishing the Foundations of Explainable Artificial Intelligencecited by 13
- 2024Explainable Artificial Intelligence for Medical Applications: A Reviewcited by 12
- 2022Privacy Meets Explainability: A Comprehensive Impact Benchmarkcited by 9
- 2022Explainable Artificial Intelligence (XAI) for Internet of Things: A Surveycited by 8
- 2021Explainable AI and Adoption of Financial Algorithmic Advisors: an Experimental Studycited by 7
- 2022Explainable AI for High Energy Physicscited by 7
- 2022Towards trustworthy Energy Disaggregation: A review of challenges, methods and perspectives for Non-Intrusive Load Monitoringcited by 7
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spacescited by 7
- 2023Explainable Fraud Detection with Deep Symbolic Classificationcited by 7
- 2022A Detailed Study of Interpretability of Deep Neural Network based Top Taggerscited by 6
- 2024What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blockscited by 6
- 2024Advancing Explainable Autonomous Vehicle Systems: A Comprehensive Review and Research Roadmapcited by 6
- 2021A User-Centred Framework for Explainable Artificial Intelligence in Human-Robot Interactioncited by 5
- 2021Applications of Explainable AI for 6G: Technical Aspects, Use Cases, and Research Challengescited by 5
- 2022Explainable Misinformation Detection Across Multiple Social Media Platformscited by 5
- 2024How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Surveycited by 5
- 2021Explanatory Pluralism in Explainable AIcited by 4
- 2022The Roles and Modes of Human Interactions with Automated Machine Learning Systemscited by 4
- 2022FAIR AI Models in High Energy Physicscited by 4
- 2023Robust Ante-hoc Graph Explainer using Bilevel Optimizationcited by 4
- 2023Identifying Drivers of Predictive Aleatoric Uncertaintycited by 4
- 2024Pantypes: Diverse Representatives for Self-Explainable Modelscited by 4
- 2024Enhancing Robot Explanation Capabilities through Vision-Language Models: a Preliminary Study by Interpreting Visual Inputs for Improved Human-Robot Interactioncited by 4
- 2023Interpretable Alzheimer's Disease Classification Via a Contrastive Diffusion Autoencodercited by 3
- 2025Evidential Deep Learning for Uncertainty Quantification and Out-of-Distribution Detection in Jet Identification using Deep Neural Networkscited by 3
- 2021Toward Affective XAI: Facial Affect Analysis for Understanding Explainable Human-AI Interactionscited by 2
- 2021Instructive artificial intelligence (AI) for human training, assistance, and explainabilitycited by 2
- 2021Explaining Face Presentation Attack Detection Using Natural Languagecited by 2
- 2022Multi-Fault Diagnosis Of Industrial Rotating Machines Using Data-Driven Approach: A Review Of Two Decades Of Researchcited by 2
- 2022Responsibility: An Example-based Explainable AI approach via Training Process Inspectioncited by 2
- 2022Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directionscited by 2
- 2023A Voting Approach for Explainable Classification with Rule Learningcited by 2
- 2024XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniquescited by 2
- 2024Let the Fuzzy Rule Speak: Enhancing In-context Learning Debiasing with Interpretabilitycited by 2
- 2021How to Explain Neural Networks: an Approximation Perspectivecited by 1
50 most cited of 79 All 79 (JSON)
- 2026Evaluating XAI Support From A Hierarchical Reinforcement Learning Policy in Human-Agent Collaboration9 Jun 2026
- 2026XtrAIn: Training-Guided Occlusion for Feature Attribution9 Jun 2026
- 2026Explainability Methods for Hardware Trojan Detection: A Systematic Comparison26 Jan 2026
- 2025Interpretable by Design: MH-AutoML for Transparent and Efficient Android Malware Detection without Compromising Performance29 Jun 2025
- 2025Sampling Preferences Yields Simple Trustworthiness Scores3 Jun 2025
- 2025Beyond Patches: Mining Interpretable Part-Prototypes for Explainable AI16 Apr 2025
- 2025Human-centered explanation does not fit all: The interplay of sociotechnical, cognitive, and individual factors in the effect AI explanations in algorithmic decision-making17 Feb 2025
- 2025Evidential Deep Learning for Uncertainty Quantification and Out-of-Distribution Detection in Jet Identification using Deep Neural Networks10 Jan 2025
- 2024Let the Fuzzy Rule Speak: Enhancing In-context Learning Debiasing with Interpretability26 Dec 2024
- 2024Explainable Artificial Intelligence for Medical Applications: A Review15 Nov 2024
- 2024Explainability in AI Based Applications: A Framework for Comparing Different Techniques28 Oct 2024
- 2024Assistive AI for Augmenting Human Decision-making18 Oct 2024
38 more
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
- 2024DeepCodeProbe: Towards Understanding What Models Trained on Code Learn11 Jul 2024
- 2024Empowering Prior to Court Legal Analysis: A Transparent and Accessible Dataset for Defensive Statement Classification and Interpretation17 May 2024
- 2024Implementation and Evaluation of a Gradient Descent-Trained Defensible Blackboard Architecture System17 Apr 2024
- 2024Enhancing Robot Explanation Capabilities through Vision-Language Models: a Preliminary Study by Interpreting Visual Inputs for Improved Human-Robot Interaction15 Apr 2024
- 2024How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey21 Mar 2024
- 2024Advancing Explainable Autonomous Vehicle Systems: A Comprehensive Review and Research Roadmap19 Mar 2024
- 2024What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blocks19 Mar 2024
- 2024Pantypes: Diverse Representatives for Self-Explainable Models14 Mar 2024
- 2024XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniques20 Feb 2024
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review8 Feb 2024
- 2024XAI-CF -- Examining the Role of Explainable Artificial Intelligence in Cyber Forensics4 Feb 2024
- 2024The twin peaks of learning neural networks23 Jan 2024
- 2023Rule-Extraction Methods From Feedforward Neural Networks: A Systematic Literature Review20 Dec 2023
- 2023Identifying Drivers of Predictive Aleatoric Uncertainty12 Dec 2023
- 2023Explainable Fraud Detection with Deep Symbolic Classification1 Dec 2023
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spaces24 Nov 2023
- 2023A Voting Approach for Explainable Classification with Rule Learning13 Nov 2023
- 2023Large Language Model Alignment: A Survey26 Sep 2023
- 2023A 3D deep learning classifier and its explainability when assessing coronary artery disease29 Jul 2023
- 2023Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterranean8 Jun 2023
- 2023Interpretable Alzheimer's Disease Classification Via a Contrastive Diffusion Autoencoder5 Jun 2023
- 2023Evaluating Machine Learning Models with NERO: Non-Equivariance Revealed on Orbits31 May 2023
- 2023Robust Ante-hoc Graph Explainer using Bilevel Optimization25 May 2023
- 2023P-NOC: adversarial training of CAM generating networks for robust weakly supervised semantic segmentation priors21 May 2023
- 2023A System's Approach Taxonomy for User-Centred XAI: A Survey6 Mar 2023
- 2023Multi-Layer Attention-Based Explainability via Transformers for Tabular Data28 Feb 2023
- 2022Rule Learning by Modularity23 Dec 2022
- 2022Lorentz group equivariant autoencoders14 Dec 2022
- 2022Artificial intelligence technologies to support research assessment: A review11 Dec 2022
- 2022FAIR AI Models in High Energy Physics9 Dec 2022
- 2022Privacy Meets Explainability: A Comprehensive Impact Benchmark8 Nov 2022
- 2022Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directions2 Nov 2022
- 2022Understanding Adverse Biological Effect Predictions Using Knowledge Graphs28 Oct 2022
- 2022A Detailed Study of Interpretability of Deep Neural Network based Top Taggers9 Oct 2022
- 2022Responsibility: An Example-based Explainable AI approach via Training Process Inspection7 Sep 2022
- 2022Towards trustworthy Energy Disaggregation: A review of challenges, methods and perspectives for Non-Intrusive Load Monitoring5 Jul 2022
- 2022Automating the Design and Development of Gradient Descent Trained Expert System Networks4 Jul 2022
50 newest of 79 All 79 (JSON)
- 2023Large Language Model Alignment: A Surveycited by 241
- 2023Large Language Model Alignment: A Survey26 Sep 2023
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
- 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
- 2021A Review on Explainability in Multimodal Deep Neural Netscited by 46
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2021What to Learn, and How: Toward Effective Learning from Rationalescited by 25
- 2022Concept Embedding Analysis: A Reviewcited by 20
- 2021A Framework and Benchmarking Study for Counterfactual Generating Methods on Tabular Datacited by 19
- 2023Mesogeos: A multi-purpose dataset for data-driven wildfire modeling in the Mediterraneancited by 18
- 2022Lorentz group equivariant autoencoderscited by 15
12 most cited of 76 All 76 (JSON)
- 2026Evaluating XAI Support From A Hierarchical Reinforcement Learning Policy in Human-Agent Collaboration9 Jun 2026
- 2026XtrAIn: Training-Guided Occlusion for Feature Attribution9 Jun 2026
- 2026Explainability Methods for Hardware Trojan Detection: A Systematic Comparison26 Jan 2026
- 2025Interpretable by Design: MH-AutoML for Transparent and Efficient Android Malware Detection without Compromising Performance29 Jun 2025
- 2025Sampling Preferences Yields Simple Trustworthiness Scores3 Jun 2025
- 2025Beyond Patches: Mining Interpretable Part-Prototypes for Explainable AI16 Apr 2025
- 2025Human-centered explanation does not fit all: The interplay of sociotechnical, cognitive, and individual factors in the effect AI explanations in algorithmic decision-making17 Feb 2025
- 2025Evidential Deep Learning for Uncertainty Quantification and Out-of-Distribution Detection in Jet Identification using Deep Neural Networks10 Jan 2025
- 2024Let the Fuzzy Rule Speak: Enhancing In-context Learning Debiasing with Interpretability26 Dec 2024
- 2024Explainable Artificial Intelligence for Medical Applications: A Review15 Nov 2024
- 2024Explainability in AI Based Applications: A Framework for Comparing Different Techniques28 Oct 2024
- 2024Assistive AI for Augmenting Human Decision-making18 Oct 2024
12 newest of 76 All 76 (JSON)