Reviewing the Need for Explainable Artificial Intelligence (xAI)
Not on the map. Why?
Abstract (arXiv)
The diffusion of artificial intelligence (AI) applications in organizations and society has fueled research on explaining AI decisions. The explainable AI (xAI) field is rapidly expanding with numerous ways of extracting information and visualizing the output of AI technologies (e.g. deep neural networks). Yet, we have a limited understanding of how xAI research addresses the need for explainable AI. We conduct a systematic review of xAI literature on the topic and identify four thematic debates central to how xAI addresses the black-box problem. Based on this critical analysis of the xAI scholarship we synthesize the findings into a future research agenda to further the xAI body of knowledge.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 10; 2023: 6; 2024: 8; 2025: 2; 2026: 1.
29 papers.
Sort:
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future researchcited by 20
- 2022Explainability in reinforcement learning: perspective and positioncited by 11
- 2022XAI for Cybersecurity: State of the Art, Challenges, Open Issues and Future Directionscited by 10
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Futurecited by 9
- 2023On the Impact of Knowledge Distillation for Model Interpretabilitycited by 8
- 2022Quality Diversity Evolutionary Learning of Decision Treescited by 7
- 2021Exploring Explainable AI in the Financial Sector: Perspectives of Banks and Supervisory Authoritiescited by 5
- 2022Improving Interpretability via Regularization of Neural Activation Sensitivitycited by 5
- 2022Painting the black box white: experimental findings from applying XAI to an ECG reading settingcited by 4
- 2024Explaining Decisions of Agents in Mixed-Motive Gamescited by 4
- 2022On the Relationship Between Explanations, Fairness Perceptions, and Decisionscited by 3
- 2024Cultural Bias in Explainable AI Research: A Systematic Analysiscited by 3
17 more
- 2022Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directionscited by 2
- 2023Beyond Single-Feature Importance with ICECREAMcited by 2
- 2022Machine Learning in Transaction Monitoring: The Prospect of xAIcited by 1
- 2023Understanding User Preferences in Explainable Artificial Intelligence: A Survey and a Mapping Function Proposalcited by 1
- 2023Requirements for Explainability and Acceptance of Artificial Intelligence in Collaborative Workcited by 1
- 2023QXAI: Explainable AI Framework for Quantitative Analysis in Patient Monitoring Systemscited by 1
- 2024Graph Neural Network and NER-Based Text Summarizationcited by 1
- 2024Why Reinforcement Learning in Energy Systems Needs Explanationscited by 1
- 2025Measuring the (Un)Faithfulness of Concept-Based Explanationscited by 1
- 2021Abstraction, Validation, and Generalization for Explainable Artificial Intelligencecited by 0
- 2022Explainable Artificial Intelligence in Construction: The Content, Context, Process, Outcome Evaluation Frameworkcited by 0
- 2023Notion of Explainable Artificial Intelligence -- An Empirical Investigation from A Users Perspectivecited by 0
- 2024Fuzzy Logic Function as a Post-hoc Explanator of the Nonlinear Classifiercited by 0
- 2024Influence based explainability of brain tumors segmentation in multimodal Magnetic Resonance Imagingcited by 0
- 2024The Literature Review Network: An Explainable Artificial Intelligence for Systematic Literature Reviews, Meta-analyses, and Method Developmentcited by 0
- 2025A Framework for Causal Concept-based Model Explanationscited by 0
- 2026Explainable Data-driven Deep Reinforcement Learning Methods for Optimal Energy Management in Buildingscited by 0
- 2026Explainable Data-driven Deep Reinforcement Learning Methods for Optimal Energy Management in Buildings1 Jun 2026
- 2025A Framework for Causal Concept-based Model Explanations2 Dec 2025
- 2025Measuring the (Un)Faithfulness of Concept-Based Explanations15 Apr 2025
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Future18 Dec 2024
- 2024The Literature Review Network: An Explainable Artificial Intelligence for Systematic Literature Reviews, Meta-analyses, and Method Development5 Aug 2024
- 2024Explaining Decisions of Agents in Mixed-Motive Games21 Jul 2024
- 2024Why Reinforcement Learning in Energy Systems Needs Explanations29 May 2024
- 2024Influence based explainability of brain tumors segmentation in multimodal Magnetic Resonance Imaging5 Apr 2024
- 2024Cultural Bias in Explainable AI Research: A Systematic Analysis28 Feb 2024
- 2024Graph Neural Network and NER-Based Text Summarization5 Feb 2024
- 2024Fuzzy Logic Function as a Post-hoc Explanator of the Nonlinear Classifier22 Jan 2024
- 2023Notion of Explainable Artificial Intelligence -- An Empirical Investigation from A Users Perspective1 Nov 2023
17 more
- 2023QXAI: Explainable AI Framework for Quantitative Analysis in Patient Monitoring Systems19 Sep 2023
- 2023Beyond Single-Feature Importance with ICECREAM19 Jul 2023
- 2023Requirements for Explainability and Acceptance of Artificial Intelligence in Collaborative Work27 Jun 2023
- 2023On the Impact of Knowledge Distillation for Model Interpretability25 May 2023
- 2023Understanding User Preferences in Explainable Artificial Intelligence: A Survey and a Mapping Function Proposal7 Feb 2023
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future research24 Nov 2022
- 2022Improving Interpretability via Regularization of Neural Activation Sensitivity16 Nov 2022
- 2022Explainable Artificial Intelligence in Construction: The Content, Context, Process, Outcome Evaluation Framework12 Nov 2022
- 2022Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directions2 Nov 2022
- 2022Painting the black box white: experimental findings from applying XAI to an ECG reading setting27 Oct 2022
- 2022Machine Learning in Transaction Monitoring: The Prospect of xAI14 Oct 2022
- 2022Quality Diversity Evolutionary Learning of Decision Trees17 Aug 2022
- 2022XAI for Cybersecurity: State of the Art, Challenges, Open Issues and Future Directions3 Jun 2022
- 2022On the Relationship Between Explanations, Fairness Perceptions, and Decisions27 Apr 2022
- 2022Explainability in reinforcement learning: perspective and position22 Mar 2022
- 2021Exploring Explainable AI in the Financial Sector: Perspectives of Banks and Supervisory Authorities3 Nov 2021
- 2021Abstraction, Validation, and Generalization for Explainable Artificial Intelligence16 May 2021
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future researchcited by 20
- 2022Explainability in reinforcement learning: perspective and positioncited by 11
- 2022XAI for Cybersecurity: State of the Art, Challenges, Open Issues and Future Directionscited by 10
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Futurecited by 9
- 2023On the Impact of Knowledge Distillation for Model Interpretabilitycited by 8
- 2022Quality Diversity Evolutionary Learning of Decision Treescited by 7
- 2021Exploring Explainable AI in the Financial Sector: Perspectives of Banks and Supervisory Authoritiescited by 5
- 2022Improving Interpretability via Regularization of Neural Activation Sensitivitycited by 5
- 2022Painting the black box white: experimental findings from applying XAI to an ECG reading settingcited by 4
- 2024Explaining Decisions of Agents in Mixed-Motive Gamescited by 4
- 2022On the Relationship Between Explanations, Fairness Perceptions, and Decisionscited by 3
- 2024Cultural Bias in Explainable AI Research: A Systematic Analysiscited by 3
12 most cited of 29 All 29 (JSON)
- 2026Explainable Data-driven Deep Reinforcement Learning Methods for Optimal Energy Management in Buildings1 Jun 2026
- 2025A Framework for Causal Concept-based Model Explanations2 Dec 2025
- 2025Measuring the (Un)Faithfulness of Concept-Based Explanations15 Apr 2025
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Future18 Dec 2024
- 2024The Literature Review Network: An Explainable Artificial Intelligence for Systematic Literature Reviews, Meta-analyses, and Method Development5 Aug 2024
- 2024Explaining Decisions of Agents in Mixed-Motive Games21 Jul 2024
- 2024Why Reinforcement Learning in Energy Systems Needs Explanations29 May 2024
- 2024Influence based explainability of brain tumors segmentation in multimodal Magnetic Resonance Imaging5 Apr 2024
- 2024Cultural Bias in Explainable AI Research: A Systematic Analysis28 Feb 2024
- 2024Graph Neural Network and NER-Based Text Summarization5 Feb 2024
- 2024Fuzzy Logic Function as a Post-hoc Explanator of the Nonlinear Classifier22 Jan 2024
- 2023Notion of Explainable Artificial Intelligence -- An Empirical Investigation from A Users Perspective1 Nov 2023
12 newest of 29 All 29 (JSON)