Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI
Not on the map. Why?
Abstract (arXiv)
This is an integrative review that address the question, "What makes for a good explanation?" with reference to AI systems. Pertinent literatures are vast. Thus, this review is necessarily selective. That said, most of the key concepts and issues are expressed in this Report. The Report encapsulates the history of computer science efforts to create systems that explain and instruct (intelligent tutoring systems and expert systems). The Report expresses the explainability issues and challenges in modern AI, and presents capsule views of the leading psychological theories of explanation. Certain articles stand out by virtue of their particular relevance to XAI, and their methods, results, and key points are highlighted. It is recommended that AI/XAI researchers be encouraged to include in their research reports fuller details on their empirical or experimental methods, in the fashion of experimental psychology research reports: details on Participants, Instructions, Procedures, Tasks, Dependent Variables (operational definitions of the measures and metrics), Independent Variables (conditions), and Control Conditions.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 7; 2023: 16; 2024: 12; 2025: 7; 2026: 2.
63 papers.
Sort:
By area:
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
- 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision supportcited by 65
- 2021Explainable Artificial Intelligence Approaches: A Surveycited by 40
- 2022Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AIcited by 40
- 2021Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AIcited by 38
- 2021Principles of Explanation in Human-AI Systemscited by 25
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2023Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Makingcited by 18
- 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
38 more
- 2021Contrastive Explanations of Plans Through Model Restrictionscited by 16
- 2021A Survey on AI Assurancecited by 16
- 2023Calibrated Explanations: with Uncertainty Information and Counterfactualscited by 16
- 2022ECLAD: Extracting Concepts with Local Aggregated Descriptorscited by 15
- 2025Artificial Intelligence Should Genuinely Support Clinical Reasoning and Decision Making To Bridge the Translational Gapcited by 13
- 2022Counterfactual Explanations for Misclassified Images: How Human and Machine Explanations Differcited by 12
- 2023A Comprehensive Review on Financial Explainable AIcited by 10
- 2021Efficient Explanations for Knowledge Compilation Languagescited by 9
- 2022A Meta Survey of Quality Evaluation Criteria in Explanation Methodscited by 8
- 2024Towards Unifying Evaluation of Counterfactual Explanations: Leveraging Large Language Models for Human-Centric Assessmentscited by 8
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2022A Theoretical Framework for AI Models Explainability with Application in Biomedicinecited by 7
- 2023Mind the Gap! Bridging Explainable Artificial Intelligence and Human Understanding with Luhmann's Functional Theory of Communicationcited by 7
- 2024Interactive Prompt Debugging with Sequence Saliencecited by 6
- 2024Why do explanations fail? A typology and discussion on failures in XAIcited by 6
- 2021Exploring Explainable AI in the Financial Sector: Perspectives of Banks and Supervisory Authoritiescited by 5
- 2021Applications of Explainable AI for 6G: Technical Aspects, Use Cases, and Research Challengescited by 5
- 2023Explainable AI And Visual Reasoning: Insights From Radiologycited by 5
- 2023A New Perspective on Evaluation Methods for Explainable Artificial Intelligence (XAI)cited by 5
- 2023Calibrated Explanations for Regressioncited by 5
- 2021Making Things Explainable vs Explaining: Requirements and Challenges under the GDPRcited by 4
- 2023Explainable Predictive Maintenancecited by 3
- 2024Information That Matters: Exploring Information Needs of People Affected by Algorithmic Decisionscited by 3
- 2024Cultural Bias in Explainable AI Research: A Systematic Analysiscited by 3
- 2022Explanation as Question Answering based on a Task Model of the Agent's Designcited by 2
- 2023Explaining Deep Learning Hidden Neuron Activations using Concept Inductioncited by 2
- 2023Automatic Textual Explanations of Concept Latticescited by 2
- 2024Leveraging Large Language Models for Hybrid Workplace Decision Supportcited by 2
- 2021Using Psychological Characteristics of Situations for Social Situation Comprehension in Support Agentscited by 1
- 2021Explanation as Question Answering based on Design Knowledgecited by 1
- 2024XAI-CF -- Examining the Role of Explainable Artificial Intelligence in Cyber Forensicscited by 1
- 2024AI with Alien Content and Alien Metasemanticscited by 1
- 2024Surrogate Modeling for Explainable Predictive Time Series Correctionscited by 1
- 2025Holistic Explainable AI (H-XAI): Extending Transparency Beyond Developers in AI-Driven Decision Makingcited by 1
- 2021A Comparative Approach to Explainable Artificial Intelligence Methods in Application to High-Dimensional Electronic Health Records: Examining the Usability of XAIcited by 0
- 2021Towards an Explanation Space to Align Humans and Explainable-AI Teamworkcited by 0
- 2022Explanation Method for Anomaly Detection on Mixed Numerical and Categorical Spacescited by 0
- 2023When a CBR in Hand is Better than Twins in the Bushcited by 0
50 most cited of 63 All 63 (JSON)
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations28 Aug 2026
- 2026Measuring User's Mental Models of Speech Translation in Human-AI Collaboration23 Jun 2026
- 2025Holistic Explainable AI (H-XAI): Extending Transparency Beyond Developers in AI-Driven Decision Making7 Aug 2025
- 2025Human-Centered Human-AI Interaction (HC-HAII): A Human-Centered AI Perspective5 Aug 2025
- 2025Feature-Guided Neighbor Selection for Non-Expert Evaluation of Model Predictions8 Jul 2025
- 2025IXAII: An Interactive Explainable Artificial Intelligence Interface for Decision Support Systems26 Jun 2025
- 2025Artificial Intelligence Should Genuinely Support Clinical Reasoning and Decision Making To Bridge the Translational Gap5 Jun 2025
- 2025A Comprehensive Survey on Self-Interpretable Neural Networks26 Jan 2025
- 2025TOAST Framework: A Multidimensional Approach to Ethical and Sustainable AI Integration in Organizations7 Jan 2025
- 2024Surrogate Modeling for Explainable Predictive Time Series Corrections27 Dec 2024
- 2024Towards Unifying Evaluation of Counterfactual Explanations: Leveraging Large Language Models for Human-Centric Assessments28 Oct 2024
- 2024Explaining Explaining26 Sep 2024
38 more
- 2024How to Measure Human-AI Prediction Accuracy in Explainable AI Systems23 Aug 2024
- 2024Explaining Graph Neural Networks for Node Similarity on Graphs10 Jul 2024
- 2024AI with Alien Content and Alien Metasemantics30 May 2024
- 2024Why do explanations fail? A typology and discussion on failures in XAI22 May 2024
- 2024Interactive Prompt Debugging with Sequence Salience11 Apr 2024
- 2024Cultural Bias in Explainable AI Research: A Systematic Analysis28 Feb 2024
- 2024Leveraging Large Language Models for Hybrid Workplace Decision Support6 Feb 2024
- 2024XAI-CF -- Examining the Role of Explainable Artificial Intelligence in Cyber Forensics4 Feb 2024
- 2024Information That Matters: Exploring Information Needs of People Affected by Algorithmic Decisions24 Jan 2024
- 2023XAI for In-hospital Mortality Prediction via Multimodal ICU Data29 Dec 2023
- 2023Adversary ML Resilience in Autonomous Driving Through Human Centered Perception Mechanisms2 Nov 2023
- 2023A Comprehensive Review on Financial Explainable AI21 Sep 2023
- 2023Calibrated Explanations for Regression30 Aug 2023
- 2023Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making8 Aug 2023
- 2023A New Perspective on Evaluation Methods for Explainable Artificial Intelligence (XAI)26 Jul 2023
- 2023What's meant by explainable model: A Scoping Review18 Jul 2023
- 2023Explainable Predictive Maintenance8 Jun 2023
- 2023A Measure of Explanatory Effectiveness20 May 2023
- 2023When a CBR in Hand is Better than Twins in the Bush9 May 2023
- 2023Calibrated Explanations: with Uncertainty Information and Counterfactuals3 May 2023
- 2023Automatic Textual Explanations of Concept Lattices17 Apr 2023
- 2023Explainable AI And Visual Reasoning: Insights From Radiology6 Apr 2023
- 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision support24 Feb 2023
- 2023Mind the Gap! Bridging Explainable Artificial Intelligence and Human Understanding with Luhmann's Functional Theory of Communication7 Feb 2023
- 2023Explaining Deep Learning Hidden Neuron Activations using Concept Induction23 Jan 2023
- 2022A Theoretical Framework for AI Models Explainability with Application in Biomedicine29 Dec 2022
- 2022Counterfactual Explanations for Misclassified Images: How Human and Machine Explanations Differ16 Dec 2022
- 2022Explanation Method for Anomaly Detection on Mixed Numerical and Categorical Spaces9 Sep 2022
- 2022Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI22 Jun 2022
- 2022ECLAD: Extracting Concepts with Local Aggregated Descriptors9 Jun 2022
- 2022Explanation as Question Answering based on a Task Model of the Agent's Design8 Jun 2022
- 2022A Meta Survey of Quality Evaluation Criteria in Explanation Methods25 Mar 2022
- 2021Explanation as Question Answering based on Design Knowledge16 Dec 2021
- 2021Applications of Explainable AI for 6G: Technical Aspects, Use Cases, and Research Challenges9 Dec 2021
- 2021A Survey on AI Assurance15 Nov 2021
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities11 Nov 2021
- 2021Exploring Explainable AI in the Financial Sector: Perspectives of Banks and Supervisory Authorities3 Nov 2021
- 2021Using Psychological Characteristics of Situations for Social Situation Comprehension in Support Agents15 Oct 2021
50 newest of 63 All 63 (JSON)
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
- 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision supportcited by 65
- 2021Explainable Artificial Intelligence Approaches: A Surveycited by 40
- 2022Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AIcited by 40
- 2021Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AIcited by 38
- 2021Principles of Explanation in Human-AI Systemscited by 25
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2023Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Makingcited by 18
- 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
12 most cited of 62 All 62 (JSON)
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations28 Aug 2026
- 2026Measuring User's Mental Models of Speech Translation in Human-AI Collaboration23 Jun 2026
- 2025Holistic Explainable AI (H-XAI): Extending Transparency Beyond Developers in AI-Driven Decision Making7 Aug 2025
- 2025Human-Centered Human-AI Interaction (HC-HAII): A Human-Centered AI Perspective5 Aug 2025
- 2025Feature-Guided Neighbor Selection for Non-Expert Evaluation of Model Predictions8 Jul 2025
- 2025IXAII: An Interactive Explainable Artificial Intelligence Interface for Decision Support Systems26 Jun 2025
- 2025Artificial Intelligence Should Genuinely Support Clinical Reasoning and Decision Making To Bridge the Translational Gap5 Jun 2025
- 2025A Comprehensive Survey on Self-Interpretable Neural Networks26 Jan 2025
- 2025TOAST Framework: A Multidimensional Approach to Ethical and Sustainable AI Integration in Organizations7 Jan 2025
- 2024Surrogate Modeling for Explainable Predictive Time Series Corrections27 Dec 2024
- 2024Towards Unifying Evaluation of Counterfactual Explanations: Leveraging Large Language Models for Human-Centric Assessments28 Oct 2024
- 2024Explaining Explaining26 Sep 2024
12 newest of 62 All 62 (JSON)