Explanation in Artificial Intelligence: Insights from the Social Sciences
Not on the map. Why?
Cited by 29 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
There has been a recent resurgence in the area of explainable artificial intelligence as researchers and practitioners seek to make their algorithms more understandable. Much of this research is focused on explicitly explaining decisions or actions to a human observer, and it should not be controversial to say that looking at how humans explain to each other can serve as a useful starting point for explanation in artificial intelligence. However, it is fair to say that most work in explainable artificial intelligence uses only the researchers' intuition of what constitutes a `good' explanation. There exists vast and valuable bodies of research in philosophy, psychology, and cognitive science of how people define, generate, select, evaluate, and present explanations, which argues that people employ certain cognitive biases and social expectations towards the explanation process. This paper argues that the field of explainable artificial intelligence should build on this existing research, and reviews relevant papers from philosophy, cognitive psychology/science, and social psychology, which study these topics. It draws out some important findings, and discusses ways that these can be infused with work on explainable artificial intelligence.
Key facts. Cited by 1,201 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 216; 2022: 216; 2023: 219; 2024: 195; 2025: 199; 2026: 156.
1,201 papers.
Sort:
By area:
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2021Understanding Dataset Difficulty with V-Usable Informationcited by 288
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 219
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
- 2021Explaining Answers with Entailment Treescited by 148
- 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
38 more
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 118
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2023Faithfulness Tests for Natural Language Explanationscited by 107
- 2024Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertaintycited by 106
- 2023Probabilistic Concept Bottleneck Modelscited by 101
- 2024Are self-explanations from Large Language Models faithful?cited by 101
- 2022Diffusion Visual Counterfactual Explanationscited by 96
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2021The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanationscited by 86
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
- 2021Explanations in Autonomous Driving: A Surveycited by 80
- 2024Visibility into AI Agentscited by 77
- 2021When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Datacited by 75
- 2021Contrastive Explanations for Model Interpretabilitycited by 75
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2022GlanceNets: Interpretabile, Leak-proof Concept-based Modelscited by 73
- 2023Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanationscited by 73
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2021XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanationscited by 72
- 2021A Survey on Interpretable Reinforcement Learningcited by 70
- 2021Argumentative XAI: A Surveycited by 66
- 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision supportcited by 65
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2021GraphSVX: Shapley Value Explanations for Graph Neural Networkscited by 63
50 most cited of 1,201 All 1,201 (JSON)
- 2026Cybernetic and Epistemic: A Missing Vocabulary for Trustworthy Agentic Delegation1 Oct 2026
- 2026Explainability from Training with Applications to TCR-Epitope Prediction28 Sep 2026
- 2026Skill Profiling with Attributable Reasoning (SPAR): A Wearable Analysis System for Boxing25 Sep 2026
- 2026Does a model's stated reason for rejecting a candidate do any work?24 Sep 2026
- 2026Null importance: Disentangling relevance for interpretable machine learning16 Sep 2026
- 2026FCx: An algorithm for finding Feasible Counterfactual Explanations16 Sep 2026
- 2026Beyond Measurement Metrics: A Human-Centered Framework for Semantic Validation of Network Traffic Classification15 Sep 2026
- 2026Can AI systems have free will?14 Sep 2026
- 2026Generative Interpretability via Scalable Neuro-Symbolic Models11 Sep 2026
- 2026From Explanations to Interventions: Execution-Guided Counterfactual Synthesis in Temporal Graphs10 Sep 2026
- 2026XAI-Arena: Can LLMs Assess the Quality of XAI Explanations?8 Sep 2026
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
38 more
- 2026ProToMEx: Rapid, Interpretable Explanations via Structured Representations2 Sep 2026
- 2026Contrastive Explanations in Quantitative Bipolar Argumentation Frameworks2 Sep 2026
- 2026Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidence31 Aug 2026
- 2026Taking the Whys Seriously: Limitations of Counterfactual Explanations in Justification and Recourse31 Aug 2026
- 2026Attribute-Based Activation Steering of LLMs for Group-Specific Explanation Generation29 Aug 2026
- 2026Towards A Unified Information Bottleneck Framework for Time Series Explanations26 Aug 2026
- 2026Method, Mind, and Morality: How People Make Sense of Artificial Intelligence25 Aug 2026
- 2026Towards Actionable Surgical Team Dynamics: from Teamwork to Counterfactual Annotations24 Aug 2026
- 2026Why This, Not That? Mining User Profiles for Pair-wise Counterfactuals21 Aug 2026
- 2026No Judgment Without a Reason: Counterfactual Receipts for Versioned AI Evaluators21 Aug 2026
- 2026Communicating Credit Risk with Large Language Models: Evaluation of Explanations from Standard and Alternative Data-Based Models18 Aug 2026
- 2026Evaluating RL Explainability Methods by How Much They Help Fix Bugs in Agents18 Aug 2026
- 2026LLM-Only PDDL Domain Repair with Open-Weight Models18 Aug 2026
- 2026Beyond L2: Generalizing Abductive Latent Explanations to Diverse Prototype-Based Architectures17 Aug 2026
- 2026NARRATE: A Multimodal Real-World Australian Driving Dataset for Human-Centred Explanations in Automated Driving14 Aug 2026
- 2026Who Are You Explaining To? A Multi-Agent System for Audience-Aware XAI Narratives11 Aug 2026
- 2026The Utility of LLMs in Recommender Systems Explanation Evaluation7 Aug 2026
- 2026MI-MIDI: Mechanistic Interpretability of Text-to-MIDI Generation Models via Probing, Lenses and Steering6 Aug 2026
- 2026Decomposed Entailment for Factuality Checking and Hallucination Detection6 Aug 2026
- 2026Contrastive Concept Importance: Explaining Pairwise Class Decisions Through Automatically Extracted Concept Representations30 Jul 2026
- 2026From Dyad to Triad: Eliciting XAI Requirements in Stroke Rehabilitation28 Jul 2026
- 2026Explanation-Bound Tool Execution for AI Agents: Server-Verified Action Claims Without Trusting Model Rationales28 Jul 2026
- 2026Explainability Framework for Policy-Aware Autonomous Agents23 Jul 2026
- 2026Explainable Deepfake Detection Challenge23 Jul 2026
- 2026ConceptCF: Concept-based Counterfactuals for the Explainability of Time Series21 Jul 2026
- 2026Unsafe at any AUC: Unlearned Lessons from Sociotechnical Disasters for Responsible AI15 Jul 2026
- 2026Align AI to Dynamic Human-AI Workflows15 Jul 2026
- 2026Discourse-Aware Policy Analysis with Argumentation: A Hybrid LLM-Symbolic Framework for Disaster Governance14 Jul 2026
- 2026Explaining Reinforcement Learning Decisions in Self-adaptive Systems13 Jul 2026
- 2026Articulate Intuition or Genuine Analysis? Benchmarking Epistemic Reliability in LLM-as-a-Judge Peer Reviews12 Jul 2026
- 2026Knowledge Graphs and Explainable AI as Complementary Resources for Urban Mining10 Jul 2026
- 2026XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection3 Jul 2026
- 2026PACE: A Neuro-Symbolic Framework for Plausible and Actionable Counterfactual Explanations1 Jul 2026
- 2026Conversable Complexity: Agentic LLM Collectives as Interpretable Substrates1 Jul 2026
- 2026AI, Trust, and Teaming: The Humans-as-Handlers Approach for Autonomous and Opaque AI Systems1 Jul 2026
- 2026Beyond But-for Test: Counterfactual Explanation in Abstract Argumentation via Actual Causality (Extended Version)30 Jun 2026
- 2026Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis24 Jun 2026
- 2026Beyond Shapley: Efficient Computation of Asymmetric Shapley Values23 Jun 2026
50 newest of 1,201 All 1,201 (JSON)
- 2023Can Language Models Teach Weaker Agents? Teacher Explanations Improve Students via Personalizationcited by 15
- 2025Abduct, Act, Predict: Scaffolding Causal Inference for Automated Failure Attribution in Multi-Agent Systemscited by 14
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2023Explaining Agent Behavior with Large Language Modelscited by 3
- 2023Understanding Your Agent: Leveraging Large Language Models for Behavior Explanationcited by 3
- 2025Integrating Counterfactual Simulations with Language Models for Explaining Multi-Agent Behaviourcited by 3
- 2026Overseeing Agents Without Constant Oversight: Challenges and Opportunitiescited by 3
- 2024Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Modelscited by 2
- 2025Show Me How: Benefits and Challenges of Agent-Augmented Counterfactual Explanations for Non-Expert Userscited by 2
- 2025Let's Get You Hired: A Job Seeker's Perspective on Multi-Agent Recruitment Systems for Explaining Hiring Decisionscited by 2
- 2025TalkToAgent: A Human-centric Explanation of Reinforcement Learning Agents with Large Language Modelscited by 2
- 2025Triadic Fusion of Cognitive, Functional, and Causal Dimensions for Explainable LLMs: The TAXAL Frameworkcited by 1
12 most cited of 29 All 29 (JSON)
- 2026Cybernetic and Epistemic: A Missing Vocabulary for Trustworthy Agentic Delegation1 Oct 2026
- 2026Generative Interpretability via Scalable Neuro-Symbolic Models11 Sep 2026
- 2026No Judgment Without a Reason: Counterfactual Receipts for Versioned AI Evaluators21 Aug 2026
- 2026Evaluating RL Explainability Methods by How Much They Help Fix Bugs in Agents18 Aug 2026
- 2026Who Are You Explaining To? A Multi-Agent System for Audience-Aware XAI Narratives11 Aug 2026
- 2026Conversable Complexity: Agentic LLM Collectives as Interpretable Substrates1 Jul 2026
- 2026PerceptUI: LLM Agents as Human-Aligned Synthetic Users for UI/UX Evaluation4 Jun 2026
- 2026Market Regime Council for Dynamic Credit Assignment in Multi-Agent LLM Decision Systems23 May 2026
- 2026Governing AI-Assisted Security Operations: A Design Science Framework for Operational Decision Support10 May 2026
- 2026Human-AI Coordination Zones: A Framework for Designing Human-in-the-Loop Experiences with Agentic AI1 May 2026
- 2026VIGIL: Towards Edge-Extended Agentic AI for Enterprise IT Support17 Mar 2026
- 2026Exploring Plan Space through Conversation: An Agentic Framework for LLM-Mediated Explanations in Planning2 Mar 2026
12 newest of 29 All 29 (JSON)
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
- 2025Improving Chain-of-Thought Reasoning via Quasi-Symbolic Abstractionscited by 17
- 2022From Black Boxes to Conversations: Incorporating XAI in a Conversational Agentcited by 14
- 2022VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectivescited by 12
- 2022COPA-SSE: Semi-structured Explanations for Commonsense Reasoningcited by 8
- 2025Improving Human Verification of LLM Reasoning through Interactive Explanation Interfacescited by 7
- 2023Explainable AI And Visual Reasoning: Insights From Radiologycited by 5
- 2022Causal Explanations for Sequential Decision Making Under Uncertaintycited by 2
- 2025LLM-Driven Collaborative Model for Untangling Commits via Explicit and Implicit Dependency Reasoningcited by 2
- 2026From XAI to Stories: A Factorial Study of LLM-Generated Explanation Qualitycited by 2
- 2025Complexity of Faceted Explanations in Propositional Abductioncited by 1
- 2025SynLang and Symbiotic Epistemology: A Manifesto for Conscious Human-AI Collaborationcited by 1
12 most cited of 16 All 16 (JSON)
- 2026Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidence31 Aug 2026
- 2026Simulate, Reason, Decide: Scientific Reasoning with LLMs for Simulation-Driven Decision Making3 Jun 2026
- 2026Supporting Calibrated Reliance in Human-AI Collaboration: Different Strategies for Different Tasks31 Jan 2026
- 2026From XAI to Stories: A Factorial Study of LLM-Generated Explanation Quality5 Jan 2026
- 2025Improving Human Verification of LLM Reasoning through Interactive Explanation Interfaces27 Oct 2025
- 2025Extended Triangular Method: A Generalized Algorithm for Contradiction Separation Based Automated Deduction12 Oct 2025
- 2025LLM-Driven Collaborative Model for Untangling Commits via Explicit and Implicit Dependency Reasoning22 Jul 2025
- 2025Complexity of Faceted Explanations in Propositional Abduction20 Jul 2025
- 2025SynLang and Symbiotic Epistemology: A Manifesto for Conscious Human-AI Collaboration3 Jun 2025
- 2025Improving Chain-of-Thought Reasoning via Quasi-Symbolic Abstractions18 Feb 2025
- 2023Explainable AI And Visual Reasoning: Insights From Radiology6 Apr 2023
- 2022From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent6 Sep 2022
12 newest of 16 All 16 (JSON)
- 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMscited by 20
- 2024Interpreting Language Reward Models via Contrastive Explanationscited by 9
- 2025Multi-Domain Explainability of Preferencescited by 2
- 2024Explaining Learned Reward Functions with Counterfactual Trajectoriescited by 1
- 2024Explanation, Debate, Align: A Weak-to-Strong Framework for Language Model Generalizationcited by 1
- 2025Direct Preference Optimization for Adaptive Concept-based Explanationscited by 0
- 2026Grounded but Misleading: Evaluating Semantic Alignment in AI-Generated Security Explanationscited by 0
- 2026Align AI to Dynamic Human-AI Workflowscited by 0
- 2026Align AI to Dynamic Human-AI Workflows15 Jul 2026
- 2026Grounded but Misleading: Evaluating Semantic Alignment in AI-Generated Security Explanations4 Feb 2026
- 2025Multi-Domain Explainability of Preferences26 May 2025
- 2025Direct Preference Optimization for Adaptive Concept-based Explanations21 May 2025
- 2024Interpreting Language Reward Models via Contrastive Explanations25 Nov 2024
- 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMs15 Sep 2024
- 2024Explanation, Debate, Align: A Weak-to-Strong Framework for Language Model Generalization11 Sep 2024
- 2024Explaining Learned Reward Functions with Counterfactual Trajectories7 Feb 2024
- 2025LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanationscited by 16
- 2023Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanationscited by 12
- 2026Not All Explanations Simulate Equally: Comparing Verbalized Feature Attributions and Self-Generated Rationalescited by 1
- 2026Not All Explanations Simulate Equally: Comparing Verbalized Feature Attributions and Self-Generated Rationales31 May 2026
- 2025LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanations11 Sep 2025
- 2023Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanations13 Nov 2023
- 2023Red Teaming Deep Neural Networks with Feature Synthesis Toolscited by 21
- 2021Fooling Partial Dependence via Data Poisoningcited by 16
- 2023Red Teaming Deep Neural Networks with Feature Synthesis Tools8 Feb 2023
- 2021Fooling Partial Dependence via Data Poisoning26 May 2021
- 2025Explainable Reinforcement Learning Agents Using World Models12 May 2025
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2021Understanding Dataset Difficulty with V-Usable Informationcited by 288
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 219
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
- 2021Explaining Answers with Entailment Treescited by 148
- 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
12 most cited of 1,134 All 1,134 (JSON)
- 2026Explainability from Training with Applications to TCR-Epitope Prediction28 Sep 2026
- 2026Skill Profiling with Attributable Reasoning (SPAR): A Wearable Analysis System for Boxing25 Sep 2026
- 2026Does a model's stated reason for rejecting a candidate do any work?24 Sep 2026
- 2026Null importance: Disentangling relevance for interpretable machine learning16 Sep 2026
- 2026FCx: An algorithm for finding Feasible Counterfactual Explanations16 Sep 2026
- 2026Beyond Measurement Metrics: A Human-Centered Framework for Semantic Validation of Network Traffic Classification15 Sep 2026
- 2026Can AI systems have free will?14 Sep 2026
- 2026From Explanations to Interventions: Execution-Guided Counterfactual Synthesis in Temporal Graphs10 Sep 2026
- 2026XAI-Arena: Can LLMs Assess the Quality of XAI Explanations?8 Sep 2026
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
- 2026ProToMEx: Rapid, Interpretable Explanations via Structured Representations2 Sep 2026
- 2026Contrastive Explanations in Quantitative Bipolar Argumentation Frameworks2 Sep 2026
12 newest of 1,134 All 1,134 (JSON)