What Does Explainable AI Really Mean? A New Conceptualization of Perspectives
Not on the map. Why?
Abstract (arXiv)
We characterize three notions of explainable AI that cut across research fields: opaque systems that offer no insight into its algo- rithmic mechanisms; interpretable systems where users can mathemat- ically analyze its algorithmic mechanisms; and comprehensible systems that emit symbols enabling user-driven explanations of how a conclusion is reached. The paper is motivated by a corpus analysis of NIPS, ACL, COGSCI, and ICCV/ECCV paper titles showing differences in how work on explainable AI is positioned in various fields. We close by introducing a fourth notion: truly explainable systems, where automated reasoning is central to output crafted explanations without requiring human post processing as final step of the generative process.
Key facts. Cited by 72 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 11; 2023: 20; 2024: 13; 2025: 3; 2026: 3.
72 papers.
Sort:
By area:
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2021Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Surveycited by 72
- 2022On scientific understanding with artificial intelligencecited by 70
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 61
- 2021Counterfactuals and Causability in Explainable Artificial Intelligence: Theory, Algorithms, and Applicationscited by 59
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2021Robust Explainability: A Tutorial on Gradient-Based Attribution Methods for Deep Neural Networkscited by 48
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2021To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methodscited by 26
- 2023`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Valuescited by 18
- 2021Explainable Machine Learning with Prior Knowledge: An Overviewcited by 15
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 14
38 more
- 2021DiCE4EL: Interpreting Process Predictions using a Milestone-Aware Counterfactual Approachcited by 13
- 2022Greybox XAI: a Neural-Symbolic learning framework to produce interpretable predictions for image classificationcited by 12
- 2022Human-Centric Artificial Intelligence Architecture for Industry 5.0 Applicationscited by 11
- 2023Discovering interpretable elastoplasticity models via the neural polynomial method enabled symbolic regressionscited by 10
- 2021Development and testing of an image transformer for explainable autonomous driving systemscited by 9
- 2022XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learningcited by 8
- 2024Comprehensible Artificial Intelligence on Knowledge Graphs: A surveycited by 8
- 2024Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and Englishcited by 8
- 2021Explainable AI and Adoption of Financial Algorithmic Advisors: an Experimental Studycited by 7
- 2021AdViCE: Aggregated Visual Counterfactual Explanations for Machine Learning Model Validationcited by 7
- 2024Neuro-Symbolic AI for Military Applicationscited by 7
- 2021Explainable Artificial Intelligence (XAI): An Engineering Perspectivecited by 6
- 2022Trade-off Between Efficiency and Consistency for Removal-based Explanationscited by 6
- 2024On the Value of Labeled Data and Symbolic Methods for Hidden Neuron Activation Analysiscited by 6
- 2023Users are the North Star for AI Transparencycited by 5
- 2023Explainable AI applications in the Medical Domain: a systematic reviewcited by 5
- 2023Deep Quantum Graph Dreaming: Deciphering Neural Network Insights into Quantum Experimentscited by 5
- 2024A Comparative Analysis of Counterfactual Explanation Methods for Text Classifierscited by 5
- 2021Trustworthy AI and Robotics and the Implications for the AEC Industry: A Systematic Literature Review and Future Potentialscited by 4
- 2022Visual Ground Truth Construction as Faceted Classificationcited by 4
- 2021Exploiting auto-encoders and segmentation methods for middle-level explanations of image classification systemscited by 3
- 2021Quantifying the Task-Specific Information in Text-Based Classificationscited by 3
- 2021A Practical guide on Explainable AI Techniques applied on Biomedical use case applicationscited by 3
- 2023PACE: A Program Analysis Framework for Continuous Performance Predictioncited by 3
- 2024A Mechanistic Explanatory Strategy for XAIcited by 3
- 2023Semantic match: Debugging feature attribution methods in XAI for healthcarecited by 2
- 2023Explaining Deep Learning Hidden Neuron Activations using Concept Inductioncited by 2
- 2023Generalization-baed similaritycited by 2
- 2023Assisting clinical practice with fuzzy probabilistic decision treescited by 2
- 2023Fixing confirmation bias in feature attribution methods via semantic matchcited by 2
- 2023Understanding CNN Hidden Neuron Activations Using Structured Background Knowledge and Deductive Reasoningcited by 2
- 2023On the Multiple Roles of Ontologies in Explainable AIcited by 2
- 2024Leveraging Large Language Models for Hybrid Workplace Decision Supportcited by 2
- 2024Aligning Generalisation Between Humans and Machinescited by 2
- 2021Explaining Ridesharing: Selection of Explanations for Increasing User Satisfactioncited by 1
- 2021mSHAP: SHAP Values for Two-Part Modelscited by 1
- 2021Semantic Reasoning from Model-Agnostic Explanationscited by 1
- 2021Measuring Ethics in AI with AI: A Methodology and Dataset Constructioncited by 1
50 most cited of 72 All 72 (JSON)
- 2026Unsafe at any AUC: Unlearned Lessons from Sociotechnical Disasters for Responsible AI15 Jul 2026
- 2026A New Technique for AI Explainability using Feature Association Map12 May 2026
- 2026Defining Explainable AI for Requirements Analysis22 Feb 2026
- 2025Optimality Principles and Neural Ordinary Differential Equations-based Process Modeling for Distributed Control6 Aug 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Actionable AI: Enabling Non Experts to Understand and Configure AI Systems9 Mar 2025
- 2024Aligning Generalisation Between Humans and Machines23 Nov 2024
- 2024A Comparative Analysis of Counterfactual Explanation Methods for Text Classifiers4 Nov 2024
- 2024A Mechanistic Explanatory Strategy for XAI2 Nov 2024
- 2024Explaining Bayesian Networks in Natural Language using Factor Arguments. Evaluation in the medical domain23 Oct 2024
- 2024Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English14 Sep 2024
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
38 more
- 2024Neuro-Symbolic AI for Military Applications17 Aug 2024
- 2024Petal-X: Human-Centered Visual Explanations to Improve Cardiovascular Risk Communication26 Jun 2024
- 2024On the Value of Labeled Data and Symbolic Methods for Hidden Neuron Activation Analysis21 Apr 2024
- 2024Comprehensible Artificial Intelligence on Knowledge Graphs: A survey4 Apr 2024
- 2024Leveraging Counterfactual Paths for Contrastive Explanations of POMDP Policies28 Mar 2024
- 2024Leveraging Large Language Models for Hybrid Workplace Decision Support6 Feb 2024
- 2024XAI-CF -- Examining the Role of Explainable Artificial Intelligence in Cyber Forensics4 Feb 2024
- 2023PACE: A Program Analysis Framework for Continuous Performance Prediction1 Dec 2023
- 2023Deep Tensor Network18 Nov 2023
- 2023On the Multiple Roles of Ontologies in Explainable AI8 Nov 2023
- 2023Deep Quantum Graph Dreaming: Deciphering Neural Network Insights into Quantum Experiments13 Sep 2023
- 2023Explainable AI applications in the Medical Domain: a systematic review10 Aug 2023
- 2023Understanding CNN Hidden Neuron Activations Using Structured Background Knowledge and Deductive Reasoning8 Aug 2023
- 2023Discovering interpretable elastoplasticity models via the neural polynomial method enabled symbolic regressions24 Jul 2023
- 2023`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values14 Jul 2023
- 2023Fixing confirmation bias in feature attribution methods via semantic match3 Jul 2023
- 2023Energy-frugal and Interpretable AI Hardware Design using Learning Automata19 May 2023
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulation2 May 2023
- 2023Assisting clinical practice with fuzzy probabilistic decision trees16 Apr 2023
- 2023Users are the North Star for AI Transparency9 Mar 2023
- 2023A System's Approach Taxonomy for User-Centred XAI: A Survey6 Mar 2023
- 2023Generalization-baed similarity13 Feb 2023
- 2023Understanding User Preferences in Explainable Artificial Intelligence: A Survey and a Mapping Function Proposal7 Feb 2023
- 2023Hypothesis Testing and Machine Learning: Interpreting Variable Effects in Deep Artificial Neural Networks using Cohen's f22 Feb 2023
- 2023Explaining Deep Learning Hidden Neuron Activations using Concept Induction23 Jan 2023
- 2023Interpreting CNN Predictions using Conditional Generative Adversarial Networks19 Jan 2023
- 2023Semantic match: Debugging feature attribution methods in XAI for healthcare5 Jan 2023
- 2022Trade-off Between Efficiency and Consistency for Removal-based Explanations31 Oct 2022
- 2022AI Explainability and Governance in Smart Energy Systems: A Review24 Oct 2022
- 2022Greybox XAI: a Neural-Symbolic learning framework to produce interpretable predictions for image classification26 Sep 2022
- 2022A Gaze into the Internal Logic of Graph Neural Networks, with Logic5 Aug 2022
- 2022Latent Properties of Lifelong Learning Systems28 Jul 2022
- 2022A Dynamic Data Driven Approach for Explainable Scene Understanding18 Jun 2022
- 2022Towards Explainable Social Agent Authoring tools: A case study on FAtiMA-Toolkit7 Jun 2022
- 2022On scientific understanding with artificial intelligence4 Apr 2022
- 2022Human-Centric Artificial Intelligence Architecture for Industry 5.0 Applications21 Mar 2022
- 2022XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learning24 Feb 2022
- 2022Visual Ground Truth Construction as Faceted Classification17 Feb 2022
50 newest of 72 All 72 (JSON)
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2021Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Surveycited by 72
- 2022On scientific understanding with artificial intelligencecited by 70
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 61
- 2021Counterfactuals and Causability in Explainable Artificial Intelligence: Theory, Algorithms, and Applicationscited by 59
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2021Robust Explainability: A Tutorial on Gradient-Based Attribution Methods for Deep Neural Networkscited by 48
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2021To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methodscited by 26
- 2023`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Valuescited by 18
- 2021Explainable Machine Learning with Prior Knowledge: An Overviewcited by 15
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 14
12 most cited of 70 All 70 (JSON)
- 2026Unsafe at any AUC: Unlearned Lessons from Sociotechnical Disasters for Responsible AI15 Jul 2026
- 2026A New Technique for AI Explainability using Feature Association Map12 May 2026
- 2026Defining Explainable AI for Requirements Analysis22 Feb 2026
- 2025Optimality Principles and Neural Ordinary Differential Equations-based Process Modeling for Distributed Control6 Aug 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Actionable AI: Enabling Non Experts to Understand and Configure AI Systems9 Mar 2025
- 2024Aligning Generalisation Between Humans and Machines23 Nov 2024
- 2024A Comparative Analysis of Counterfactual Explanation Methods for Text Classifiers4 Nov 2024
- 2024A Mechanistic Explanatory Strategy for XAI2 Nov 2024
- 2024Explaining Bayesian Networks in Natural Language using Factor Arguments. Evaluation in the medical domain23 Oct 2024
- 2024Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English14 Sep 2024
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
12 newest of 70 All 70 (JSON)