mlsanityData to 14 Oct 2026

Causal Explanations and XAI

arXiv 2201.13169 ↗First posted 31 Jan 2022cs.AIcited by 30

Not on the map. Why?

Abstract (arXiv)

Although standard Machine Learning models are optimized for making predictions about observations, more and more they are used for making predictions about the results of actions. An important goal of Explainable Artificial Intelligence (XAI) is to compensate for this mismatch by offering explanations about the predictions of an ML-model which ensure that they are reliably action-guiding. As action-guiding explanations are causal explanations, the literature on this topic is starting to embrace insights from the literature on causal models. Here I take a step further down this path by formally defining the causal notions of sufficient explanations and counterfactual explanations. I show how these notions relate to (and improve upon) existing work, and motivate their adequacy by illustrating how different explanations are action-guiding under different circumstances. Moreover, this work is the first to offer a formal definition of actual causation that is founded entirely in action-guiding explanations. Although the definitions are motivated by a focus on XAI, the analysis of causal explanation and actual causation applies in general. I also touch upon the significance of this work for fairness in AI by showing how actual causation can be used to improve the idea of path-specific counterfactual fairness.

Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 31 Jan 2022.

Builds on

25 of 40 references.

References · 25

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  3. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
  4. 2017Counterfactual Fairnesscited by 804
  5. 2016The Mythos of Model Interpretabilitycited by 721
  6. 2018Actionable Recourse in Linear Classificationcited by 328
  7. 2013Direct and Indirect Effectscited by 280
  8. 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
  9. 2019FACE: Feasible and Actionable Counterfactual Explanationscited by 233
  10. 2018Path-Specific Counterfactual Fairnesscited by 181
  11. 2017Fair Inference On Outcomescited by 144
  12. 2019Preserving Causal Constraints in Counterfactual Explanations for Machine Learning Classifierscited by 144
13 more
  1. 2020Algorithmic recourse under imperfect causal knowledge: a probabilistic approachcited by 140
  2. 2018A Symbolic Approach to Explaining Bayesian Network Classifierscited by 131
  3. 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
  4. 2020On The Reasons Behind Decisionscited by 100
  5. 2020General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Modelscited by 75
  6. 2019PC-Fairness: A Unified Framework for Measuring Causality-based Fairnesscited by 67
  7. 2020Towards Unifying Feature Attribution and Counterfactual Explanations: Different Means to the Same Endcited by 66
  8. 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
  9. 2018Causal Reasoning for Algorithmic Fairnesscited by 51
  10. 2021Local Explanations via Necessity and Sufficiency: Unifying Theory and Practicecited by 45
  11. 2019CERTIFAI: Counterfactual Explanations for Robustness, Transparency, Interpretability, and Fairness of Artificial Intelligence modelscited by 34
  12. 2021Causal Sufficiency and Actual Causationcited by 29
  13. 2021A Causal Perspective on Meaningful and Robust Algorithmic Recoursecited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 7; 2024: 8; 2025: 7; 2026: 6.

30 papers.

Sort:

By area:

  1. 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 125
  2. 2024Causal Concept Graph Models: Beyond Causal Opacity in Deep Learningcited by 29
  3. 2023Towards Trustworthy Explanation: On Causal Rationalizationcited by 19
  4. 2023Learning by Self-Explainingcited by 17
  5. 2022Backtracking Counterfactualscited by 16
  6. 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 16
  7. 2023Interpretation of Time-Series Deep Models: A Surveycited by 15
  8. 2022On the Probability of Necessity and Sufficiency of Explaining Graph Neural Networks: A Lower Bound Optimization Approachcited by 11
  9. 2025Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspectivecited by 11
  10. 2023Deep Backtracking Counterfactuals for Causally Compliant Explanationscited by 9
  11. 2024Graph Neural Network Causal Explanation via Neural Causal Modelscited by 9
  12. 2024Causal Explanations for Image Classifierscited by 9
18 more
  1. 2024Automated Discovery of Functional Actual Causes in Complex Environmentscited by 4
  2. 2024Intervention and Conditioning in Causal Bayesian Networkscited by 3
  3. 2023NLP as a Lens for Causal Analysis and Perception Mining to Infer Mental Health on Social Mediacited by 2
  4. 2024Generally-Occurring Model Change for Robust Counterfactual Explanationscited by 2
  5. 2023Causal Kripke Modelscited by 0
  6. 2024Counterfactual Explanations of Black-box Machine Learning Models using Causal Discovery with Applications to Credit Ratingcited by 0
  7. 2025Robot Pouring: Identifying Causes of Spillage and Selecting Alternative Action Parameters Using Probabilistic Actual Causationcited by 0
  8. 2025Actual Causation and Nondeterministic Causal Modelscited by 0
  9. 2025Fixed Point Explainabilitycited by 0
  10. 2025Intervening in Black Box: Concept Bottleneck Model for Enhancing Human Neural Network Mutual Understandingcited by 0
  11. 2025Evaluation of Black-Box XAI Approaches for Predictors of Values of Boolean Formulaecited by 0
  12. 2025A Framework for Causal Concept-based Model Explanationscited by 0
  13. 2026cc-Shapley: Measuring Multivariate Feature Importance Needs Causal Contextcited by 0
  14. 2026Position: Explainable AI is Causality in Disguisecited by 0
  15. 2026A Causal Argumentation Method for Explainability of Machine Learning Modelscited by 0
  16. 2026Formalizing and falsifying causal pathways of rare eventscited by 0
  17. 2026CIExplainer++: Generating Causal and Interpretable Explanations for Graph Neural Networkscited by 0
  18. 2026Generating Medical Image Counterfactuals using Causal Explanationscited by 0