Causal SHAP: Feature Attribution with Dependency Awareness through Causal Discovery
Not on the map. Why?
Abstract (arXiv)
Explaining machine learning (ML) predictions has become crucial as ML models are increasingly deployed in high-stakes domains such as healthcare. While SHapley Additive exPlanations (SHAP) is widely used for model interpretability, it fails to differentiate between causality and correlation, often misattributing feature importance when features are highly correlated. We propose Causal SHAP, a novel framework that integrates causal relationships into feature attribution while preserving many desirable properties of SHAP. By combining the Peter-Clark (PC) algorithm for causal discovery and the Intervention Calculus when the DAG is Absent (IDA) algorithm for causal strength quantification, our approach addresses the weakness of SHAP. Specifically, Causal SHAP reduces attribution scores for features that are merely correlated with the target, as validated through experiments on both synthetic and real-world datasets. This study contributes to the field of Explainable AI (XAI) by providing a practical framework for causal-aware model explanations. Our approach is particularly valuable in domains such as healthcare, where understanding true causal relationships is critical for informed decision-making.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 31 Aug 2025.
Builds on
14 of 32 references.
References · 14
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
- 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
- 2019Explaining individual predictions when features are dependent: More accurate approximations to Shapley valuescited by 208
- 2019Feature relevance quantification in explainable AI: A causal problemcited by 167
- 2019Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainabilitycited by 114
- 2020Causal Shapley Values: Exploiting Causal Knowledge to Explain Individual Predictions of Complex Modelscited by 107
- 2020Shapley explainability on the data manifoldcited by 88
- 2020Shapley Flow: A Graph-based Approach to Interpreting Model Predictionscited by 51
- 2013A Discovery Algorithm for Directed Cyclic Graphscited by 34
2 more
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026DynSHAP: Towards Explainable Dynamic Survival Analysiscited by 0
- 2026DynSHAP: Towards Explainable Dynamic Survival Analysis11 Sep 2026