The Inadequacy of Shapley Values for Explainability
Not on the map. Why?
Abstract (arXiv)
This paper develops a rigorous argument for why the use of Shapley values in explainable AI (XAI) will necessarily yield provably misleading information about the relative importance of features for predictions. Concretely, this paper demonstrates that there exist classifiers, and associated predictions, for which the relative importance of features determined by the Shapley values will incorrectly assign more importance to features that are provably irrelevant for the prediction, and less importance to features that are provably relevant for the prediction. The paper also argues that, given recent complexity results, the existence of efficient algorithms for the computation of rigorous feature attribution values in the case of some restricted classes of classifiers should be deemed unlikely at best.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 39 of its 108 references that are in the map. First posted on arXiv 16 Feb 2023.
Builds on
39 of 108 references.
References · 39
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2019The many Shapley values for model explanationcited by 344
- 2020Problems with Shapley-value-based explanations as feature importance measurescited by 200
- 2018Abduction-Based Explanations for Machine Learning Modelscited by 160
- 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 154
- 2017PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparisoncited by 140
- 2020Reliable Post hoc Explanations: Modeling Uncertainty in Explainabilitycited by 125
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 125
- 2019Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainabilitycited by 114
27 more
- 2018L-Shapley and C-Shapley: Efficient Model Interpretation for Structured Datacited by 100
- 2020On The Reasons Behind Decisionscited by 100
- 2022The Shapley Value in Machine Learningcited by 98
- 2020On the Tractability of SHAP Explanationscited by 92
- 2020Shapley explainability on the data manifoldcited by 88
- 2020Model Interpretability through the Lens of Computational Complexitycited by 75
- 2020Towards Unifying Feature Attribution and Counterfactual Explanations: Different Means to the Same Endcited by 66
- 2020Explaining Naive Bayes and Other Linear Classifiers with Polynomial Time and Delaycited by 57
- 2021On Explaining Random Forests with SATcited by 57
- 2021Shapley values for feature selection: The good, the bad, and the axiomscited by 54
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2022Logic-Based Explainability in Machine Learningcited by 48
- 2021Local Explanations via Necessity and Sufficiency: Unifying Theory and Practicecited by 45
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021SAT-Based Rigorous Explanations for Decision Listscited by 40
- 2021Explanations for Monotonic Classifierscited by 39
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2021On the Complexity of SHAP-Score-Based Explanations: Tractability via Knowledge Compilation and Non-Approximability Resultscited by 32
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanationscited by 26
- 2022Feature Necessity & Relevancy in ML Classifier Explanationscited by 23
- 2021Counterfactual Shapley Additive Explanationscited by 22
- 2021Rational Shapley Valuescited by 18
- 2021XOmiVAE: an interpretable deep learning model for cancer classification using high-dimensional omics datacited by 13
- 2021Towards Rigorous Interpretations: a Formalisation of Feature Attributioncited by 11
- 2021Exact Shapley Values for Local and Model-True Explanations of Decision Tree Ensemblescited by 5
Built on by
Citing papers per year: 2023: 12; 2024: 11; 2025: 3; 2026: 5.
31 papers.
Sort:
By area:
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2023Explainability is NOT a Gamecited by 23
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2023On Formal Feature Attribution and Its Approximationcited by 11
- 2023Axiomatic Aggregations of Abductive Explanationscited by 10
- 2023Anytime Approximate Formal Feature Attributioncited by 9
- 2024From SHAP Scores to Feature Importance Scorescited by 8
- 2024Auditing Local Explanations is Hardcited by 8
- 2024Formal Explanations for Neuro-Symbolic AIcited by 6
- 2023Explaining Exchange Rate Forecasts with Macroeconomic Fundamentals Using Interpretive Machine Learningcited by 5
- 2024X Hacking: The Threat of Misguided AutoMLcited by 5
- 2024Causality from Bottom to Top: A Surveycited by 5
19 more
- 2023A Refutation of Shapley Values for Explainabilitycited by 4
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
- 2023A Uniform Language to Explain Decision Treescited by 4
- 2024Logic-Based Explainability: Past, Present & Futurecited by 2
- 2024SHAP scores fail pervasively even when Lipschitz succeedscited by 2
- 2023Self-Reinforcement Attention Mechanism For Tabular Learningcited by 1
- 2024Error Analysis of Shapley Value-Based Model Explanations: An Informative Perspectivecited by 1
- 2024Stronger Baseline Models -- A Key Requirement for Aligning Machine Learning Research with Clinical Utilitycited by 1
- 2024Explaining the Unexplained: Revealing Hidden Correlations for Better Interpretabilitycited by 1
- 2025The Explanation Game -- Rekindled (Extended Version)cited by 1
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithmscited by 1
- 2023What's meant by explainable model: A Scoping Reviewcited by 0
- 2024Unifying Interpretability and Explainability for Alzheimer's Disease Progression Predictioncited by 0
- 2025Feature-Guided Neighbor Selection for Non-Expert Evaluation of Model Predictionscited by 0
- 2026Towards Rigorous Explainability by Feature Attributioncited by 0
- 2026We Need Explanation Cards to Connect Explanation Algorithms to the Real Worldcited by 0
- 2026Beyond Shapley: Efficient Computation of Asymmetric Shapley Valuescited by 0
- 2026X-WAD: eXplainable Web Anomaly Detectioncited by 0
- 2026Solving Hard XAI Queries Based on a Compiled Dual-Rail Encodingcited by 0
- 2026Solving Hard XAI Queries Based on a Compiled Dual-Rail Encoding4 Sep 2026
- 2026X-WAD: eXplainable Web Anomaly Detection27 Aug 2026
- 2026Beyond Shapley: Efficient Computation of Asymmetric Shapley Values23 Jun 2026
- 2026We Need Explanation Cards to Connect Explanation Algorithms to the Real World15 Jun 2026
- 2026Towards Rigorous Explainability by Feature Attribution17 Apr 2026
- 2025Feature-Guided Neighbor Selection for Non-Expert Evaluation of Model Predictions8 Jul 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025The Explanation Game -- Rekindled (Extended Version)20 Jan 2025
- 2024SHAP scores fail pervasively even when Lipschitz succeeds18 Dec 2024
- 2024Explaining the Unexplained: Revealing Hidden Correlations for Better Interpretability2 Dec 2024
- 2024Formal Explanations for Neuro-Symbolic AI18 Oct 2024
- 2024Stronger Baseline Models -- A Key Requirement for Aligning Machine Learning Research with Clinical Utility18 Sep 2024
19 more
- 2024Auditing Local Explanations is Hard18 Jul 2024
- 2024Unifying Interpretability and Explainability for Alzheimer's Disease Progression Prediction11 Jun 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2024From SHAP Scores to Feature Importance Scores20 May 2024
- 2024Error Analysis of Shapley Value-Based Model Explanations: An Informative Perspective21 Apr 2024
- 2024Causality from Bottom to Top: A Survey17 Mar 2024
- 2024X Hacking: The Threat of Misguided AutoML16 Jan 2024
- 2023Anytime Approximate Formal Feature Attribution12 Dec 2023
- 2023A Uniform Language to Explain Decision Trees18 Oct 2023
- 2023Refutation of Shapley Values for XAI -- Additional Evidence30 Sep 2023
- 2023Axiomatic Aggregations of Abductive Explanations29 Sep 2023
- 2023A Refutation of Shapley Values for Explainability6 Sep 2023
- 2023What's meant by explainable model: A Scoping Review18 Jul 2023
- 2023On Formal Feature Attribution and Its Approximation7 Jul 2023
- 2023Explainability is NOT a Game27 Jun 2023
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Values9 Jun 2023
- 2023Self-Reinforcement Attention Mechanism For Tabular Learning19 May 2023
- 2023Disproving XAI Myths with Formal Methods -- Initial Results13 May 2023
- 2023Explaining Exchange Rate Forecasts with Macroeconomic Fundamentals Using Interpretive Machine Learning23 Mar 2023
- 2026X-WAD: eXplainable Web Anomaly Detectioncited by 0
- 2026X-WAD: eXplainable Web Anomaly Detection27 Aug 2026
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2023Explainability is NOT a Gamecited by 23
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2023On Formal Feature Attribution and Its Approximationcited by 11
- 2023Axiomatic Aggregations of Abductive Explanationscited by 10
- 2023Anytime Approximate Formal Feature Attributioncited by 9
- 2024From SHAP Scores to Feature Importance Scorescited by 8
- 2024Auditing Local Explanations is Hardcited by 8
- 2024Formal Explanations for Neuro-Symbolic AIcited by 6
- 2023Explaining Exchange Rate Forecasts with Macroeconomic Fundamentals Using Interpretive Machine Learningcited by 5
- 2024X Hacking: The Threat of Misguided AutoMLcited by 5
- 2024Causality from Bottom to Top: A Surveycited by 5
12 most cited of 29 All 29 (JSON)
- 2026Solving Hard XAI Queries Based on a Compiled Dual-Rail Encoding4 Sep 2026
- 2026Beyond Shapley: Efficient Computation of Asymmetric Shapley Values23 Jun 2026
- 2026We Need Explanation Cards to Connect Explanation Algorithms to the Real World15 Jun 2026
- 2026Towards Rigorous Explainability by Feature Attribution17 Apr 2026
- 2025Feature-Guided Neighbor Selection for Non-Expert Evaluation of Model Predictions8 Jul 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025The Explanation Game -- Rekindled (Extended Version)20 Jan 2025
- 2024SHAP scores fail pervasively even when Lipschitz succeeds18 Dec 2024
- 2024Explaining the Unexplained: Revealing Hidden Correlations for Better Interpretability2 Dec 2024
- 2024Formal Explanations for Neuro-Symbolic AI18 Oct 2024
- 2024Stronger Baseline Models -- A Key Requirement for Aligning Machine Learning Research with Clinical Utility18 Sep 2024
- 2024Auditing Local Explanations is Hard18 Jul 2024
12 newest of 29 All 29 (JSON)