On the Tractability of SHAP Explanations
Not on the map. Why?
Abstract (arXiv)
SHAP explanations are a popular feature-attribution mechanism for explainable AI. They use game-theoretic notions to measure the influence of individual features on the prediction of a machine learning model. Despite a lot of recent interest from both academia and industry, it is not known whether SHAP explanations of common machine learning models can be computed efficiently. In this paper, we establish the complexity of computing the SHAP explanation in three important settings. First, we consider fully-factorized data distributions, and show that the complexity of computing the SHAP explanation is the same as the complexity of computing the expected value of the model. This fully-factorized setting is often used to simplify the SHAP computation, yet our results show that the computation can be intractable for commonly used models such as logistic regression. Going beyond fully-factorized distributions, we show that computing SHAP explanations is already intractable for a very simple setting: computing SHAP explanations of trivial classifiers over naive Bayes distributions. Finally, we show that even computing SHAP over the empirical distribution is #P-hard.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 10; 2023: 21; 2024: 18; 2025: 18; 2026: 10.
92 papers.
Sort:
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 123
- 2022Additive MIL: Intrinsically Interpretable Multiple Instance Learning for Pathologycited by 58
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021Explanations for Monotonic Classifierscited by 39
- 2021Tractable Regularization of Probabilistic Circuitscited by 39
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2021On the Complexity of SHAP-Score-Based Explanations: Tractability via Knowledge Compilation and Non-Approximability Resultscited by 32
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 30
- 2023Explainability is NOT a Gamecited by 23
38 more
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2023Pixel-Grounded Prototypical Part Networkscited by 18
- 2023Explaining Quantum Circuits with Shapley Values: Towards Explainable Quantum Machine Learningcited by 17
- 2022Accelerating Shapley Explanation via Contributive Cooperator Selectioncited by 13
- 2022Unfooling Perturbation-Based Post Hoc Explainerscited by 12
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2021Evaluating the Values of Sources in Transfer Learningcited by 11
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2023Compositional Probabilistic and Causal Inference using Tractable Circuit Modelscited by 10
- 2024On the Tractability of SHAP Explanations under Markovian Distributionscited by 10
- 2024A Compositional Atlas for Algebraic Circuitscited by 10
- 2022Tractable Boolean and Arithmetic Circuitscited by 9
- 2021Ensembles of Random SHAPscited by 8
- 2024From SHAP Scores to Feature Importance Scorescited by 8
- 2024ProtoS-ViT: Visual foundation models for sparse self-explainable classificationscited by 8
- 2024SHAP values via sparse Fourier representationcited by 8
- 2025Investigating the Duality of Interpretability and Explainability in Machine Learningcited by 8
- 2025SHAP Meets Tensor Networks: Provably Tractable Explanations with Parallelismcited by 8
- 2021An Imprecise SHAP as a Tool for Explaining the Class Probability Distributions under Limited Training Datacited by 6
- 2023Interpretable Survival Analysis for Heart Failure Risk Predictioncited by 6
- 2024Expected Shapley-Like Scores of Boolean Functions: Complexity and Applications to Probabilistic Databasescited by 6
- 2021Coalitional strategies for efficient individual prediction explanationcited by 4
- 2021Toward a Unified Framework for Debugging Concept-based Modelscited by 4
- 2022Combining Counterfactuals With Shapley Values To Explain Image Modelscited by 4
- 2023Efficient SAGE Estimation via Causal Structure Learningcited by 4
- 2023A Refutation of Shapley Values for Explainabilitycited by 4
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
- 2023The Thousand Faces of Explainable AI Along the Machine Learning Life Cycle: Industrial Reality and Current State of Researchcited by 4
- 2024Transforming In-Vehicle Network Intrusion Detection: VAE-based Knowledge Distillation Meets Explainable AIcited by 4
- 2021Pitfalls of Explainable ML: An Industry Perspectivecited by 3
- 2021A Framework for Evaluating Post Hoc Feature-Additive Explainerscited by 3
- 2022New-Onset Diabetes Assessment Using Artificial Intelligence-Enhanced Electrocardiographycited by 3
- 2022Towards a Theory of Faithfulness: Faithful Explanations of Differentiable Classifiers over Continuous Datacited by 3
- 2023Efficient Computation of Shap Explanation Scores for Neural Network Classifiers via Knowledge Compilationcited by 3
- 2023Derivative-based Shapley value for global sensitivity analysis and machine learning explainabilitycited by 3
- 2025Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the roomcited by 3
- 2025Additive Models Explained: A Computational Complexity Approachcited by 3
- 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithmcited by 3
50 most cited of 92 All 92 (JSON)
- 2026CAR-MIL: Counterfactual Attention Regularization for Multiple Instance Learning8 Sep 2026
- 2026Beyond Shapley: Efficient Computation of Asymmetric Shapley Values23 Jun 2026
- 2026Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks22 May 2026
- 2026Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions6 May 2026
- 2026eDySec: A Deep Learning-based Explainable Dynamic Analysis Framework for Detecting Malicious Packages in PyPI Ecosystem29 Apr 2026
- 2026WOODELF-HD: Efficient Background SHAP for High-Depth Decision Trees12 Apr 2026
- 2026Emergency Lane-Change Simulation: A Behavioral Guidance Approach for Risky Scenario Generation8 Mar 2026
- 2026Exact Functional ANOVA Decomposition for Categorical Inputs Models3 Mar 2026
- 2026Unifying Formal Explanations: A Complexity-Theoretic Perspective20 Feb 2026
- 2026TT-FSI: Scalable Faithful Shapley Interactions via Tensor-Train5 Jan 2026
- 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithm12 Nov 2025
- 2025GroupSHAP-Guided Integration of Financial News Keywords and Technical Indicators for Stock Price Prediction27 Oct 2025
38 more
- 2025SHAP Meets Tensor Networks: Provably Tractable Explanations with Parallelism24 Oct 2025
- 2025Additive Models Explained: A Computational Complexity Approach24 Oct 2025
- 2025Network-Based Detection of Autism Spectrum Disorder Using Sustainable and Non-invasive Salivary Biomarkers19 Sep 2025
- 2025An Interpretable Benchmark for Clickbait Detection and Tactic Attribution13 Sep 2025
- 2025Understanding Action Effects through Instrumental Empowerment in Multi-Agent Reinforcement Learning21 Aug 2025
- 2025Rigorous Feature Importance Scores based on Shapley Value and Banzhaf Index16 Aug 2025
- 2025MUPAX: Multidimensional Problem Agnostic eXplainable AI17 Jul 2025
- 2025Customized Exploration of Landscape Features Driving Multi-Objective Combinatorial Optimization Performance2 Jul 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Enhancing ML Model Interpretability: Leveraging Fine-Tuned Large Language Models for Better Understanding of AI2 May 2025
- 2025Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the room22 Apr 2025
- 2025Are We Merely Justifying Results ex Post Facto? Quantifying Explanatory Inversion in Post-Hoc Model Explanations11 Apr 2025
- 2025Investigating the Duality of Interpretability and Explainability in Machine Learning27 Mar 2025
- 2025EVolutionary Independent DEtermiNistiC Explanation20 Jan 2025
- 2025The Explanation Game -- Rekindled (Extended Version)20 Jan 2025
- 2025When is the Computation of a Feature Attribution Method Tractable?4 Jan 2025
- 2024A Shapley Value Estimation Speedup for Efficient Explainable Quantum AI19 Dec 2024
- 2024A Compositional Atlas for Algebraic Circuits7 Dec 2024
- 2024DNAMite: Interpretable Calibrated Survival Analysis with Discretized Additive Models8 Nov 2024
- 2024Transforming In-Vehicle Network Intrusion Detection: VAE-based Knowledge Distillation Meets Explainable AI11 Oct 2024
- 2024Prediction by Machine Learning Analysis of Genomic Data Phenotypic Frost Tolerance in Perccottus glenii11 Oct 2024
- 2024The Sets of Power10 Oct 2024
- 2024SHAP values via sparse Fourier representation8 Oct 2024
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Backward Compatibility in Attributive Explanation and Enhanced Model Training Method5 Aug 2024
- 2024BONES: a Benchmark fOr Neural Estimation of Shapley values23 Jul 2024
- 2024ProtoS-ViT: Visual foundation models for sparse self-explainable classifications14 Jun 2024
- 2024Local vs. Global Interpretability: A Computational Complexity Perspective5 Jun 2024
- 2024From SHAP Scores to Feature Importance Scores20 May 2024
- 2024On the Tractability of SHAP Explanations under Markovian Distributions5 May 2024
- 2024Interpretable Prediction and Feature Selection for Survival Analysis23 Apr 2024
- 2024Probabilistic Shapley Value Modeling and Inference6 Feb 2024
- 2024The Distributional Uncertainty of the SHAP score in Explainable Machine Learning23 Jan 2024
- 2024Expected Shapley-Like Scores of Boolean Functions: Complexity and Applications to Probabilistic Databases12 Jan 2024
- 2023SurvBeNIM: The Beran-Based Neural Importance Model for Explaining the Survival Models11 Dec 2023
- 2023Unveiling The Factors of Aesthetic Preferences with Explainable AI24 Nov 2023
- 2023Fast Shapley Value Estimation: A Unified Approach2 Nov 2023
- 2023How Well Do Feature-Additive Explainers Explain Feature-Additive Predictors?27 Oct 2023
50 newest of 92 All 92 (JSON)
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 123
- 2022Additive MIL: Intrinsically Interpretable Multiple Instance Learning for Pathologycited by 58
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021Explanations for Monotonic Classifierscited by 39
- 2021Tractable Regularization of Probabilistic Circuitscited by 39
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2021On the Complexity of SHAP-Score-Based Explanations: Tractability via Knowledge Compilation and Non-Approximability Resultscited by 32
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 30
- 2023Explainability is NOT a Gamecited by 23
12 most cited of 92 All 92 (JSON)
- 2026CAR-MIL: Counterfactual Attention Regularization for Multiple Instance Learning8 Sep 2026
- 2026Beyond Shapley: Efficient Computation of Asymmetric Shapley Values23 Jun 2026
- 2026Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks22 May 2026
- 2026Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions6 May 2026
- 2026eDySec: A Deep Learning-based Explainable Dynamic Analysis Framework for Detecting Malicious Packages in PyPI Ecosystem29 Apr 2026
- 2026WOODELF-HD: Efficient Background SHAP for High-Depth Decision Trees12 Apr 2026
- 2026Emergency Lane-Change Simulation: A Behavioral Guidance Approach for Risky Scenario Generation8 Mar 2026
- 2026Exact Functional ANOVA Decomposition for Categorical Inputs Models3 Mar 2026
- 2026Unifying Formal Explanations: A Complexity-Theoretic Perspective20 Feb 2026
- 2026TT-FSI: Scalable Faithful Shapley Interactions via Tensor-Train5 Jan 2026
- 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithm12 Nov 2025
- 2025GroupSHAP-Guided Integration of Financial News Keywords and Technical Indicators for Stock Price Prediction27 Oct 2025
12 newest of 92 All 92 (JSON)