shapiq: Shapley Interactions for Machine Learning
Not on the map. Why?
Abstract (arXiv)
Originally rooted in game theory, the Shapley Value (SV) has recently become an important tool in machine learning research. Perhaps most notably, it is used for feature attribution and data valuation in explainable artificial intelligence. Shapley Interactions (SIs) naturally extend the SV and address its limitations by assigning joint contributions to groups of entities, which enhance understanding of black box machine learning models. Due to the exponential complexity of computing SVs and SIs, various methods have been proposed that exploit structural assumptions or yield probabilistic estimates given limited resources. In this work, we introduce shapiq, an open-source Python package that unifies state-of-the-art algorithms to efficiently compute SVs and any-order SIs in an application-agnostic framework. Moreover, it includes a benchmarking suite containing 11 machine learning applications of SIs with pre-computed games and ground-truth values to systematically assess computational performance across domains. For practitioners, shapiq is able to explain and visualize any-order feature interactions in predictions of models, including vision transformers, language models, as well as XGBoost and LightGBM with TreeSHAP-IQ. With shapiq, we extend shap beyond feature attributions and consolidate the application of SVs and SIs in machine learning that facilitates future research. The source code and documentation are available at https://github.com/mmschlk/shapiq.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 48 of its 100 references that are in the map. First posted on arXiv 2 Oct 2024.
Builds on
48 of 100 references.
References · 48
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
- 2019The many Shapley values for model explanationcited by 341
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
- 2019Explaining individual predictions when features are dependent: More accurate approximations to Shapley valuescited by 205
- 2020Problems with Shapley-value-based explanations as feature importance measurescited by 198
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2017OpenML Benchmarking Suitescited by 169
36 more
- 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 153
- 2019The Shapley Taylor Interaction Indexcited by 143
- 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 125
- 2020True to the Model or True to the Data?cited by 123
- 2022Algorithms to estimate Shapley value feature attributionscited by 114
- 2022The Shapley Value in Machine Learningcited by 97
- 2020Shapley explainability on the data manifoldcited by 88
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2020How does this interaction affect me? Interpretable attribution for feature interactionscited by 73
- 2022Faith-Shap: The Faithful Shapley Interaction Indexcited by 68
- 2019OpenML-Python: an extensible Python API for OpenMLcited by 62
- 2021Synthetic Benchmarks for Scientific Research in Explainable Machine Learningcited by 59
- 2022From Shapley Values to Generalized Additive Models and backcited by 59
- 2018iNNvestigate neural networks!cited by 58
- 2013Bounding the Estimation Error of Sampling-based Shapley Value Approximationcited by 56
- 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
- 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 50
- 2021Discovering and Explaining the Representation Bottleneck of DNNscited by 42
- 2020dalex: Responsible Machine Learning with Interactive Explainability and Fairness in Pythoncited by 40
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2023Approximating the Shapley Value without Marginal Contributionscited by 34
- 2024Beyond TreeSHAP: Efficient Computation of Any-Order Shapley Interactions for Tree Ensemblescited by 30
- 2020The Grammar of Interactive Explanatory Model Analysiscited by 24
- 2021The Shapley Value of Classifiers in Ensemble Gamescited by 23
- 2024KernelSHAP-IQ: Weighted Least-Square Optimization for Shapley Interactionscited by 22
- 2021Incentivizing Collaboration in Machine Learning via Synthetic Data Rewardscited by 20
- 2021Using Shapley Values and Variational Autoencoders to Explain Predictive Models with Dependent Mixed Featurescited by 19
- 2023On the Robustness of Removal-Based Feature Attributionscited by 18
- 2024SVARM-IQ: Efficient Approximation of Any-order Shapley Interactions through Stratificationcited by 16
- 2021Joint Shapley values: a measure of joint feature importancecited by 15
- 2023A Comparative Study of Methods for Estimating Conditional Shapley Values and When to Use Themcited by 15
- 2020High Dimensional Model Explanations: an Axiomatic Approachcited by 13
- 2024Interpretable Machine Learning for TabPFNcited by 10
- 2022A k-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learningcited by 8
- 2022Probably Approximate Shapley Fairness with Applications in Machine Learningcited by 6
- 2022Unsupervised Features Ranking via Coalitional Game Theory for Categorical Datacited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 22; 2026: 18.
42 papers.
Sort:
By area:
- 2025Exact Computation of Any-Order Shapley Interactions for Graph Neural Networkscited by 12
- 2024Unifying Feature-Based Explanations with Functional ANOVA and Cooperative Game Theorycited by 10
- 2025Understanding and Optimizing Agentic Workflows via Shapley valuecited by 9
- 2025Explaining Similarity in Vision-Language Encoders with Weighted Banzhaf Interactionscited by 6
- 2026PolySHAP: Extending KernelSHAP with Interaction-Informed Polynomial Regressioncited by 6
- 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Pythoncited by 5
- 2025Tree Ensemble Explainability through the Hoeffding Functional Decomposition and TreeHFD Algorithmcited by 5
- 2025HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimizationcited by 4
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervalscited by 4
- 2025Amortized Linear-time Exact Shapley Value for Product-Kernel Methodscited by 3
- 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithmcited by 3
- 2025Adaptive Prompting: Ad-hoc Prompt Composition for Social Bias Detectioncited by 2
30 more
- 2025EvalxNLP: A Framework for Benchmarking Post-Hoc Explainability Methods on NLP Modelscited by 2
- 2025Physics-Informed Spectral Modeling for Hyperspectral Imagingcited by 2
- 2025Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Valuecited by 2
- 2025Tractable Shapley Values and Interactions via Tensor Networkscited by 2
- 2025Overview and practical recommendations on using Shapley Values for identifying predictive biomarkers via CATE modelingcited by 1
- 2025SIM-Shapley: A Stable and Computationally Efficient Approach to Shapley Value Approximationcited by 1
- 2026Lecture notes on Machine Learning applications for global fitscited by 1
- 2026Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactionscited by 1
- 2026Generalized Functional ANOVA: A Complete Theoretical Frameworkcited by 1
- 2026Measuring Cross-Modal Synergy: A Benchmark for VLM Explainabilitycited by 1
- 2026The Representational Limit of Scalar Interactions: An Interventional Decompositioncited by 1
- 2024Upside-Down Reinforcement Learning for More Interpretable Optimal Controlcited by 0
- 2025From Rows to Yields: How Foundation Models for Tabular Data Simplify Crop Yield Predictioncited by 0
- 2025Simulating Biases for Interpretable Fairness in Offline and Online Classifierscited by 0
- 2025Adversarial Training Improves Generalization Under Distribution Shifts in Bird Sound Classificationcited by 0
- 2025Owen Sampling Accelerates Contribution Estimation in Federated Learningcited by 0
- 2025CUBE: Contrastive Understanding by Balanced Experimentscited by 0
- 2025Beyond Additivity: Sparse Isotonic Shapley Regression toward Nonlinear Explainabilitycited by 0
- 2026TT-FSI: Scalable Faithful Shapley Interactions via Tensor-Traincited by 0
- 2026Computing Conditional Shapley Values Using Tabular Foundation Modelscited by 0
- 2026When One Modality Rules Them All: Backdoor Modality Collapse in Multimodal Diffusion Modelscited by 0
- 2026ConfoundingSHAP: Quantifying confounding strength in causal inferencecited by 0
- 2026Constraint-Data-Value-Maximization: Utilizing Data Attribution for Effective Data Pruning in Low-Data Environmentscited by 0
- 2026Explainable AI Isn't Enough! Rethinking Algorithmic Contestabilitycited by 0
- 2026Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shiftcited by 0
- 2026Unification and Optimization of Robust Supervised Learningcited by 0
- 2026SAILS: Surrogate-based Analysis of Interactions via Local Effect Smoothscited by 0
- 2026Interactions Between Crosscoder Features: A Compact Proofs Perspectivecited by 0
- 2026Which Hyperparameters Matter? A Game-Theoretic Framework for Interpretable Hyperparameter Sensitivity Analysiscited by 0
- 2026In-Context Learning to Assess Built Environment Impacts on Perceived Neighborhood Walkability Among Mobility-impaired Older Adultscited by 0
- 2026In-Context Learning to Assess Built Environment Impacts on Perceived Neighborhood Walkability Among Mobility-impaired Older Adults1 Aug 2026
- 2026Which Hyperparameters Matter? A Game-Theoretic Framework for Interpretable Hyperparameter Sensitivity Analysis17 Jul 2026
- 2026The Representational Limit of Scalar Interactions: An Interventional Decomposition17 Jun 2026
- 2026Interactions Between Crosscoder Features: A Compact Proofs Perspective8 Jun 2026
- 2026SAILS: Surrogate-based Analysis of Interactions via Local Effect Smooths8 Jun 2026
- 2026Unification and Optimization of Robust Supervised Learning27 May 2026
- 2026Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift26 May 2026
- 2026Measuring Cross-Modal Synergy: A Benchmark for VLM Explainability21 May 2026
- 2026Generalized Functional ANOVA: A Complete Theoretical Framework18 May 2026
- 2026Explainable AI Isn't Enough! Rethinking Algorithmic Contestability15 May 2026
- 2026Constraint-Data-Value-Maximization: Utilizing Data Attribution for Effective Data Pruning in Low-Data Environments11 May 2026
- 2026ConfoundingSHAP: Quantifying confounding strength in causal inference11 May 2026
30 more
- 2026Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions6 May 2026
- 2026Lecture notes on Machine Learning applications for global fits8 Apr 2026
- 2026When One Modality Rules Them All: Backdoor Modality Collapse in Multimodal Diffusion Models6 Mar 2026
- 2026Computing Conditional Shapley Values Using Tabular Foundation Models10 Feb 2026
- 2026PolySHAP: Extending KernelSHAP with Interaction-Informed Polynomial Regression26 Jan 2026
- 2026TT-FSI: Scalable Faithful Shapley Interactions via Tensor-Train5 Jan 2026
- 2025Beyond Additivity: Sparse Isotonic Shapley Regression toward Nonlinear Explainability2 Dec 2025
- 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithm12 Nov 2025
- 2025Tree Ensemble Explainability through the Hoeffding Functional Decomposition and TreeHFD Algorithm28 Oct 2025
- 2025Tractable Shapley Values and Interactions via Tensor Networks25 Oct 2025
- 2025Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value2 Oct 2025
- 2025CUBE: Contrastive Understanding by Balanced Experiments13 Sep 2025
- 2025Physics-Informed Spectral Modeling for Hyperspectral Imaging29 Aug 2025
- 2025Owen Sampling Accelerates Contribution Estimation in Federated Learning28 Aug 2025
- 2025Explaining Similarity in Vision-Language Encoders with Weighted Banzhaf Interactions7 Aug 2025
- 2025Adversarial Training Improves Generalization Under Distribution Shifts in Bird Sound Classification18 Jul 2025
- 2025Simulating Biases for Interpretable Fairness in Offline and Online Classifiers14 Jul 2025
- 2025From Rows to Yields: How Foundation Models for Tabular Data Simplify Crop Yield Prediction23 Jun 2025
- 2025Amortized Linear-time Exact Shapley Value for Product-Kernel Methods22 May 2025
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervals19 May 2025
- 2025SIM-Shapley: A Stable and Computationally Efficient Approach to Shapley Value Approximation13 May 2025
- 2025EvalxNLP: A Framework for Benchmarking Post-Hoc Explainability Methods on NLP Models2 May 2025
- 2025Overview and practical recommendations on using Shapley Values for identifying predictive biomarkers via CATE modeling2 May 2025
- 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Python2 Apr 2025
- 2025Adaptive Prompting: Ad-hoc Prompt Composition for Social Bias Detection10 Feb 2025
- 2025HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimization3 Feb 2025
- 2025Understanding and Optimizing Agentic Workflows via Shapley value1 Feb 2025
- 2025Exact Computation of Any-Order Shapley Interactions for Graph Neural Networks28 Jan 2025
- 2024Unifying Feature-Based Explanations with Functional ANOVA and Cooperative Game Theory22 Dec 2024
- 2024Upside-Down Reinforcement Learning for More Interpretable Optimal Control18 Nov 2024
- 2025Exact Computation of Any-Order Shapley Interactions for Graph Neural Networkscited by 12
- 2024Unifying Feature-Based Explanations with Functional ANOVA and Cooperative Game Theorycited by 10
- 2026PolySHAP: Extending KernelSHAP with Interaction-Informed Polynomial Regressioncited by 6
- 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Pythoncited by 5
- 2025Tree Ensemble Explainability through the Hoeffding Functional Decomposition and TreeHFD Algorithmcited by 5
- 2025HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimizationcited by 4
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervalscited by 4
- 2025Amortized Linear-time Exact Shapley Value for Product-Kernel Methodscited by 3
- 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithmcited by 3
- 2025EvalxNLP: A Framework for Benchmarking Post-Hoc Explainability Methods on NLP Modelscited by 2
- 2025Physics-Informed Spectral Modeling for Hyperspectral Imagingcited by 2
- 2025Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Valuecited by 2
12 most cited of 37 All 37 (JSON)
- 2026In-Context Learning to Assess Built Environment Impacts on Perceived Neighborhood Walkability Among Mobility-impaired Older Adults1 Aug 2026
- 2026Which Hyperparameters Matter? A Game-Theoretic Framework for Interpretable Hyperparameter Sensitivity Analysis17 Jul 2026
- 2026The Representational Limit of Scalar Interactions: An Interventional Decomposition17 Jun 2026
- 2026Interactions Between Crosscoder Features: A Compact Proofs Perspective8 Jun 2026
- 2026SAILS: Surrogate-based Analysis of Interactions via Local Effect Smooths8 Jun 2026
- 2026Unification and Optimization of Robust Supervised Learning27 May 2026
- 2026Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift26 May 2026
- 2026Generalized Functional ANOVA: A Complete Theoretical Framework18 May 2026
- 2026Explainable AI Isn't Enough! Rethinking Algorithmic Contestability15 May 2026
- 2026Constraint-Data-Value-Maximization: Utilizing Data Attribution for Effective Data Pruning in Low-Data Environments11 May 2026
- 2026ConfoundingSHAP: Quantifying confounding strength in causal inference11 May 2026
- 2026Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions6 May 2026
12 newest of 37 All 37 (JSON)