mlsanityData to 7 Oct 2026

shapiq: Shapley Interactions for Machine Learning

arXiv 2410.01649 ↗First posted 2 Oct 2024cs.LG cs.AIcited by 42

Not on the map. Why?

Abstract (arXiv)

Originally rooted in game theory, the Shapley Value (SV) has recently become an important tool in machine learning research. Perhaps most notably, it is used for feature attribution and data valuation in explainable artificial intelligence. Shapley Interactions (SIs) naturally extend the SV and address its limitations by assigning joint contributions to groups of entities, which enhance understanding of black box machine learning models. Due to the exponential complexity of computing SVs and SIs, various methods have been proposed that exploit structural assumptions or yield probabilistic estimates given limited resources. In this work, we introduce shapiq, an open-source Python package that unifies state-of-the-art algorithms to efficiently compute SVs and any-order SIs in an application-agnostic framework. Moreover, it includes a benchmarking suite containing 11 machine learning applications of SIs with pre-computed games and ground-truth values to systematically assess computational performance across domains. For practitioners, shapiq is able to explain and visualize any-order feature interactions in predictions of models, including vision transformers, language models, as well as XGBoost and LightGBM with TreeSHAP-IQ. With shapiq, we extend shap beyond feature attributions and consolidate the application of SVs and SIs in machine learning that facilitates future research. The source code and documentation are available at https://github.com/mmschlk/shapiq.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 48 of its 100 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

48 of 100 references.

References · 48

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  4. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  5. 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
  6. 2019The many Shapley values for model explanationcited by 341
  7. 2018Manipulating and Measuring Model Interpretabilitycited by 256
  8. 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
  9. 2019Explaining individual predictions when features are dependent: More accurate approximations to Shapley valuescited by 205
  10. 2020Problems with Shapley-value-based explanations as feature importance measurescited by 198
  11. 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
  12. 2017OpenML Benchmarking Suitescited by 169
36 more
  1. 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 153
  2. 2019The Shapley Taylor Interaction Indexcited by 143
  3. 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 125
  4. 2020True to the Model or True to the Data?cited by 123
  5. 2022Algorithms to estimate Shapley value feature attributionscited by 114
  6. 2022The Shapley Value in Machine Learningcited by 97
  7. 2020Shapley explainability on the data manifoldcited by 88
  8. 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
  9. 2020How does this interaction affect me? Interpretable attribution for feature interactionscited by 73
  10. 2022Faith-Shap: The Faithful Shapley Interaction Indexcited by 68
  11. 2019OpenML-Python: an extensible Python API for OpenMLcited by 62
  12. 2021Synthetic Benchmarks for Scientific Research in Explainable Machine Learningcited by 59
  13. 2022From Shapley Values to Generalized Additive Models and backcited by 59
  14. 2018iNNvestigate neural networks!cited by 58
  15. 2013Bounding the Estimation Error of Sampling-based Shapley Value Approximationcited by 56
  16. 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
  17. 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 50
  18. 2021Discovering and Explaining the Representation Bottleneck of DNNscited by 42
  19. 2020dalex: Responsible Machine Learning with Interactive Explainability and Fairness in Pythoncited by 40
  20. 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
  21. 2023Approximating the Shapley Value without Marginal Contributionscited by 34
  22. 2024Beyond TreeSHAP: Efficient Computation of Any-Order Shapley Interactions for Tree Ensemblescited by 30
  23. 2020The Grammar of Interactive Explanatory Model Analysiscited by 24
  24. 2021The Shapley Value of Classifiers in Ensemble Gamescited by 23
  25. 2024KernelSHAP-IQ: Weighted Least-Square Optimization for Shapley Interactionscited by 22
  26. 2021Incentivizing Collaboration in Machine Learning via Synthetic Data Rewardscited by 20
  27. 2021Using Shapley Values and Variational Autoencoders to Explain Predictive Models with Dependent Mixed Featurescited by 19
  28. 2023On the Robustness of Removal-Based Feature Attributionscited by 18
  29. 2024SVARM-IQ: Efficient Approximation of Any-order Shapley Interactions through Stratificationcited by 16
  30. 2021Joint Shapley values: a measure of joint feature importancecited by 15
  31. 2023A Comparative Study of Methods for Estimating Conditional Shapley Values and When to Use Themcited by 15
  32. 2020High Dimensional Model Explanations: an Axiomatic Approachcited by 13
  33. 2024Interpretable Machine Learning for TabPFNcited by 10
  34. 2022A k-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learningcited by 8
  35. 2022Probably Approximate Shapley Fairness with Applications in Machine Learningcited by 6
  36. 2022Unsupervised Features Ranking via Coalitional Game Theory for Categorical Datacited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 22; 2026: 18.

42 papers.

Sort:

By area:

  1. 2025Exact Computation of Any-Order Shapley Interactions for Graph Neural Networkscited by 12
  2. 2024Unifying Feature-Based Explanations with Functional ANOVA and Cooperative Game Theorycited by 10
  3. 2025Understanding and Optimizing Agentic Workflows via Shapley valuecited by 9
  4. 2025Explaining Similarity in Vision-Language Encoders with Weighted Banzhaf Interactionscited by 6
  5. 2026PolySHAP: Extending KernelSHAP with Interaction-Informed Polynomial Regressioncited by 6
  6. 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Pythoncited by 5
  7. 2025Tree Ensemble Explainability through the Hoeffding Functional Decomposition and TreeHFD Algorithmcited by 5
  8. 2025HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimizationcited by 4
  9. 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervalscited by 4
  10. 2025Amortized Linear-time Exact Shapley Value for Product-Kernel Methodscited by 3
  11. 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithmcited by 3
  12. 2025Adaptive Prompting: Ad-hoc Prompt Composition for Social Bias Detectioncited by 2
30 more
  1. 2025EvalxNLP: A Framework for Benchmarking Post-Hoc Explainability Methods on NLP Modelscited by 2
  2. 2025Physics-Informed Spectral Modeling for Hyperspectral Imagingcited by 2
  3. 2025Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Valuecited by 2
  4. 2025Tractable Shapley Values and Interactions via Tensor Networkscited by 2
  5. 2025Overview and practical recommendations on using Shapley Values for identifying predictive biomarkers via CATE modelingcited by 1
  6. 2025SIM-Shapley: A Stable and Computationally Efficient Approach to Shapley Value Approximationcited by 1
  7. 2026Lecture notes on Machine Learning applications for global fitscited by 1
  8. 2026Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactionscited by 1
  9. 2026Generalized Functional ANOVA: A Complete Theoretical Frameworkcited by 1
  10. 2026Measuring Cross-Modal Synergy: A Benchmark for VLM Explainabilitycited by 1
  11. 2026The Representational Limit of Scalar Interactions: An Interventional Decompositioncited by 1
  12. 2024Upside-Down Reinforcement Learning for More Interpretable Optimal Controlcited by 0
  13. 2025From Rows to Yields: How Foundation Models for Tabular Data Simplify Crop Yield Predictioncited by 0
  14. 2025Simulating Biases for Interpretable Fairness in Offline and Online Classifierscited by 0
  15. 2025Adversarial Training Improves Generalization Under Distribution Shifts in Bird Sound Classificationcited by 0
  16. 2025Owen Sampling Accelerates Contribution Estimation in Federated Learningcited by 0
  17. 2025CUBE: Contrastive Understanding by Balanced Experimentscited by 0
  18. 2025Beyond Additivity: Sparse Isotonic Shapley Regression toward Nonlinear Explainabilitycited by 0
  19. 2026TT-FSI: Scalable Faithful Shapley Interactions via Tensor-Traincited by 0
  20. 2026Computing Conditional Shapley Values Using Tabular Foundation Modelscited by 0
  21. 2026When One Modality Rules Them All: Backdoor Modality Collapse in Multimodal Diffusion Modelscited by 0
  22. 2026ConfoundingSHAP: Quantifying confounding strength in causal inferencecited by 0
  23. 2026Constraint-Data-Value-Maximization: Utilizing Data Attribution for Effective Data Pruning in Low-Data Environmentscited by 0
  24. 2026Explainable AI Isn't Enough! Rethinking Algorithmic Contestabilitycited by 0
  25. 2026Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shiftcited by 0
  26. 2026Unification and Optimization of Robust Supervised Learningcited by 0
  27. 2026SAILS: Surrogate-based Analysis of Interactions via Local Effect Smoothscited by 0
  28. 2026Interactions Between Crosscoder Features: A Compact Proofs Perspectivecited by 0
  29. 2026Which Hyperparameters Matter? A Game-Theoretic Framework for Interpretable Hyperparameter Sensitivity Analysiscited by 0
  30. 2026In-Context Learning to Assess Built Environment Impacts on Perceived Neighborhood Walkability Among Mobility-impaired Older Adultscited by 0