Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions
Not on the map. Why?
Abstract (arXiv)
Shapley values are a standard tool for explaining predictions of tree ensembles, with Path-Dependent SHAP being the most widely used variant. Despite substantial progress, existing methods still exhibit trade-offs between depth-dependent runtime, numerical stability, and support for higher-order interactions. To address these challenges, we introduce Quadrature-TreeSHAP, a quadrature-based reformulation of Path-Dependent TreeSHAP that is numerically stable, naturally extends to any-order Shapley interaction values and is practically insensitive to tree depth. Our implementation supports both CPU and GPU and is integrated into XGBoost. Our method is based on a weighted-Banzhaf interaction polynomial, which expresses Banzhaf interaction values as expectations under a feature participation probability p. Shapley values and any-order interaction values are then recovered by integrating these polynomials over p from 0 to 1. We evaluate these integrals using Gauss-Legendre quadrature, and show that, in practice, only 8 fixed quadrature points are sufficient to reach machine precision. In fact, Quadrature-TreeSHAP with 8 fixed points achieves greater numerical stability than TreeSHAP. This fixed-point formulation removes depth dependence from the inner computation and enables efficient SIMD execution. We confirm these advantages empirically. On 12 XGBoost benchmarks, Quadrature-TreeSHAP computes Shapley values 1.06x-10.59x faster than TreeSHAP on CPU and 1.84x-6.95x faster than GPUTreeSHAP on GPU. Shapley pairwise interactions are 3.80x-58.11x faster on CPU, with higher-order interactions achieving speedups of up to 1200x compared to TreeSHAP-IQ.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 57 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
19 of 57 references.
References · 19
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2019The Shapley Taylor Interaction Indexcited by 143
- 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 126
- 2020On the Tractability of SHAP Explanationscited by 92
- 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 50
- 2024shapiq: Shapley Interactions for Machine Learningcited by 42
- 2024Beyond TreeSHAP: Efficient Computation of Any-Order Shapley Interactions for Tree Ensemblescited by 30
- 2021Fast TreeSHAP: Accelerating SHAP Value Computation for Treescited by 28
- 2017CatBoost: unbiased boosting with categorical featurescited by 27
- 2020GPUTreeShap: Massively Parallel Exact Calculation of SHAP Scores for Tree Ensemblescited by 14
7 more
- 2022Linear TreeShapcited by 12
- 2023TsSHAP: Robust model agnostic feature-based explainability for time series forecastingcited by 5
- 2024Fast Estimation of Partial Dependence Functions using Treescited by 4
- 2025HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimizationcited by 4
- 2026TreeGrad-Ranker: Feature Ranking via O(L)-Time Gradients for Decision Treescited by 4
- 2023On marginal feature attributions of tree-based modelscited by 3
- 2025From Decision Trees to Boolean Logic: A Fast and Unified SHAP Algorithmcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.