Beyond Additivity: Sparse Isotonic Shapley Regression toward Nonlinear Explainability
Not on the map. Why?
Abstract (arXiv)
Shapley values, a gold standard for feature attribution in Explainable AI, face two key challenges. First, the canonical Shapley framework assumes that the worth function is additive, yet real-world payoff constructions--driven by non-Gaussian distributions, heavy tails, feature dependence, or domain-specific loss scales--often violate this assumption, leading to distorted attributions. Second, achieving sparse explanations in high-dimensional settings by computing dense Shapley values and then applying ad hoc thresholding is costly and risks inconsistency. We introduce Sparse Isotonic Shapley Regression (SISR), a unified nonlinear explanation framework. SISR simultaneously learns a monotonic transformation to restore additivity--obviating the need for a closed-form specification--and enforces an L0 sparsity constraint on the Shapley vector, enhancing computational efficiency in large feature spaces. Its optimization algorithm leverages Pool-Adjacent-Violators for efficient isotonic regression and normalized hard-thresholding for support selection, ensuring ease in implementation and global convergence guarantees. Analysis shows that SISR recovers the true transformation in a wide range of scenarios and achieves strong support recovery even in high noise. Moreover, we are the first to demonstrate that irrelevant features and inter-feature dependencies can induce a true payoff transformation that deviates substantially from linearity. Extensive experiments demonstrate that SISR stabilizes attributions across payoff schemes and correctly filters irrelevant features; in contrast, standard Shapley values suffer severe rank and sign distortions. By unifying nonlinear transformation estimation with sparsity pursuit, SISR advances the frontier of nonlinear explainability, providing a theoretically grounded and practical attribution framework.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 51 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
15 of 51 references.
References · 15
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
- 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 153
- 2019The Shapley Taylor Interaction Indexcited by 143
- 2019Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximationcited by 115
- 2022From Shapley Values to Generalized Additive Models and backcited by 59
- 2021Shapley values for feature selection: The good, the bad, and the axiomscited by 54
- 2024shapiq: Shapley Interactions for Machine Learningcited by 42
- 2020The Grammar of Interactive Explanatory Model Analysiscited by 24
Built on by
Not cited yet.