mlsanityData to 7 Oct 2026

Beyond Additivity: Sparse Isotonic Shapley Regression toward Nonlinear Explainability

arXiv 2512.03112 ↗First posted 2 Dec 2025cs.LG cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Shapley values, a gold standard for feature attribution in Explainable AI, face two key challenges. First, the canonical Shapley framework assumes that the worth function is additive, yet real-world payoff constructions--driven by non-Gaussian distributions, heavy tails, feature dependence, or domain-specific loss scales--often violate this assumption, leading to distorted attributions. Second, achieving sparse explanations in high-dimensional settings by computing dense Shapley values and then applying ad hoc thresholding is costly and risks inconsistency. We introduce Sparse Isotonic Shapley Regression (SISR), a unified nonlinear explanation framework. SISR simultaneously learns a monotonic transformation to restore additivity--obviating the need for a closed-form specification--and enforces an L0 sparsity constraint on the Shapley vector, enhancing computational efficiency in large feature spaces. Its optimization algorithm leverages Pool-Adjacent-Violators for efficient isotonic regression and normalized hard-thresholding for support selection, ensuring ease in implementation and global convergence guarantees. Analysis shows that SISR recovers the true transformation in a wide range of scenarios and achieves strong support recovery even in high noise. Moreover, we are the first to demonstrate that irrelevant features and inter-feature dependencies can induce a true payoff transformation that deviates substantially from linearity. Extensive experiments demonstrate that SISR stabilizes attributions across payoff schemes and correctly filters irrelevant features; in contrast, standard Shapley values suffer severe rank and sign distortions. By unifying nonlinear transformation estimation with sparsity pursuit, SISR advances the frontier of nonlinear explainability, providing a theoretically grounded and practical attribution framework.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 51 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

15 of 51 references.

References · 15

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  4. 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
  5. 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
  6. 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 153
  7. 2019The Shapley Taylor Interaction Indexcited by 143
  8. 2019Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximationcited by 115
  9. 2022From Shapley Values to Generalized Additive Models and backcited by 59
  10. 2021Shapley values for feature selection: The good, the bad, and the axiomscited by 54
  11. 2024shapiq: Shapley Interactions for Machine Learningcited by 42
  12. 2020The Grammar of Interactive Explanatory Model Analysiscited by 24
3 more
  1. 2020Predictive and Causal Implications of using Shapley Value for Model Interpretationcited by 16
  2. 2021Grouped Feature Importance and Combined Features Effect Plotcited by 14
  3. 2023Derivative-based Shapley value for global sensitivity analysis and machine learning explainabilitycited by 3

Built on by

Not cited yet.