SIM-Shapley: A Stable and Computationally Efficient Approach to Shapley Value Approximation
Not on the map. Why?
Abstract (arXiv)
Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature attribution in complex models but incur high computational costs, limiting their scalability in high-dimensional settings. We propose Stochastic Iterative Momentum for Shapley Value Approximation (SIM-Shapley), a stable and efficient SV approximation method inspired by stochastic optimization. We analyze variance theoretically, prove linear Q-convergence, and demonstrate improved empirical stability and low bias in practice on real-world datasets. In our numerical experiments, SIM-Shapley reduces computation time by up to 85% relative to state-of-the-art baselines while maintaining comparable feature attribution quality. Beyond feature attribution, our stochastic mini-batch iterative framework extends naturally to a broader class of sample average approximation problems, offering a new avenue for improving computational efficiency with stability guarantees. Code is publicly available at https://github.com/nliulab/SIM-Shapley.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 72 references that are in the map. First posted on arXiv 13 May 2025.
Builds on
31 of 72 references.
References · 31
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2021Convex optimizationcited by 2,515
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
- 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 154
- 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 148
- 2013Communication Efficient Distributed Optimization using an Approximate Newton-type Methodcited by 132
- 2022Algorithms to estimate Shapley value feature attributionscited by 115
- 2020Neuron Shapley: Discovering the Responsible Neuronscited by 98
19 more
- 2020Transfer Learning for High-dimensional Linear Regression: Prediction, Estimation, and Minimax Optimalitycited by 90
- 2020Efficient nonparametric statistical inference on population feature importance using Shapley valuescited by 61
- 2022From Shapley Values to Generalized Additive Models and backcited by 60
- 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 51
- 2024shapiq: Shapley Interactions for Machine Learningcited by 43
- 2021Shapley Explanation Networkscited by 41
- 2019Communication-Efficient Accurate Statistical Estimationcited by 32
- 2021Benchmarking emergency department triage prediction models with machine learning and large public electronic health recordscited by 31
- 2016Coupling Adaptive Batch Sizes with Learning Ratescited by 30
- 2021The Shapley Value of Classifiers in Ensemble Gamescited by 23
- 2024Provably Accurate Shapley Value Estimation via Leverage Score Samplingcited by 23
- 2024KernelSHAP-IQ: Weighted Least-Square Optimization for Shapley Interactionscited by 22
- 2020The Impact of the Mini-batch Size on the Variance of Gradients in Stochastic Gradient Descentcited by 16
- 2022Variance reduced Shapley value estimation for trustworthy data valuationcited by 16
- 2024Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaborationcited by 12
- 2024Bridging Data Gaps in Healthcare: A Scoping Review of Transfer Learning in Biomedical Data Analysiscited by 6
- 2022Sample Average Approximation for Stochastic Programming with Equality Constraintscited by 3
- 2023Fast Shapley Value Estimation: A Unified Approachcited by 2
- 2024Energy-Based Model for Accurate Estimation of Shapley Values in Feature Attributioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.