mlsanityData to 14 Oct 2026

A New Baseline Assumption of Integated Gradients Based on Shaply value

arXiv 2310.04821 ↗First posted 7 Oct 2023cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines in IG is crucial for crafting meaningful and unbiased explanations of model predictions in diverse settings. The standard approach of utilizing a single baseline, however, is frequently inadequate, prompting the need for multiple baselines. Leveraging the natural link between IG and the Aumann-Shapley Value, we provide a novel outlook on baseline design. Theoretically, we demonstrate that under certain assumptions, a collection of baselines aligns with the coalitions described by the Shapley Value. Building on this insight, we develop a new baseline method called Shapley Integrated Gradients (SIG), which uses proportional sampling to mirror the Shapley Value computation process. Simulations conducted in GridWorld validate that SIG effectively emulates the distribution of Shapley Values. Moreover, empirical tests on various image processing tasks show that SIG surpasses traditional IG baseline methods by offering more precise estimates of feature contributions, providing consistent explanations across different applications, and ensuring adaptability to diverse data types with negligible additional computational demand.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 7 Oct 2023.

Builds on

24 of 42 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  4. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  5. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  6. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
  7. 2017Interpretation of Neural Networks is Fragilecited by 444
  8. 2019The many Shapley values for model explanationcited by 344
  9. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 254
  10. 2017Real Time Image Saliency for Black Box Classifierscited by 246
  11. 2020Problems with Shapley-value-based explanations as feature importance measurescited by 200
  12. 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 199
12 more
  1. 2019Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximationcited by 115
  2. 2022Algorithms to estimate Shapley value feature attributionscited by 115
  3. 2020Causal Shapley Values: Exploiting Causal Knowledge to Explain Individual Predictions of Complex Modelscited by 107
  4. 2021Sampling Permutations for Shapley Value Estimationcited by 102
  5. 2020Shapley explainability on the data manifoldcited by 88
  6. 2018Did the Model Understand the Question?cited by 60
  7. 2023Sequential Integrated Gradients: a simple but effective method for explaining language modelscited by 52
  8. 2021Explaining a Series of Models by Propagating Shapley Valuescited by 37
  9. 2019Explaining Models by Propagating Shapley Values of Local Componentscited by 29
  10. 2020Quantitative Evaluations on Saliency Methods: An Experimental Studycited by 10
  11. 2022Maximum Entropy Baseline for Integrated Gradientscited by 3
  12. 2022Comparing Baseline Shapley and Integrated Gradients for Local Explanation: Some Additional Insightscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 2.

3 papers.