mlsanityData to 14 Oct 2026

Riemann Sum Optimization for Accurate Integrated Gradients Computation

arXiv 2410.04118 ↗First posted 5 Oct 2024cs.LG cs.AI math.OCcited by 1

Not on the map. Why?

Abstract (arXiv)

Integrated Gradients (IG) is a widely used algorithm for attributing the outputs of a deep neural network to its input features. Due to the absence of closed-form integrals for deep learning models, inaccurate Riemann Sum approximations are used to calculate IG. This often introduces undesirable errors in the form of high levels of noise, leading to false insights in the model's decision-making process. We introduce a framework, RiemannOpt, that minimizes these errors by optimizing the sample point selection for the Riemann Sum. Our algorithm is highly versatile and applicable to IG as well as its derivatives like Blur IG and Guided IG. RiemannOpt achieves up to 20% improvement in Insertion Scores. Additionally, it enables its users to curtail computational costs by up to four folds, thereby making it highly functional for constrained environments.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 30 references that are in the map. First posted on arXiv 5 Oct 2024.

Builds on

23 of 30 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  7. 2014Going Deeper with Convolutionscited by 4,241
  8. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  9. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  10. 2018Group Normalizationcited by 1,524
  11. 2017SmoothGrad: removing noise by adding noisecited by 1,109
  12. 2014Striving for Simplicity: The All Convolutional Netcited by 990
11 more
  1. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
  2. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
  3. 2019The many Shapley values for model explanationcited by 344
  4. 2017Real Time Image Saliency for Black Box Classifierscited by 246
  5. 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
  6. 2019XRAI: Better Attributions Through Regionscited by 116
  7. 2021Guided Integrated Gradients: An Adaptive Path Method for Removing Noisecited by 102
  8. 2020Attribution in Scale and Spacecited by 61
  9. 2023IDGI: A Framework to Eliminate Explanation Noise from Integrated Gradientscited by 16
  10. 2019Computing Linear Restrictions of Neural Networkscited by 15
  11. 2019Interpretable Deep Learning in Drug Discoverycited by 14

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.