Path Choice Matters for Clear Attribution in Path Methods
Not on the map. Why?
Abstract (arXiv)
Rigorousness and clarity are both essential for interpretations of DNNs to engender human trust. Path methods are commonly employed to generate rigorous attributions that satisfy three axioms. However, the meaning of attributions remains ambiguous due to distinct path choices. To address the ambiguity, we introduce Concentration Principle, which centrally allocates high attributions to indispensable features, thereby endowing aesthetic and sparsity. We then present SAMP, a model-agnostic interpreter, which efficiently searches the near-optimal path from a pre-defined set of manipulation paths. Moreover, we propose the infinitesimal constraint (IC) and momentum strategy (MS) to improve the rigorousness and optimality. Visualizations show that SAMP can precisely reveal DNNs by pinpointing salient image pixels. We also perform quantitative experiments and observe that our method significantly outperforms the counterparts. Code: https://github.com/zbr17/SAMP.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 19 Jan 2024.
Builds on
35 of 44 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
23 more
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 345
- 2016Top-down Neural Attention by Excitation Backpropcited by 321
- 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2016Not Just a Black Box: Learning Important Features Through Propagating Activation Differencescited by 297
- 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
- 2017Interpretable Convolutional Neural Networkscited by 162
- 2018Visual Interpretability for Deep Learning: a Surveycited by 155
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2019XRAI: Better Attributions Through Regionscited by 116
- 2021Guided Integrated Gradients: An Adaptive Path Method for Removing Noisecited by 102
- 2020Attribution in Scale and Spacecited by 61
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2020NBDT: Neural-Backed Decision Treescited by 46
- 2022Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measurecited by 33
- 2020Training Interpretable Convolutional Neural Networks by Differentiating Class-specific Filterscited by 26
- 2021Self-Interpretable Model with TransformationEquivariant Interpretationcited by 21
- 2021Interpretable Compositional Convolutional Neural Networkscited by 16
- 2020DANCE: Enhancing saliency maps using decoyscited by 10
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 3.
4 papers.
- 2024Efficient and Accurate Explanation Estimation with Distribution Compressioncited by 4
- 2026Manifold-Aligned Guided Integrated Gradients for Reliable Feature Attributioncited by 2
- 2026Diffusion Integrated Gradients: Controllable Path Generation for Flexible Feature Attributioncited by 1
- 2026Consistent Evidence, Robust Recognition: Faithful Attribution Regularization under Geometric Transformationscited by 0
- 2026Consistent Evidence, Robust Recognition: Faithful Attribution Regularization under Geometric Transformations26 Jul 2026
- 2026Diffusion Integrated Gradients: Controllable Path Generation for Flexible Feature Attribution21 Jun 2026
- 2026Manifold-Aligned Guided Integrated Gradients for Reliable Feature Attribution4 May 2026
- 2024Efficient and Accurate Explanation Estimation with Distribution Compression26 Jun 2024