Expected Grad-CAM: Towards gradient faithfulness
Not on the map. Why?
Abstract (arXiv)
Although input-gradients techniques have evolved to mitigate and tackle the challenges associated with gradients, modern gradient-weighted CAM approaches still rely on vanilla gradients, which are inherently susceptible to the saturation phenomena. Despite recent enhancements have incorporated counterfactual gradient strategies as a mitigating measure, these local explanation techniques still exhibit a lack of sensitivity to their baseline parameter. Our work proposes a gradient-weighted CAM augmentation that tackles both the saturation and sensitivity problem by reshaping the gradient computation, incorporating two well-established and provably approaches: Expected Gradients and kernel smoothing. By revisiting the original formulation as the smoothed expectation of the perturbed integrated gradients, one can concurrently construct more faithful, localized and robust explanations which minimize infidelity. Through fine modulation of the perturbation distribution it is possible to regulate the complexity characteristic of the explanation, selectively discriminating stable features. Our technique, Expected Grad-CAM, differently from recent works, exclusively optimizes the gradient computation, purposefully designed as an enhanced substitute of the foundational Grad-CAM algorithm and any method built therefrom. Quantitative and qualitative evaluations have been conducted to assess the effectiveness of our method.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 3 Jun 2024.
Builds on
45 of 58 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
33 more
- 2016The Mythos of Model Interpretabilitycited by 716
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2017The (Un)reliability of saliency methodscited by 331
- 2018On the Robustness of Interpretability Methodscited by 310
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
- 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 202
- 2020Evaluating and Aggregating Feature-based Model Explanationscited by 185
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
- 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
- 2022A Consistent and Efficient Evaluation Strategy for Attribution Methodscited by 100
- 2020Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networkscited by 79
- 2019Towards Best Practice in Explaining Neural Network Decisions with LRPcited by 70
- 2022Framework for Evaluating Faithfulness of Local Explanationscited by 55
- 2022Rethinking Stability for Attribution-based Explanationscited by 52
- 2020IROF: a low resource evaluation metric for explanation methodscited by 45
- 2018Local Explanation Methods for Deep Neural Networks Lack Sensitivity to Parameter Valuescited by 40
- 2023The Meta-Evaluation Problem in Explainable AI: Identifying Reliable Estimators with MetaQuantuscited by 37
- 2019Why are Saliency Maps Noisy? Cause of and Solution to Noisy Saliency Mapscited by 34
- 2021Interpretable Semantic Photo Geolocationcited by 32
- 2016Gradients of Counterfactualscited by 31
- 2021Integrated Grad-CAM: Sensitivity-Aware Visual Explanation of Deep Convolutional Networks via Integrated Gradient-Based Scoringcited by 16
- 2022Attribution-based XAI Methods in Computer Vision: A Reviewcited by 16
- 2018CIFAR10 to Compare Visual Recognition Performance between Deep Neural Networks and Humanscited by 14
- 2020Zoom-CAM: Generating Fine-grained Pixel Annotations from Image Labelscited by 10
- 2022Poly-CAM: High resolution class activation map for convolutional neural networkscited by 10
- 2018A Note about: Local Explanation Methods for Deep Neural Networks lack Sensitivity to Parameter Valuescited by 9
- 2022Explaining Image Classifiers Using Contrastive Counterfactuals in Generative Latent Spacescited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Winsor-CAM: Human-Tunable Visual Explanations from Deep Networks via Layer-Wise Winsorizationcited by 10
- 2025SCOPE-MRI: Bankart Lesion Detection as a Case Study in Data Curation and Deep Learning for Challenging Diagnosescited by 0
- 2026Fusion-CAM: Integrating Gradient and Region-Based Class Activation Maps for Robust Visual Explanationscited by 0
- 2026Fundamental Limitation in Explaining AIcited by 0
- 2026Fundamental Limitation in Explaining AI23 May 2026
- 2026Fusion-CAM: Integrating Gradient and Region-Based Class Activation Maps for Robust Visual Explanations5 Mar 2026
- 2025Winsor-CAM: Human-Tunable Visual Explanations from Deep Networks via Layer-Wise Winsorization14 Jul 2025
- 2025SCOPE-MRI: Bankart Lesion Detection as a Case Study in Data Curation and Deep Learning for Challenging Diagnoses29 Apr 2025