Grad-CAM: Why did you say that?
Not on the map. Why?
Abstract (arXiv)
We propose a technique for making Convolutional Neural Network (CNN)-based models more transparent by visualizing input regions that are 'important' for predictions -- or visual explanations. Our approach, called Gradient-weighted Class Activation Mapping (Grad-CAM), uses class-specific gradient information to localize important regions. These localizations are combined with existing pixel-space visualizations to create a novel high-resolution and class-discriminative visualization called Guided Grad-CAM. These methods help better understand CNN-based models, including image captioning and visual question answering (VQA) models. We evaluate our visual explanations by measuring their ability to discriminate between classes, to inspire trust in humans, and their correlation with occlusion maps. Grad-CAM provides a new way to understand CNN-based models. We have released code, an online demo hosted on CloudCV, and a full version of this extended abstract.
Key facts. Cited by 161 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 22; 2023: 43; 2024: 37; 2025: 25; 2026: 16.
161 papers.
Sort:
By area:
- 2023Learning Concise and Descriptive Attributes for Visual Recognitioncited by 73
- 2021High Fidelity Visualization of What Your Self-Supervised Representation Knows Aboutcited by 66
- 2022Concept Embedding Models: Beyond the Accuracy-Explainability Trade-Offcited by 61
- 2023From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuningcited by 56
- 2021A Review on Explainability in Multimodal Deep Neural Netscited by 46
- 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 46
- 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
- 2022Are Vision Transformers Robust to Spurious Correlations?cited by 36
- 2023Spurious Feature Diversification Improves Out-of-distribution Generalizationcited by 26
- 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directionscited by 25
- 2022Are Deep Neural Networks SMARTer than Second Graders?cited by 24
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approachcited by 16
38 more
- 2022On the Relationship Between Explanation and Prediction: A Causal Viewcited by 14
- 2021CAM-loss: Towards Learning Spatially Discriminative Feature Representationscited by 13
- 2022Correct-by-Construction Runtime Enforcement in AI -- A Surveycited by 12
- 2023Explainability of Vision Transformers: A Comprehensive Review and New Perspectivescited by 12
- 2023Towards Visual Saliency Explanations of Face Verificationcited by 11
- 2024Explainable Attribute-Based Speaker Verificationcited by 11
- 2024MA-AVT: Modality Alignment for Parameter-Efficient Audio-Visual Transformerscited by 11
- 2021SelectAugment: Hierarchical Deterministic Sample Selection for Data Augmentationcited by 10
- 2022New Definitions and Evaluations for Saliency Methods: Staying Intrinsic, Complete and Soundcited by 10
- 2023Can We Trust Explainable AI Methods on ASR? An Evaluation on Phoneme Recognitioncited by 10
- 2021SCALP -- Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadatacited by 9
- 2022Generalizing Adversarial Explanations with Grad-CAMcited by 9
- 2021Cause and Effect: Hierarchical Concept-based Explanation of Neural Networkscited by 8
- 2021GETAM: Gradient-weighted Element-wise Transformer Attention Map for Weakly-supervised Semantic segmentationcited by 8
- 2023Sanity checks for patch visualisation in prototype-based image classificationcited by 8
- 2024DAWN: Domain-Adaptive Weakly Supervised Nuclei Segmentation via Cross-Task Interactionscited by 8
- 2024KAN You See It? KANs and Sentinel for Effective and Explainable Crop Field Segmentationcited by 8
- 2025MIRAGE: Towards AI-Generated Image Detection in the Wildcited by 8
- 2022Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rayscited by 7
- 2022DASH: Visual Analytics for Debiasing Image Classification via User-Driven Synthetic Data Augmentationcited by 7
- 2022Zero-shot Active Visual Search (ZAVIS): Intelligent Object Search for Robotic Assistantscited by 7
- 2023Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyondcited by 7
- 2026Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMscited by 7
- 2021Knowledge-Augmented Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loopcited by 6
- 2021Knee Osteoarthritis Severity Prediction using an Attentive Multi-Scale Deep Convolutional Neural Networkcited by 6
- 2021Soundify: Matching Sound Effects to Videocited by 6
- 2023Revisiting Image Classifier Training for Improved Certified Robust Defense against Adversarial Patchescited by 6
- 2024From Movements to Metrics: Evaluating Explainable AI Methods in Skeleton-Based Human Activity Recognitioncited by 6
- 2024On the Value of Labeled Data and Symbolic Methods for Hidden Neuron Activation Analysiscited by 6
- 2024Causal Deciphering and Inpainting in Spatio-Temporal Dynamics via Diffusion Modelcited by 6
- 2021Improving Attribution Methods by Learning Submodular Functionscited by 5
- 2021Explainable Deep Reinforcement Learning for Portfolio Management: An Empirical Approachcited by 5
- 2023Fairness in AI Systems: Mitigating gender bias from language-vision modelscited by 5
- 2023A Strong and Simple Deep Learning Baseline for BCI MI Decodingcited by 5
- 2025ConceptScope: Characterizing Dataset Bias via Disentangled Visual Conceptscited by 5
- 2022Multi-task UNet: Jointly Boosting Saliency Prediction and Disease Classification on Chest X-ray Imagescited by 4
- 2022CtrlFormer: Learning Transferable State Representation for Visual Control via Transformercited by 4
- 2022Concept-Based Explanations for Tabular Datacited by 4
50 most cited of 161 All 161 (JSON)
- 2026GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?10 Oct 2026
- 2026Interpreting hierarchical organisation of speaker embeddings14 Sep 2026
- 2026Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Sampling2 Sep 2026
- 2026Fusing Perceptual Vision Experts with Multimodal Large Language Models for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation23 Aug 2026
- 2026BREAD: Baseline-Referenced Explanations for Anomaly Diagnosis11 Aug 2026
- 2026Scaling Inherently Interpretable Language Models6 Aug 2026
- 2026Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMs4 Jul 2026
- 2026Explainable AI in Speaker Recognition -- Attention Map Visualisation and Evaluation22 Jun 2026
- 2026On the explainability of max-plus neural networks27 Apr 2026
- 2026Explainable AI in Speaker Recognition -- Making Latent Representations Understandable25 Apr 2026
- 2026Dataset Color Quantization: A Training-Oriented Framework for Dataset-Level Compression24 Feb 2026
- 2026From Features to Actions: Explainability in Traditional and Agentic AI Systems6 Feb 2026
38 more
- 2026Towards Autonomous Instrument Tray Assembly for Sterile Processing Applications2 Feb 2026
- 2026Emergent, not Immanent: A Baradian Reading of Explainable AI21 Jan 2026
- 2026textitFocaLogic: Logic-Based Interpretation of Visual Model Decisions17 Jan 2026
- 2026Interpretability and Individuality in Knee MRI: Patient-Specific Radiomic Fingerprint with Reconstructed Healthy Personas13 Jan 2026
- 2025Quadrant Segmentation VLM with Few-Shot Adaptation and OCT Learning-based Explainability Methods for Diabetic Retinopathy20 Dec 2025
- 2025A Novel CustNetGC Boosted Model with Spectral Features for Parkinson's Disease Prediction19 Nov 2025
- 2025CaberNet: Causal Representation Learning for Cross-Domain HVAC Energy Prediction10 Nov 2025
- 2025ConceptScope: Characterizing Dataset Bias via Disentangled Visual Concepts30 Oct 2025
- 2025FeatureFool: Zero-Query Fooling of Video Models via Feature Map21 Oct 2025
- 2025Modeling Time-Lapse Trajectories to Characterize Cranberry Growth10 Oct 2025
- 2025Multi-Level CLS Token Fusion for Contrastive Learning in Endoscopy Image Classification31 Aug 2025
- 2025A Novel Local Focusing Mechanism for Deepfake Detection Generalization23 Aug 2025
- 2025Explainable Knowledge Distillation for Efficient Medical Image Classification21 Aug 2025
- 2025MIRAGE: Towards AI-Generated Image Detection in the Wild17 Aug 2025
- 2025No Masks Needed: Explainable AI for Deriving Segmentation from Classification6 Aug 2025
- 2025Proto-FG3D: Prototype-based Interpretable Fine-Grained 3D Shape Classification23 May 2025
- 2025Tversky Neural Networks: Psychologically Plausible Deep Learning with Differentiable Tversky Similarity21 May 2025
- 2025Direct Preference Optimization for Adaptive Concept-based Explanations21 May 2025
- 2025Enhancing Vision Transformer Explainability Using Artificial Astrocytes20 May 2025
- 2025See What I Mean? CUE: A Cognitive Model of Understanding Explanations9 May 2025
- 2025Semantic Depth Matters: Explaining Errors of Deep Vision Networks through Perceived Class Similarities14 Apr 2025
- 2025From Visual Explanations to Counterfactual Explanations with Latent Diffusion12 Apr 2025
- 2025Evaluating Time Series Models with Knowledge Discovery19 Mar 2025
- 2025scBIT: Integrating Single-cell Transcriptomic Data into fMRI-based Prediction for Alzheimer's Disease Diagnosis4 Feb 2025
- 2025Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability31 Jan 2025
- 2025Enhancing Adversarial Transferability via Component-Wise Transformation21 Jan 2025
- 2025Self-CephaloNet: A Two-stage Novel Framework using Operational Neural Network for Cephalometric Analysis19 Jan 2025
- 2025MedGrad E-CLIP: Enhancing Trust and Transparency in AI-Driven Skin Lesion Diagnosis12 Jan 2025
- 2025Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics12 Jan 2025
- 2024Explainable Semantic Federated Learning Enabled Industrial Edge Network for Fire Surveillance28 Dec 2024
- 2024PCIM: Learning Pixel Attributions via Pixel-wise Channel Isolation Mixing in High Content Imaging3 Dec 2024
- 2024MEGL: Multimodal Explanation-Guided Learning20 Nov 2024
- 2024Learning local discrete features in explainable-by-design convolutional neural networks31 Oct 2024
- 2024Exploiting Text-Image Latent Spaces for the Description of Visual Concepts23 Oct 2024
- 2024Reproducibility study of "LICO: Explainable Models with Language-Image Consistency"17 Oct 2024
- 2024Causal Deciphering and Inpainting in Spatio-Temporal Dynamics via Diffusion Model29 Sep 2024
- 2024ORB-SfMLearner: ORB-Guided Self-supervised Visual Odometry with Selective Online Adaptation18 Sep 2024
- 2024KAN You See It? KANs and Sentinel for Effective and Explainable Crop Field Segmentation13 Aug 2024
50 newest of 161 All 161 (JSON)
- 2023Learning Concise and Descriptive Attributes for Visual Recognitioncited by 73
- 2026Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMscited by 7
- 2023Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answeringcited by 2
- 2024Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severitycited by 1
- 2026Fusing Perceptual Vision Experts with Multimodal Large Language Models for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validationcited by 0
- 2026Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Samplingcited by 0
- 2026GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?cited by 0
- 2026GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?10 Oct 2026
- 2026Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Sampling2 Sep 2026
- 2026Fusing Perceptual Vision Experts with Multimodal Large Language Models for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation23 Aug 2026
- 2026Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMs4 Jul 2026
- 2024Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severity12 Jan 2024
- 2023Learning Concise and Descriptive Attributes for Visual Recognition7 Aug 2023
- 2023Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answering24 May 2023
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approachcited by 16
- 2024Causal Deciphering and Inpainting in Spatio-Temporal Dynamics via Diffusion Modelcited by 6
- 2025From Visual Explanations to Counterfactual Explanations with Latent Diffusioncited by 4
- 2024I2AM: Interpreting Image-to-Image Latent Diffusion Models via Bi-Attribution Mapscited by 2
- 2026Scaling Inherently Interpretable Language Modelscited by 1
- 2026Scaling Inherently Interpretable Language Models6 Aug 2026
- 2025From Visual Explanations to Counterfactual Explanations with Latent Diffusion12 Apr 2025
- 2024Causal Deciphering and Inpainting in Spatio-Temporal Dynamics via Diffusion Model29 Sep 2024
- 2024I2AM: Interpreting Image-to-Image Latent Diffusion Models via Bi-Attribution Maps17 Jul 2024
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approach27 Jun 2024
- 2021High Fidelity Visualization of What Your Self-Supervised Representation Knows Aboutcited by 66
- 2022Concept Embedding Models: Beyond the Accuracy-Explainability Trade-Offcited by 61
- 2023From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuningcited by 56
- 2021A Review on Explainability in Multimodal Deep Neural Netscited by 46
- 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 46
- 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
- 2022Are Vision Transformers Robust to Spurious Correlations?cited by 36
- 2023Spurious Feature Diversification Improves Out-of-distribution Generalizationcited by 26
- 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directionscited by 25
- 2022Are Deep Neural Networks SMARTer than Second Graders?cited by 24
- 2022On the Relationship Between Explanation and Prediction: A Causal Viewcited by 14
- 2021CAM-loss: Towards Learning Spatially Discriminative Feature Representationscited by 13
12 most cited of 141 All 141 (JSON)
- 2026Interpreting hierarchical organisation of speaker embeddings14 Sep 2026
- 2026BREAD: Baseline-Referenced Explanations for Anomaly Diagnosis11 Aug 2026
- 2026Explainable AI in Speaker Recognition -- Attention Map Visualisation and Evaluation22 Jun 2026
- 2026On the explainability of max-plus neural networks27 Apr 2026
- 2026Explainable AI in Speaker Recognition -- Making Latent Representations Understandable25 Apr 2026
- 2026Dataset Color Quantization: A Training-Oriented Framework for Dataset-Level Compression24 Feb 2026
- 2026Towards Autonomous Instrument Tray Assembly for Sterile Processing Applications2 Feb 2026
- 2026Emergent, not Immanent: A Baradian Reading of Explainable AI21 Jan 2026
- 2026textitFocaLogic: Logic-Based Interpretation of Visual Model Decisions17 Jan 2026
- 2026Interpretability and Individuality in Knee MRI: Patient-Specific Radiomic Fingerprint with Reconstructed Healthy Personas13 Jan 2026
- 2025Quadrant Segmentation VLM with Few-Shot Adaptation and OCT Learning-based Explainability Methods for Diabetic Retinopathy20 Dec 2025
- 2025A Novel CustNetGC Boosted Model with Spectral Features for Parkinson's Disease Prediction19 Nov 2025
12 newest of 141 All 141 (JSON)