Attribution-based XAI Methods in Computer Vision: A Review
Not on the map. Why?
Abstract (arXiv)
The advancements in deep learning-based methods for visual perception tasks have seen astounding growth in the last decade, with widespread adoption in a plethora of application areas from autonomous driving to clinical decision support systems. Despite their impressive performance, these deep learning-based models remain fairly opaque in their decision-making process, making their deployment in human-critical tasks a risky endeavor. This in turn makes understanding the decisions made by these models crucial for their reliable deployment. Explainable AI (XAI) methods attempt to address this by offering explanations for such black-box deep learning methods. In this paper, we provide a comprehensive survey of attribution-based XAI methods in computer vision and review the existing literature for gradient-based, perturbation-based, and contrastive methods for XAI, and provide insights on the key challenges in developing and evaluating robust XAI methods.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 49 of its 73 references that are in the map. First posted on arXiv 27 Nov 2022.
Builds on
49 of 73 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2013Intriguing properties of neural networkscited by 5,114
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2014Going Deeper with Convolutionscited by 4,231
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
37 more
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2016The Mythos of Model Interpretabilitycited by 716
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2013Network In Networkcited by 600
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 401
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
- 2015Understanding Neural Networks Through Deep Visualizationcited by 332
- 2017The (Un)reliability of saliency methodscited by 331
- 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 261
- 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
- 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 257
- 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 248
- 2017Real Time Image Saliency for Black Box Classifierscited by 246
- 2018Techniques for Interpretable Machine Learningcited by 237
- 2019Explanations can be manipulated and geometry is to blamecited by 215
- 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 202
- 2019Full-Gradient Representation for Neural Network Visualizationcited by 189
- 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
- 2018Visual Interpretability for Deep Learning: a Surveycited by 155
- 2019XRAI: Better Attributions Through Regionscited by 116
- 2016Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?cited by 111
- 2020Explainable deep learning models in medical image analysiscited by 111
- 2020Contrastive Explanations in Neural Networkscited by 26
Built on by
Citing papers per year: 2023: 4; 2024: 7; 2025: 3; 2026: 2.
16 papers.
Sort:
By area:
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 60
- 2024IG2: Integrated Gradient on Iterative Gradient Path for Feature Attributioncited by 12
- 2025Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Bettercited by 11
- 2024Verifying Machine Unlearning with Explainable AIcited by 5
- 2024Expected Grad-CAM: Towards gradient faithfulnesscited by 4
- 2024Achieving Sparse Activation in Small Language Modelscited by 4
- 2023Fixing confirmation bias in feature attribution methods via semantic matchcited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2023Black-Box Anomaly Attributioncited by 1
- 2024Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attackscited by 1
- 2024On the Black-box Explainability of Object Detection Models for Safe and Trustworthy Industrial Applicationscited by 1
- 2025Explainable but Vulnerable: Adversarial Attacks on XAI Explanation in Cybersecurity Applicationscited by 1
4 more
- 2023Counterfactual Edits for Generative Evaluationcited by 0
- 2024Beyond Fidelity: Explaining Vulnerability Localization of Learning-based Detectorscited by 0
- 2026Entropy-Centric Explainable AI for Remote Sensing Image Segmentationcited by 0
- 2026For Those Who Believe in Faithfulness: Optimizing the Area Under Insertion and Deletion Curves for Ranking Relative Feature Importancecited by 0
- 2026For Those Who Believe in Faithfulness: Optimizing the Area Under Insertion and Deletion Curves for Ranking Relative Feature Importance7 Oct 2026
- 2026Entropy-Centric Explainable AI for Remote Sensing Image Segmentation11 Aug 2026
- 2025Explainable but Vulnerable: Adversarial Attacks on XAI Explanation in Cybersecurity Applications4 Oct 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Better15 Jun 2025
- 2024Verifying Machine Unlearning with Explainable AI20 Nov 2024
- 2024On the Black-box Explainability of Object Detection Models for Safe and Trustworthy Industrial Applications28 Oct 2024
- 2024IG2: Integrated Gradient on Iterative Gradient Path for Feature Attribution16 Jun 2024
- 2024Achieving Sparse Activation in Small Language Models3 Jun 2024
- 2024Expected Grad-CAM: Towards gradient faithfulness3 Jun 2024
- 2024Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attacks22 Jan 2024
- 2024Beyond Fidelity: Explaining Vulnerability Localization of Learning-based Detectors5 Jan 2024
4 more
- 2023Fixing confirmation bias in feature attribution methods via semantic match3 Jul 2023
- 2023Black-Box Anomaly Attribution29 May 2023
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulation2 May 2023
- 2023Counterfactual Edits for Generative Evaluation2 Mar 2023
- 2024Verifying Machine Unlearning with Explainable AIcited by 5
- 2024Verifying Machine Unlearning with Explainable AI20 Nov 2024
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 60
- 2024IG2: Integrated Gradient on Iterative Gradient Path for Feature Attributioncited by 12
- 2025Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Bettercited by 11
- 2024Expected Grad-CAM: Towards gradient faithfulnesscited by 4
- 2024Achieving Sparse Activation in Small Language Modelscited by 4
- 2023Fixing confirmation bias in feature attribution methods via semantic matchcited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2023Black-Box Anomaly Attributioncited by 1
- 2024Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attackscited by 1
- 2024On the Black-box Explainability of Object Detection Models for Safe and Trustworthy Industrial Applicationscited by 1
- 2025Explainable but Vulnerable: Adversarial Attacks on XAI Explanation in Cybersecurity Applicationscited by 1
- 2023Counterfactual Edits for Generative Evaluationcited by 0
12 most cited of 15 All 15 (JSON)
- 2026For Those Who Believe in Faithfulness: Optimizing the Area Under Insertion and Deletion Curves for Ranking Relative Feature Importance7 Oct 2026
- 2026Entropy-Centric Explainable AI for Remote Sensing Image Segmentation11 Aug 2026
- 2025Explainable but Vulnerable: Adversarial Attacks on XAI Explanation in Cybersecurity Applications4 Oct 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Better15 Jun 2025
- 2024On the Black-box Explainability of Object Detection Models for Safe and Trustworthy Industrial Applications28 Oct 2024
- 2024IG2: Integrated Gradient on Iterative Gradient Path for Feature Attribution16 Jun 2024
- 2024Achieving Sparse Activation in Small Language Models3 Jun 2024
- 2024Expected Grad-CAM: Towards gradient faithfulness3 Jun 2024
- 2024Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attacks22 Jan 2024
- 2024Beyond Fidelity: Explaining Vulnerability Localization of Learning-based Detectors5 Jan 2024
- 2023Fixing confirmation bias in feature attribution methods via semantic match3 Jul 2023
12 newest of 15 All 15 (JSON)