Real Time Image Saliency for Black Box Classifiers
Not on the map. Why?
Abstract (arXiv)
In this work we develop a fast saliency detection method that can be applied to any differentiable image classifier. We train a masking model to manipulate the scores of the classifier by masking salient parts of the input image. Our model generalises well to unseen images and requires a single forward pass to perform saliency detection, therefore suitable for use in real-time systems. We test our approach on CIFAR-10 and ImageNet datasets and show that the produced saliency maps are easily interpretable, sharp, and free of artifacts. We suggest a new metric for saliency and test our method on the ImageNet object localisation task. We achieve results outperforming other weakly supervised methods.
Key facts. Cited by 246 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 60; 2022: 59; 2023: 59; 2024: 38; 2025: 19; 2026: 11.
246 papers.
Sort:
By area:
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 316
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2021IA-RED2: Interpretability-Aware Redundancy Reduction for Vision Transformerscited by 127
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 123
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 120
- 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 104
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2022Distilling Model Failures as Directions in Latent Spacecited by 82
- 2022Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanationscited by 77
- 2021GraphSVX: Shapley Value Explanations for Graph Neural Networkscited by 63
38 more
- 2021Have We Learned to Explain?: How Interpretability Methods Can Learn to Encode Predictions in their Interpretationscited by 59
- 2021Beyond Trivial Counterfactual Explanations with Diverse Valuable Explanationscited by 56
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2022GStarX: Explaining Graph Neural Networks with Structure-Aware Cooperative Gamescited by 42
- 2022Optimizing Relevance Maps of Vision Transformers Improves Robustnesscited by 41
- 2022Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanationscited by 40
- 2021Counterfactual State Explanations for Reinforcement Learning Agents via Generative Deep Learningcited by 38
- 2022Model Zoos: A Dataset of Diverse Populations of Neural Network Modelscited by 38
- 2022On the Explainability of Natural Language Processing Deep Modelscited by 37
- 2021Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networkscited by 36
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNscited by 36
- 2022Missingness Bias in Model Debuggingcited by 36
- 2021Locally Sparse Neural Networks for Tabular Biomedical Datacited by 34
- 20213DB: A Framework for Debugging Computer Vision Modelscited by 31
- 2022Making Heads or Tails: Towards Semantically Consistent Visual Counterfactualscited by 30
- 2022ModelDiff: A Framework for Comparing Learning Algorithmscited by 30
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
- 2022Diffeomorphic Counterfactuals with Generative Modelscited by 29
- 2021CAMERAS: Enhanced Resolution And Sanity preserving Class Activation Mapping for image saliencycited by 28
- 2022Towards Better Understanding Attribution Methodscited by 28
- 2023Does a Neural Network Really Encode Symbolic Concepts?cited by 27
- 2023Circuit Breaking: Removing Model Behaviors with Targeted Ablationcited by 27
- 2021Revisiting The Evaluation of Class Activation Mapping for Explainability: A Novel Metric and Experimental Analysiscited by 25
- 2023Opti-CAM: Optimizing saliency maps for interpretabilitycited by 25
- 2023Explaining Generalization Power of a DNN Using Interactive Conceptscited by 25
- 2024The Quest for the Right Mediator: Surveying Mechanistic Interpretability Through the Lens of Causal Mediation Analysiscited by 24
- 2021You Mostly Walk Alone: Analyzing Feature Attribution in Trajectory Predictioncited by 23
- 2021UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Modelscited by 23
- 2022Human-Centered Concept Explanations for Neural Networkscited by 23
- 2022Shap-CAM: Visual Explanations for Convolutional Neural Networks based on Shapley Valuecited by 23
- 2022Fairness and Explainability: Bridging the Gap Towards Fair Model Explanationscited by 22
- 2024Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attributioncited by 21
- 2024Optimal ablation for interpretabilitycited by 21
- 2021Revisiting Sanity Checks for Saliency Mapscited by 20
- 2022FlowX: Towards Explainable Graph Neural Networks via Message Flowscited by 20
- 2022Concept Gradient: Concept-based Interpretation Without Linear Assumptioncited by 20
- 2023Distilling Cognitive Backdoor Patterns within an Imagecited by 20
- 2023CoRTX: Contrastive Framework for Real-time Explanationcited by 20
50 most cited of 246 All 246 (JSON)
- 2026Evaluating and Explaining Prompt Sensitivity of LLMs Using Interactions19 Aug 2026
- 2026Hide&Seek: Learning to Explain in an End-to-End Differentiable Network17 Aug 2026
- 2026Inpainting Insights: Elevating Visual XAI with Photorealistic Perturbations16 Jul 2026
- 2026Local Additive Feature Attribution: A Mathematical Taxonomy and Reporting Checklist15 Jul 2026
- 2026What Pixels Are Enough? SEAMS: Sufficiency Saliency via MSE-Preservation Soft-Masks10 Jul 2026
- 2026Few-class Fidelity: Evaluating Explanations of Real-conditions CNN classifiers with Optimized Perturbations23 Jun 2026
- 2026AIM: Adversarial Information Masking for Faithfulness Evaluation of Saliency Maps16 May 2026
- 2026Seeing What Shouldn't Be There: Counterfactual GANs for Medical Image Attribution6 May 2026
- 2026A Unified Approach to Interpreting Knowledge Distillation for Large Language Models via Interactions5 May 2026
- 2026Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness9 Mar 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025TextCAM: Explaining Class Activation Map with Text1 Oct 2025
38 more
- 2025Token-Based Detection of Spurious Correlations in Vision Transformers4 Sep 2025
- 2025On the notion of missingness for path attribution explainability methods in medical settings: Guiding the selection of medically meaningful baselines20 Aug 2025
- 2025Attribution Explanations for Deep Neural Networks: A Theoretical Perspective11 Aug 2025
- 2025Explainable Artificial Intelligence in Biomedical Image Analysis: A Comprehensive Survey9 Jul 2025
- 2025Anomaly Detection in Event-triggered Traffic Time Series via Similarity Learning20 Jun 2025
- 2025Pixel-level Certified Explanations via Randomized Smoothing18 Jun 2025
- 2025Do Protein Transformers Have Biological Intelligence?7 Jun 2025
- 2025XAI-Units: Benchmarking Explainability Methods with Unit Tests1 Jun 2025
- 2025Uncovering the Structure of Explanation Quality with Spectral Analysis11 Apr 2025
- 2025A Meaningful Perturbation Metric for Evaluating Explainability Methods9 Apr 2025
- 2025Fast Fourier Correlation is a Highly Efficient and Accurate Feature Attribution Algorithm from the Perspective of Control Theory and Game Theory2 Apr 2025
- 2025Where do Large Vision-Language Models Look at when Answering Questions?18 Mar 2025
- 2025Explainable AI in Time-Sensitive Scenarios: Prefetched Offline Explanation Model6 Mar 2025
- 2025Walking the Web of Concept-Class Relationships in Incrementally Trained Interpretable Models27 Feb 2025
- 2025Revisiting Generalization Power of a DNN in Terms of Symbolic Interactions14 Feb 2025
- 2025Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability31 Jan 2025
- 2025Generating visual explanations from deep networks using implicit neural representations20 Jan 2025
- 2025FaceOracle: Chat with a Face Image Oracle13 Jan 2025
- 2024FastRM: An efficient and automatic explainability framework for multimodal generative models2 Dec 2024
- 2024Explanations that reveal all through the definition of encoding4 Nov 2024
- 2024SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generation3 Nov 2024
- 2024Axiomatic Explainer Globalness via Optimal Transport2 Nov 2024
- 2024Why pre-training is beneficial for downstream classification tasks?11 Oct 2024
- 2024Explaining Hypergraph Neural Networks: From Local Explanations to Global Concepts10 Oct 2024
- 2024Hyper-Representations: Learning from Populations of Neural Networks7 Oct 2024
- 2024Riemann Sum Optimization for Accurate Integrated Gradients Computation5 Oct 2024
- 2024Sufficient and Necessary Explanations (and What Lies in Between)30 Sep 2024
- 2024PCEvE: Part Contribution Evaluation Based Model Explanation for Human Figure Drawing Assessment and Beyond26 Sep 2024
- 2024Leveraging Local Structure for Improving Model Explanations: An Information Propagation Approach24 Sep 2024
- 2024Optimal ablation for interpretability16 Sep 2024
- 2024Layerwise Change of Knowledge in Neural Networks13 Sep 2024
- 2024Joint Universal Adversarial Perturbations with Interpretations3 Aug 2024
- 2024The Quest for the Right Mediator: Surveying Mechanistic Interpretability Through the Lens of Causal Mediation Analysis2 Aug 2024
- 2024Comprehensive Attribution: Inherently Explainable Vision Model with Feature Detector27 Jul 2024
- 2024Local Feature Selection without Label or Feature Leakage for Interpretable Machine Learning Predictions16 Jul 2024
- 2024Understanding the Dependence of Perception Model Competency on Regions in an Image15 Jul 2024
- 2024Large Language Models are Interpretable Learners25 Jun 2024
- 2024Inpainting the Gaps: A Novel Framework for Evaluating Explanation Methods in Vision Transformers17 Jun 2024
50 newest of 246 All 246 (JSON)
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 316
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2021IA-RED2: Interpretability-Aware Redundancy Reduction for Vision Transformerscited by 127
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 123
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 120
- 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 104
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2022Distilling Model Failures as Directions in Latent Spacecited by 82
- 2022Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanationscited by 77
- 2021GraphSVX: Shapley Value Explanations for Graph Neural Networkscited by 63
12 most cited of 242 All 242 (JSON)
- 2026Evaluating and Explaining Prompt Sensitivity of LLMs Using Interactions19 Aug 2026
- 2026Hide&Seek: Learning to Explain in an End-to-End Differentiable Network17 Aug 2026
- 2026Inpainting Insights: Elevating Visual XAI with Photorealistic Perturbations16 Jul 2026
- 2026Local Additive Feature Attribution: A Mathematical Taxonomy and Reporting Checklist15 Jul 2026
- 2026What Pixels Are Enough? SEAMS: Sufficiency Saliency via MSE-Preservation Soft-Masks10 Jul 2026
- 2026Few-class Fidelity: Evaluating Explanations of Real-conditions CNN classifiers with Optimized Perturbations23 Jun 2026
- 2026AIM: Adversarial Information Masking for Faithfulness Evaluation of Saliency Maps16 May 2026
- 2026Seeing What Shouldn't Be There: Counterfactual GANs for Medical Image Attribution6 May 2026
- 2026A Unified Approach to Interpreting Knowledge Distillation for Large Language Models via Interactions5 May 2026
- 2026Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness9 Mar 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025TextCAM: Explaining Class Activation Map with Text1 Oct 2025
12 newest of 242 All 242 (JSON)