Black-box Explanation of Object Detectors via Saliency Maps
Not on the map. Why?
Abstract (arXiv)
We propose D-RISE, a method for generating visual explanations for the predictions of object detectors. Utilizing the proposed similarity metric that accounts for both localization and categorization aspects of object detection allows our method to produce saliency maps that show image areas that most affect the prediction. D-RISE can be considered "black-box" in the software testing sense, as it only needs access to the inputs and outputs of an object detector. Compared to gradient-based methods, D-RISE is more general and agnostic to the particular type of object detector being tested, and does not need knowledge of the inner workings of the model. We show that D-RISE can be easily applied to different object detectors including one-stage detectors such as YOLOv3 and two-stage detectors such as Faster-RCNN. We present a detailed analysis of the generated visual explanations to highlight the utilization of context and possible biases learned by object detectors.
Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 15; 2023: 18; 2024: 17; 2025: 9; 2026: 11.
74 papers.
Sort:
By area:
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2022Diffusion Models for Counterfactual Explanationscited by 79
- 2022Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measurecited by 33
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2021Explainable Person Re-Identification with Attribute-guided Metric Distillationcited by 23
- 2024Interpreting Object-level Foundation Models via Visual Precision Searchcited by 20
- 2022Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanationscited by 17
- 2024Explaining generative diffusion models via visual analysis for interpretable decision-making processcited by 15
- 2023Towards Better Explanations for Object Detectioncited by 14
- 2022OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Datacited by 13
- 2022What You See is What You Classify: Black Box Attributionscited by 12
- 2023ODAM: Gradient-based instance-specific visual explanations for object detectioncited by 12
38 more
- 2024LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Taskscited by 12
- 2023Towards Visual Saliency Explanations of Face Verificationcited by 11
- 2023Bridging the Transparency Gap: What Can Explainable AI Learn From the AI Act?cited by 10
- 2023Towards Trust of Explainable AI in Thyroid Nodule Diagnosiscited by 10
- 2022"Is your explanation stable?": A Robustness Evaluation Framework for Feature Attributioncited by 7
- 2023G-CAME: Gaussian-Class Activation Mapping Explainer for Object Detectorscited by 7
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approachcited by 7
- 2025Grad-ECLIP: Gradient-based Visual and Textual Explanations for CLIPcited by 7
- 2021Estimating and Maximizing Mutual Information for Knowledge Distillationcited by 6
- 2022Explaining YOLO: Leveraging Grad-CAM to Explain Object Detectionscited by 6
- 2023Model-agnostic explainable artificial intelligence for object detection in image datacited by 6
- 2023Human Attention-Guided Explainable Artificial Intelligence for Computer Vision Modelscited by 6
- 2024CrisisKAN: Knowledge-infused and Explainable Multimodal Attention Network for Crisis Event Classificationcited by 6
- 2024Explainable Face Verification via Feature-Guided Gradient Backpropagationcited by 6
- 2024Efficient and Concise Explanations for Object Detection with Gaussian-Class Activation Mapping Explainercited by 6
- 2024Comprehensive Attribution: Inherently Explainable Vision Model with Feature Detectorcited by 5
- 2023ViT-ReciproCAM: Gradient and Attention-Free Visual Explanations for Vision Transformercited by 4
- 2025Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitorscited by 4
- 2022Challenges and Opportunities for Machine Learning Classification of Behavior and Mental State from Imagescited by 3
- 2022Recipro-CAM: Fast gradient-free visual explanations for convolutional neural networkscited by 3
- 2023Explanation of Face Recognition via Saliency Mapscited by 3
- 2023Improve Video Representation with Temporal Adversarial Augmentationcited by 3
- 2023Discriminative Deep Feature Visualization for Explainable Face Recognitioncited by 3
- 2023BSED: Baseline Shapley-Based Explainable Detectorcited by 3
- 2024Explaining Object Detectors via Collective Contribution of Pixelscited by 3
- 2025ODExAI: A Comprehensive Object Detection Explainable AI Evaluationcited by 3
- 2022DExT: Detector Explanation Toolkitcited by 2
- 2023Sanity Checks for Saliency Methods Explaining Object Detectorscited by 2
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectorscited by 2
- 2021Co-segmentation Inspired Attention Module for Video-based Computer Vision Taskscited by 1
- 2022Black-box Error Diagnosis in Deep Neural Networks for Computer Vision: a Survey of Toolscited by 1
- 2022Illuminating Salient Contributions in Neuron Activation with Attribution Equilibriumcited by 1
- 2023Defining Quality Requirements for a Trustworthy AI Wildflower Monitoring Platformcited by 1
- 2023ODSmoothGrad: Generating Saliency Maps for Object Detectorscited by 1
- 2023Assessing Trustworthiness of Autonomous Systemscited by 1
- 2023FM-G-CAM: A Holistic Approach for Explainable AI in Computer Visioncited by 1
- 2024Enhancing the Fairness and Performance of Edge Cameras with Explainable AIcited by 1
- 2024XAI-Enhanced Semantic Segmentation Models for Visual Quality Inspectioncited by 1
50 most cited of 74 All 74 (JSON)
- 2026Reconstructed holograms and explanation-aware evaluation for low-cost computational pollen analysis in veterinary cytology19 Sep 2026
- 2026Det-LIME: Detector-Aware, Multi-Instance Local Interpretable Model-Agnostic Explanations for Automated Marine Mammal Detection15 Sep 2026
- 2026A Good Initialization is All You Need for Faithful Visual Attribution7 Jul 2026
- 2026MalariAI: A Label-Resilient Decoupled Framework for Annotation-Agnostic Cell Segmentation and Explainable Stage Classification in Dense Malaria Blood Smears1 Jul 2026
- 2026Listening makes Vision Clear for VLMs22 Jun 2026
- 2026PhaseWin: An Efficient Search Algorithm for Faithful Visual Attribution16 Jun 2026
- 2026ContextShift: A Controlled Benchmark for Context Dependence in Object Detection8 Jun 2026
- 2026Differences in Detection: Explainability Where it Matters5 Jun 2026
- 2026The Neglected Baseline in Model Interpretation21 May 2026
- 2026SAM-Sode: Towards Faithful Explanations for Tiny Bacteria Detection20 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2025Out-of-the-box: Black-box Causal Attacks on Object Detectors3 Dec 2025
38 more
- 2025LLEXICORP: End-user Explainability of Convolutional Neural Networks4 Nov 2025
- 2025Controlling the image generation process with parametric activation functions17 Oct 2025
- 2025Counterfactual Visual Explanation via Causally-Guided Adversarial Steering14 Jul 2025
- 2025ProtoSolo: Interpretable Image Classification via Single-Prototype Activation24 Jun 2025
- 2025Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitors16 May 2025
- 2025ODExAI: A Comprehensive Object Detection Explainable AI Evaluation27 Apr 2025
- 2025Grad-ECLIP: Gradient-based Visual and Textual Explanations for CLIP26 Feb 2025
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking13 Feb 2025
- 2024Explaining Object Detectors via Collective Contribution of Pixels1 Dec 2024
- 2024Interpreting Object-level Foundation Models via Visual Precision Search25 Nov 2024
- 2024On the Black-box Explainability of Object Detection Models for Safe and Trustworthy Industrial Applications28 Oct 2024
- 2024Real-Time Incremental Explanations for Object Detectors in Autonomous Driving21 Aug 2024
- 2024Comprehensive Attribution: Inherently Explainable Vision Model with Feature Detector27 Jul 2024
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approach16 Jul 2024
- 2024Towards A Comprehensive Visual Saliency Explanation Framework for AI-based Face Recognition Systems8 Jul 2024
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectors21 May 2024
- 2024Efficient and Concise Explanations for Object Detection with Gaussian-Class Activation Mapping Explainer20 Apr 2024
- 2024Explainable Face Verification via Feature-Guided Gradient Backpropagation7 Mar 2024
- 2024ProtoP-OD: Explainable Object Detection with Prototypical Parts29 Feb 2024
- 2024LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks19 Feb 2024
- 2024Explaining generative diffusion models via visual analysis for interpretable decision-making process16 Feb 2024
- 2024REVEX: A Unified Framework for Removal-Based Explainable Artificial Intelligence in Video22 Jan 2024
- 2024XAI-Enhanced Semantic Segmentation Models for Visual Quality Inspection18 Jan 2024
- 2024Enhancing the Fairness and Performance of Edge Cameras with Explainable AI18 Jan 2024
- 2024CrisisKAN: Knowledge-infused and Explainable Multimodal Attention Network for Crisis Event Classification11 Jan 2024
- 2023FM-G-CAM: A Holistic Approach for Explainable AI in Computer Vision10 Dec 2023
- 2023ViT-ReciproCAM: Gradient and Attention-Free Visual Explanations for Vision Transformer4 Oct 2023
- 2023BSED: Baseline Shapley-Based Explainable Detector14 Aug 2023
- 2023G-CAME: Gaussian-Class Activation Mapping Explainer for Object Detectors6 Jun 2023
- 2023Towards Better Explanations for Object Detection5 Jun 2023
- 2023Sanity Checks for Saliency Methods Explaining Object Detectors4 Jun 2023
- 2023Discriminative Deep Feature Visualization for Explainable Face Recognition1 Jun 2023
- 2023Towards Visual Saliency Explanations of Face Verification15 May 2023
- 2023Human Attention-Guided Explainable Artificial Intelligence for Computer Vision Models5 May 2023
- 2023Assessing Trustworthiness of Autonomous Systems5 May 2023
- 2023Improve Video Representation with Temporal Adversarial Augmentation28 Apr 2023
- 2023ODSmoothGrad: Generating Saliency Maps for Object Detectors15 Apr 2023
- 2023ODAM: Gradient-based instance-specific visual explanations for object detection13 Apr 2023
50 newest of 74 All 74 (JSON)
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2022Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measurecited by 33
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2021Explainable Person Re-Identification with Attribute-guided Metric Distillationcited by 23
- 2024Interpreting Object-level Foundation Models via Visual Precision Searchcited by 20
- 2022Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanationscited by 17
- 2023Towards Better Explanations for Object Detectioncited by 14
- 2022OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Datacited by 13
- 2022What You See is What You Classify: Black Box Attributionscited by 12
- 2023ODAM: Gradient-based instance-specific visual explanations for object detectioncited by 12
- 2024LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Taskscited by 12
- 2023Towards Visual Saliency Explanations of Face Verificationcited by 11
12 most cited of 70 All 70 (JSON)
- 2026Reconstructed holograms and explanation-aware evaluation for low-cost computational pollen analysis in veterinary cytology19 Sep 2026
- 2026Det-LIME: Detector-Aware, Multi-Instance Local Interpretable Model-Agnostic Explanations for Automated Marine Mammal Detection15 Sep 2026
- 2026A Good Initialization is All You Need for Faithful Visual Attribution7 Jul 2026
- 2026MalariAI: A Label-Resilient Decoupled Framework for Annotation-Agnostic Cell Segmentation and Explainable Stage Classification in Dense Malaria Blood Smears1 Jul 2026
- 2026Listening makes Vision Clear for VLMs22 Jun 2026
- 2026ContextShift: A Controlled Benchmark for Context Dependence in Object Detection8 Jun 2026
- 2026Differences in Detection: Explainability Where it Matters5 Jun 2026
- 2026The Neglected Baseline in Model Interpretation21 May 2026
- 2026SAM-Sode: Towards Faithful Explanations for Tiny Bacteria Detection20 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2025Out-of-the-box: Black-box Causal Attacks on Object Detectors3 Dec 2025
- 2025LLEXICORP: End-user Explainability of Convolutional Neural Networks4 Nov 2025
12 newest of 70 All 70 (JSON)