Explanations for Occluded Images
Not on the map. Why?
Abstract (arXiv)
Existing algorithms for explaining the output of image classifiers perform poorly on inputs where the object of interest is partially occluded. We present a novel, black-box algorithm for computing explanations that uses a principled approach based on causal theory. We have implemented the method in the DEEPCOVER tool. We obtain explanations that are much more accurate than those generated by the existing explanation tools on images with occlusions and observe a level of performance comparable to the state of the art when explaining images without occlusions.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 5 Mar 2021.
Builds on
17 of 38 references.
References · 17
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 257
- 2018Learning to Explain: An Information-Theoretic Perspective on Model Interpretationcited by 248
- 2019Relative Attributing Propagation: Interpreting the Comparative Contributions of Individual Units in Deep Neural Networkscited by 49
- 2015A Modification of the Halpern-Pearl Definition of Causalitycited by 47
5 more
- 2020Compositional Convolutional Neural Networks: A Deep Architecture with Innate Robustness to Partial Occlusioncited by 47
- 2019Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusioncited by 24
- 2019Robustness of Object Recognition under Extreme Occlusion in Humans and Computational Modelscited by 18
- 2015Unsupervised learning of object semantic parts from internal states of CNNs by population encodingcited by 8
- 2013Defining Explanation in Probabilistic Systemscited by 5
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 2; 2025: 3; 2026: 1.
14 papers.
Sort:
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasonscited by 11
- 2024Explaining Image Classifierscited by 7
- 2023Occlusion Sensitivity Analysis with Augmentation Subspace Perturbation in Deep Feature Spacecited by 6
- 2025Self-Explaining Neural Networks for Business Process Monitoringcited by 5
- 2023Approaching an unknown communication system by latent space exploration and causal inferencecited by 4
- 2023Multiple Different Black Box Explanations for Image Classifierscited by 4
- 2023A Stochastic Approach to Classification Error Estimates in Convolutional Neural Networkscited by 3
- 2022Illuminating Salient Contributions in Neuron Activation with Attribution Equilibriumcited by 1
- 2023Statistical relational learning and neuro-symbolic AI: what does first-order logic offer?cited by 1
- 2026I Guess That's Why They Call it the Blues: Causal Analysis for Audio Classifierscited by 1
- 2022Ablation Path Saliencycited by 0
- 2026I Guess That's Why They Call it the Blues: Causal Analysis for Audio Classifiers23 Jan 2026
- 2025Self-Explaining Neural Networks for Business Process Monitoring23 Mar 2025
- 2025Robot Pouring: Identifying Causes of Spillage and Selecting Alternative Action Parameters Using Probabilistic Actual Causation13 Feb 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2024It's a Feature, Not a Bug: Measuring Creative Fluidity in Image Generators3 Jun 2024
- 2024Explaining Image Classifiers24 Jan 2024
- 2023A Stochastic Approach to Classification Error Estimates in Convolutional Neural Networks21 Dec 2023
- 2023Occlusion Sensitivity Analysis with Augmentation Subspace Perturbation in Deep Feature Space25 Nov 2023
- 2023Multiple Different Black Box Explanations for Image Classifiers25 Sep 2023
- 2023The role of causality in explainable artificial intelligence18 Sep 2023
- 2023Statistical relational learning and neuro-symbolic AI: what does first-order logic offer?8 Jun 2023
- 2023Approaching an unknown communication system by latent space exploration and causal inference20 Mar 2023
2 more
- 2022Ablation Path Saliency26 Sep 2022
- 2022Illuminating Salient Contributions in Neuron Activation with Attribution Equilibrium23 May 2022
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasonscited by 11
- 2024Explaining Image Classifierscited by 7
- 2023Occlusion Sensitivity Analysis with Augmentation Subspace Perturbation in Deep Feature Spacecited by 6
- 2025Self-Explaining Neural Networks for Business Process Monitoringcited by 5
- 2023Approaching an unknown communication system by latent space exploration and causal inferencecited by 4
- 2023Multiple Different Black Box Explanations for Image Classifierscited by 4
- 2023A Stochastic Approach to Classification Error Estimates in Convolutional Neural Networkscited by 3
- 2022Illuminating Salient Contributions in Neuron Activation with Attribution Equilibriumcited by 1
- 2023Statistical relational learning and neuro-symbolic AI: what does first-order logic offer?cited by 1
- 2026I Guess That's Why They Call it the Blues: Causal Analysis for Audio Classifierscited by 1
- 2022Ablation Path Saliencycited by 0
12 most cited of 14 All 14 (JSON)
- 2026I Guess That's Why They Call it the Blues: Causal Analysis for Audio Classifiers23 Jan 2026
- 2025Self-Explaining Neural Networks for Business Process Monitoring23 Mar 2025
- 2025Robot Pouring: Identifying Causes of Spillage and Selecting Alternative Action Parameters Using Probabilistic Actual Causation13 Feb 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2024It's a Feature, Not a Bug: Measuring Creative Fluidity in Image Generators3 Jun 2024
- 2024Explaining Image Classifiers24 Jan 2024
- 2023A Stochastic Approach to Classification Error Estimates in Convolutional Neural Networks21 Dec 2023
- 2023Occlusion Sensitivity Analysis with Augmentation Subspace Perturbation in Deep Feature Space25 Nov 2023
- 2023Multiple Different Black Box Explanations for Image Classifiers25 Sep 2023
- 2023The role of causality in explainable artificial intelligence18 Sep 2023
- 2023Statistical relational learning and neuro-symbolic AI: what does first-order logic offer?8 Jun 2023
- 2023Approaching an unknown communication system by latent space exploration and causal inference20 Mar 2023
12 newest of 14 All 14 (JSON)