Identifying Spurious Correlations and Correcting them with an Explanation-based Learning
Not on the map. Why?
Abstract (arXiv)
Identifying spurious correlations learned by a trained model is at the core of refining a trained model and building a trustworthy model. We present a simple method to identify spurious correlations that have been learned by a model trained for image classification problems. We apply image-level perturbations and monitor changes in certainties of predictions made using the trained model. We demonstrate this approach using an image classification dataset that contains images with synthetically generated spurious regions and show that the trained model was overdependent on spurious regions. Moreover, we remove the learned spurious correlations with an explanation based learning approach.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 15 Nov 2022.
Builds on
24 of 55 references.
References · 24
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 293
- 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 141
- 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
12 more
- 2021Salient ImageNet: How to discover spurious features in Deep Learning?cited by 114
- 2020Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)cited by 79
- 2021The Spotlight: A General Method for Discovering Systematic Errors in Deep Learning Modelscited by 63
- 2020On Generating Plausible Counterfactual and Semi-Factual Explanations for Deep Learningcited by 60
- 2020Learn to Forget: Machine Unlearning via Neuron Maskingcited by 56
- 2020Understanding Failures of Deep Networks via Robust Feature Extractioncited by 56
- 2021Finding and Fixing Spurious Patterns with Explanationscited by 38
- 2021What does LIME really see in images?cited by 21
- 2022"Even if ..." -- Diverse Semifactual Explanations of Rejectcited by 11
- 2022Impact of Feedback Type on Explanatory Interactive Learningcited by 7
- 2020Probabilistic Object Classification using CNN ML-MAP layerscited by 3
- 2021Optimising Knee Injury Detection with Spatial Attention and Validating Localisation Abilitycited by 3
Built on by
Citing papers per year: 2023: 8; 2024: 0; 2025: 1; 2026: 1.
10 papers.
- 2023Discover and Cure: Concept-aware Mitigation of Spurious Correlationcited by 71
- 2023Seeing is not Believing: Robust Reinforcement Learning against Spurious Correlationcited by 25
- 2023Even if Explanations: Prior Work, Desiderata & Benchmarks for Semi-Factual XAIcited by 20
- 2023Studying How to Efficiently and Effectively Guide Models with Explanationscited by 16
- 2023Unlearning Spurious Correlations in Chest X-ray Classificationcited by 2
- 2023Learning from Exemplary Explanationscited by 1
- 2023Distance-Aware eXplanation Based Learningcited by 1
- 2023Detecting Spurious Correlations via Robust Visual Concepts in Real and AI-Generated Image Classificationcited by 1
- 2025Explainable Image Classification with Reduced Overconfidence for Tissue Characterisationcited by 0
- 2026eXplaining to Learn (eX2L): Regularization Using Contrastive Visual Explanation Pairs for Distribution Shiftscited by 0
- 2026eXplaining to Learn (eX2L): Regularization Using Contrastive Visual Explanation Pairs for Distribution Shifts7 May 2026
- 2025Explainable Image Classification with Reduced Overconfidence for Tissue Characterisation31 Jul 2025
- 2023Detecting Spurious Correlations via Robust Visual Concepts in Real and AI-Generated Image Classification3 Nov 2023
- 2023Distance-Aware eXplanation Based Learning11 Sep 2023
- 2023Unlearning Spurious Correlations in Chest X-ray Classification2 Aug 2023
- 2023Seeing is not Believing: Robust Reinforcement Learning against Spurious Correlation15 Jul 2023
- 2023Learning from Exemplary Explanations12 Jul 2023
- 2023Discover and Cure: Concept-aware Mitigation of Spurious Correlation1 May 2023
- 2023Studying How to Efficiently and Effectively Guide Models with Explanations21 Mar 2023
- 2023Even if Explanations: Prior Work, Desiderata & Benchmarks for Semi-Factual XAI27 Jan 2023