mlsanityData to 7 Oct 2026

Identifying Spurious Correlations and Correcting them with an Explanation-based Learning

arXiv 2211.08285 ↗First posted 15 Nov 2022cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Identifying spurious correlations learned by a trained model is at the core of refining a trained model and building a trustworthy model. We present a simple method to identify spurious correlations that have been learned by a model trained for image classification problems. We apply image-level perturbations and monitor changes in certainties of predictions made using the trained model. We demonstrate this approach using an image classification dataset that contains images with synthetically generated spurious regions and show that the trained model was overdependent on spurious regions. Moreover, we remove the learned spurious correlations with an explanation based learning approach.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 15 Nov 2022.

Builds on

24 of 55 references.

References · 24

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  5. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  6. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  7. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  8. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
  9. 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
  10. 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 293
  11. 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 141
  12. 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
12 more
  1. 2021Salient ImageNet: How to discover spurious features in Deep Learning?cited by 114
  2. 2020Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)cited by 79
  3. 2021The Spotlight: A General Method for Discovering Systematic Errors in Deep Learning Modelscited by 63
  4. 2020On Generating Plausible Counterfactual and Semi-Factual Explanations for Deep Learningcited by 60
  5. 2020Learn to Forget: Machine Unlearning via Neuron Maskingcited by 56
  6. 2020Understanding Failures of Deep Networks via Robust Feature Extractioncited by 56
  7. 2021Finding and Fixing Spurious Patterns with Explanationscited by 38
  8. 2021What does LIME really see in images?cited by 21
  9. 2022"Even if ..." -- Diverse Semifactual Explanations of Rejectcited by 11
  10. 2022Impact of Feedback Type on Explanatory Interactive Learningcited by 7
  11. 2020Probabilistic Object Classification using CNN ML-MAP layerscited by 3
  12. 2021Optimising Knee Injury Detection with Spatial Attention and Validating Localisation Abilitycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 8; 2024: 0; 2025: 1; 2026: 1.

10 papers.