Mitigating Bias: Enhancing Image Classification by Improving Model Explanations
Not on the map. Why?
Abstract (arXiv)
Deep learning models have demonstrated remarkable capabilities in learning complex patterns and concepts from training data. However, recent findings indicate that these models tend to rely heavily on simple and easily discernible features present in the background of images rather than the main concepts or objects they are intended to classify. This phenomenon poses a challenge to image classifiers as the crucial elements of interest in images may be overshadowed. In this paper, we propose a novel approach to address this issue and improve the learning of main concepts by image classifiers. Our central idea revolves around concurrently guiding the model's attention toward the foreground during the classification task. By emphasizing the foreground, which encapsulates the primary objects of interest, we aim to shift the focus of the model away from the dominant influence of the background. To accomplish this, we introduce a mechanism that encourages the model to allocate sufficient attention to the foreground. We investigate various strategies, including modifying the loss function or incorporating additional architectural components, to enable the classifier to effectively capture the primary concept within an image. Additionally, we explore the impact of different foreground attention mechanisms on model performance and provide insights into their effectiveness. Through extensive experimentation on benchmark datasets, we demonstrate the efficacy of our proposed approach in improving the classification accuracy of image classifiers. Our findings highlight the importance of foreground attention in enhancing model understanding and representation of the main concepts within images. The results of this study contribute to advancing the field of image classification and provide valuable insights for developing more robust and accurate deep-learning models.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 25 references that are in the map. First posted on arXiv 4 Jul 2023.
Builds on
21 of 25 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
- 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 299
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 293
9 more
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
- 2019Explainable Machine Learning for Scientific Insights and Discoveriescited by 165
- 2019Interpretations are useful: penalizing explanations to align neural networks with prior knowledgecited by 144
- 2021Learning to Predict Visual Attributes in the Wildcited by 95
- 2020Don't Judge an Object by Its Context: Learning to Overcome Contextual Biascited by 91
- 2020CASTing Your Model: Learning to Localize Improves Self-Supervised Representationscited by 63
- 2022A Comprehensive Study of Image Classification Model Sensitivity to Foregrounds, Backgrounds, and Visual Attributescited by 56
- 2021Consistent Explanations by Contrastive Learningcited by 18
- 2023Revealing Model Biases: Assessing Deep Neural Networks via Recovered Sample Analysiscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.