mlsanityData to 13 Oct 2026

IMPACTX: improving model performance by appropriately constraining the training with teacher explanations

arXiv 2502.12222 ↗First posted 17 Feb 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The eXplainable Artificial Intelligence (XAI) research predominantly concentrates to provide explainations about AI model decisions, especially Deep Learning (DL) models. However, there is a growing interest in using XAI techniques to automatically improve the performance of the AI systems themselves. This paper proposes IMPACTX, a novel approach that leverages XAI as a fully automated attention mechanism, without requiring external knowledge or human feedback. Experimental results show that IMPACTX has improved performance respect to the standalone ML model by integrating an attention mechanism based an XAI method outputs during the model training. Furthermore, IMPACTX directly provides proper feature attribution maps for the model's decisions, without relying on external XAI methods during the inference process. Our proposal is evaluated using three widely recognized DL models (EfficientNet-B2, MobileNet, and LeNet-5) along with three standard image datasets: CIFAR-10, CIFAR-100, and STL-10. The results show that IMPACTX consistently improves the performance of all the inspected DL models across all evaluated datasets, and it directly provides appropriate explanations for its responses.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 44 of its 80 references that are in the map. First posted on arXiv 17 Feb 2025.

Builds on

44 of 80 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020End-to-End Object Detection with Transformerscited by 7,396
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,713
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,515
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,426
  6. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,055
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,836
  8. 2015Learning Deep Features for Discriminative Localizationcited by 2,434
  9. 2013Visualizing and Understanding Convolutional Networkscited by 2,282
  10. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,547
  11. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,306
  12. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,203
32 more
  1. 2020Concept Bottleneck Modelscited by 1,027
  2. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 830
  3. 2016The Mythos of Model Interpretabilitycited by 718
  4. 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 417
  5. 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
  6. 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 248
  7. 2018Learning to Explain: An Information-Theoretic Perspective on Model Interpretationcited by 248
  8. 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 199
  9. 2015Inverting Visual Representations with Convolutional Networkscited by 168
  10. 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 142
  11. 2016Harnessing Deep Neural Networks with Logic Rulescited by 135
  12. 2019Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Groundedcited by 127
  13. 2018Attention Branch Network: Learning of Attention Mechanism for Visual Explanationcited by 109
  14. 2019Pruning by Explaining: A Novel Criterion for Deep Neural Network Pruningcited by 89
  15. 2019Incorporating Priors with Feature Attribution on Text Classificationcited by 68
  16. 2021Improving Deep Learning Interpretability by Saliency Guided Trainingcited by 68
  17. 2020Explanation-Guided Training for Cross-Domain Few-Shot Classificationcited by 58
  18. 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
  19. 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learningcited by 35
  20. 2019Embedding Human Knowledge into Deep Neural Network via Attention Mapcited by 33
  21. 2020Explainable Deep Classification Models for Domain Generalizationcited by 27
  22. 2021Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensingcited by 26
  23. 2021Interpretability-Driven Sample Selection Using Self Supervised Learning For Disease Classification And Segmentationcited by 22
  24. 2020Quantifying Explainability of Saliency Methods in Deep Neural Networks with a Synthetic Datasetcited by 14
  25. 2020Reflective-Net: Learning from Explanationscited by 13
  26. 2024Don't Push the Button! Exploring Data Leakage Risks in Machine Learning and Transfer Learningcited by 11
  27. 2018Excitation Dropout: Encouraging Plasticity in Deep Neural Networkscited by 7
  28. 2022Impact of Feedback Type on Explanatory Interactive Learningcited by 7
  29. 2023Strategies to exploit XAI to improve classification systemscited by 7
  30. 2022Utilizing Explainable AI for improving the Performance of Neural Networkscited by 5
  31. 2021Exploiting auto-encoders and segmentation methods for middle-level explanations of image classification systemscited by 3
  32. 2023Neural Architecture Search: Two Constant Shared Weights Initialisationscited by 1

Built on by

Not cited yet.