Utilizing Explainable AI for improving the Performance of Neural Networks
Not on the map. Why?
Abstract (arXiv)
Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this, Explainable Artificial Intelligence (XAI) has been developing as a field that aims to improve the transparency of the model and increase their trustworthiness. We propose a retraining pipeline that consistently improves the model predictions starting from XAI and utilizing state-of-the-art techniques. To do that, we use the XAI results, namely SHapley Additive exPlanations (SHAP) values, to give specific training weights to the data samples. This leads to an improved training of the model and, consequently, better performance. In order to benchmark our method, we evaluate it on both real-life and public datasets. First, we perform the method on a radar-based people counting scenario. Afterward, we test it on the CIFAR-10, a public Computer Vision dataset. Experiments using the SHAP-based retraining approach achieve a 4% more accuracy w.r.t. the standard equal weight retraining for people counting tasks. Moreover, on the CIFAR-10, our SHAP-based weighting strategy ends up with a 3% accuracy rate than the training procedure with equal weighted samples.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 7 Oct 2022.
Builds on
20 of 35 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2013Intriguing properties of neural networkscited by 5,114
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
- 2013Network In Networkcited by 600
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 401
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 231
- 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 202
8 more
- 2016Improving the Robustness of Deep Neural Networks via Stability Trainingcited by 156
- 2016Understanding How Image Quality Affects Deep Neural Networkscited by 118
- 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
- 2017Deep Learning in Robotics: A Review of Recent Researchcited by 42
- 2020Utilizing Explainable AI for Quantization and Pruning of Deep Neural Networkscited by 17
- 2020SHAP values for Explaining CNN-based Text Classification Modelscited by 12
- 2021Label-Aware Ranked Loss for robust People Counting using Automotive in-cabin Radarcited by 7
- 2022Cross-modal Learning of Graph Representations using Radar Point Cloud for Long-Range Gesture Recognitioncited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 2.
5 papers.
- 2024XAI-Enhanced Semantic Segmentation Models for Visual Quality Inspectioncited by 1
- 2024Enhancing Manufacturing Quality Prediction Models through the Integration of Explainability Methodscited by 1
- 2025XD-RCDepth: Lightweight Radar-Camera Depth Estimation with Explainability-Aligned and Distribution-Aware Distillationcited by 1
- 2022Harnessing the Power of Explanations for Incremental Training: A LIME-Based Approachcited by 0
- 2025IMPACTX: improving model performance by appropriately constraining the training with teacher explanationscited by 0
- 2025XD-RCDepth: Lightweight Radar-Camera Depth Estimation with Explainability-Aligned and Distribution-Aware Distillation15 Oct 2025
- 2025IMPACTX: improving model performance by appropriately constraining the training with teacher explanations17 Feb 2025
- 2024Enhancing Manufacturing Quality Prediction Models through the Integration of Explainability Methods27 Mar 2024
- 2024XAI-Enhanced Semantic Segmentation Models for Visual Quality Inspection18 Jan 2024
- 2022Harnessing the Power of Explanations for Incremental Training: A LIME-Based Approach2 Nov 2022