Neural network interpretability with layer-wise relevance propagation: novel techniques for neuron selection and visualization
Not on the map. Why?
Abstract (arXiv)
Interpreting complex neural networks is crucial for understanding their decision-making processes, particularly in applications where transparency and accountability are essential. This proposed method addresses this need by focusing on layer-wise Relevance Propagation (LRP), a technique used in explainable artificial intelligence (XAI) to attribute neural network outputs to input features through backpropagated relevance scores. Existing LRP methods often struggle with precision in evaluating individual neuron contributions. To overcome this limitation, we present a novel approach that improves the parsing of selected neurons during LRP backward propagation, using the Visual Geometry Group 16 (VGG16) architecture as a case study. Our method creates neural network graphs to highlight critical paths and visualizes these paths with heatmaps, optimizing neuron selection through accuracy metrics like Mean Squared Error (MSE) and Symmetric Mean Absolute Percentage Error (SMAPE). Additionally, we utilize a deconvolutional visualization technique to reconstruct feature maps, offering a comprehensive view of the network's inner workings. Extensive experiments demonstrate that our approach enhances interpretability and supports the development of more transparent artificial intelligence (AI) systems for computer vision applications. This advancement has the potential to improve the trustworthiness of AI models in real-world machine vision applications, thereby increasing their reliability and effectiveness.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 17 references that are in the map. First posted on arXiv 7 Dec 2024.
Builds on
11 of 17 references.
References · 11
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 365
- 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 250
- 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 199
- 2019Towards Explainable Artificial Intelligencecited by 106
- 2019Explaining Convolutional Neural Networks using Softmax Gradient Layer-wise Relevance Propagationcited by 29
Built on by
Citing papers per year: 2026: 2.
2 papers.