Explaining NonLinear Classification Decisions with Deep Taylor Decomposition
Not on the map. Why?
Abstract (arXiv)
Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods perform impressively well, they have a significant disadvantage, the lack of transparency, limiting the interpretability of the solution and thus the scope of application in practice. Especially DNNs act as black boxes due to their multilayer nonlinear structure. In this paper we introduce a novel methodology for interpreting generic multilayer neural networks by decomposing the network classification decision into contributions of its input elements. Although our focus is on image classification, the method is applicable to a broad set of input data, learning tasks and network architectures. Our method is based on deep Taylor decomposition and efficiently utilizes the structure of the network by backpropagating the explanations from the output to the input layer. We evaluate the proposed method empirically on the MNIST and ILSVRC data sets.
Key facts. Cited by 248 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 33; 2022: 44; 2023: 42; 2024: 64; 2025: 39; 2026: 25.
248 papers.
Sort:
By area:
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2022From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagationcited by 141
- 2024AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformerscited by 116
- 2024Rethinking Interpretability in the Era of Large Language Modelscited by 110
- 2021Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAycited by 53
- 2022Evaluation of post-hoc interpretability methods in time-series classificationcited by 53
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 45
- 2022Optimizing Relevance Maps of Vision Transformers Improves Robustnesscited by 41
- 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learningcited by 35
- 2022ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Modelcited by 34
38 more
- 2024Gradient based Feature Attribution in Explainable AI: A Technical Reviewcited by 34
- 2021Explainable AI: current status and future directionscited by 32
- 2021EXplainable Neural-Symbolic Learning (X-NeSyL) methodology to fuse deep learning representations with expert knowledge graphs: the MonuMAI cultural heritage use casecited by 30
- 2022Diffeomorphic Counterfactuals with Generative Modelscited by 29
- 2022Investigating the fidelity of explainable artificial intelligence methods for applications of convolutional neural networks in geosciencecited by 28
- 2022Visualizing and Understanding Patch Interactions in Vision Transformercited by 26
- 2022Improving deep neural network generalization and robustness to background bias via layer-wise relevance propagation optimizationcited by 25
- 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
- 2022Disentangled Explanations of Neural Network Predictions by Finding Relevant Subspacescited by 25
- 2023Finding the right XAI method -- A Guide for the Evaluation and Ranking of Explainable AI Methods in Climate Sciencecited by 25
- 2022Discovering Transferable Forensic Features for CNN-generated Images Detectioncited by 24
- 2023A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?cited by 24
- 2021Interpretability-Driven Sample Selection Using Self Supervised Learning For Disease Classification And Segmentationcited by 22
- 2022Fairness and Explainability: Bridging the Gap Towards Fair Model Explanationscited by 22
- 2021Robust Models Are More Interpretable Because Attributions Look Normalcited by 21
- 2024Optimal ablation for interpretabilitycited by 21
- 2021Focus! Rating XAI Methods and Finding Biasescited by 20
- 2022Do Explanations Explain? Model Knows Bestcited by 20
- 2024Interpreting Object-level Foundation Models via Visual Precision Searchcited by 20
- 2024Token Transformation Matters: Towards Faithful Post-hoc Explanation for Vision Transformercited by 19
- 2021Neural Network Attribution Methods for Problems in Geoscience: A Novel Synthetic Benchmark Datasetcited by 18
- 2021DeepAID: Interpreting and Improving Deep Learning-based Anomaly Detection in Security Applicationscited by 18
- 2023Improved Visual Grounding through Self-Consistent Explanationscited by 17
- 2024Attention Guided CAM: Visual Explanations of Vision Transformer Guided by Self-Attentioncited by 17
- 2024CausalFormer: An Interpretable Transformer for Temporal Causal Discoverycited by 17
- 2022Attribution-based XAI Methods in Computer Vision: A Reviewcited by 16
- 2021Keep CALM and Improve Visual Feature Attributioncited by 15
- 2024Explaining generative diffusion models via visual analysis for interpretable decision-making processcited by 15
- 2024xMIL: Insightful Explanations for Multiple Instance Learning in Histopathologycited by 15
- 2021Learn-Explain-Reinforce: Counterfactual Reasoning and Its Guidance to Reinforce an Alzheimer's Disease Diagnosis Modelcited by 14
- 2022Machine Learning for a Sustainable Energy Futurecited by 14
- 2018Granger-causal Attentive Mixtures of Experts: Learning Important Features with Neural Networkscited by 13
- 2022ViTOL: Vision Transformer for Weakly Supervised Object Localizationcited by 13
- 2022Multi-objective optimization determines when, which and how to fuse deep networks: an application to predict COVID-19 outcomescited by 12
- 2023Improving Interpretation Faithfulness for Vision Transformerscited by 12
- 2025Show and Tell: Visually Explainable Deep Neural Nets via Spatially-Aware Concept Bottleneck Modelscited by 12
- 2025Dynamic Accumulated Attention Map for Interpreting Evolution of Decision-Making in Vision Transformercited by 12
- 2022Saliency Cards: A Framework to Characterize and Compare Saliency Methodscited by 11
50 most cited of 248 All 248 (JSON)
- 2026Explaining Hyperbolic Neural Networks via Geometry-Aware Relevance Propagation28 Sep 2026
- 2026ResLRP: The Role of Residual Cancellation in Attribution Instability in Vision Transformers15 Sep 2026
- 2026HiLRP: Toward One Trustworthy Explanation for Vision Transformer: Conservation-Valid Attribution via Attention Primitives1 Sep 2026
- 2026Hidden in the Request: Explaining Unethical LLM Compliance through Token Relevance24 Aug 2026
- 2026Uncertainty propagation in auto-regressive random neural network models20 Aug 2026
- 2026Local Additive Feature Attribution: A Mathematical Taxonomy and Reporting Checklist15 Jul 2026
- 2026Explaining Temporal Graph Neural Networks via Feature-induced Information Flow25 Jun 2026
- 2026SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches16 Jun 2026
- 2026Normalized Relevance Measure as a Unifying Framework to Explain Neural Network Latent Structures30 May 2026
- 2026The Neglected Baseline in Model Interpretation21 May 2026
- 2026From Clever Hans to Scientific Discovery: Interpreting EEG Foundational Transformers with LRP12 May 2026
- 2026GRALIS: Fusing Coalition and Gradient Attribution with Closed-Form Conservation Error and Finite-Sample Guarantees6 May 2026
38 more
- 2026Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time3 May 2026
- 2026Why Model Selection Fails in Time Series Forecasting: An Empirical Study of Instability Across Data Regimes2 May 2026
- 2026From Local to Global to Mechanistic: An iERF-Centered Unified Framework for Interpreting Vision Models1 May 2026
- 2026Faithfulness Serum: Mitigating the Faithfulness Gap in Textual Explanations of LLM Decisions via Attribution Guidance15 Apr 2026
- 2026Layer-wise Target Propagation: Efficient Component Attribution through Target Centric Propagation20 Mar 2026
- 2026Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness9 Mar 2026
- 2026From Baselines to Transport Geodesics: Axiomatic Attribution via Optimal Generative Flows5 Mar 2026
- 2026ROKA: Robust Knowledge Unlearning against Adversaries28 Feb 2026
- 2026Fair feature attribution for multi-output prediction: a Shapley-based perspective26 Feb 2026
- 2026Sample-Free Safety Assessment of Neural Network Controllers via Taylor Methods11 Feb 2026
- 2026The effect of whitening on explanation performance9 Feb 2026
- 2026Trustworthy Data-driven Chronological Age Estimation from Panoramic Dental Images19 Jan 2026
- 2026Hidden Monotonicity: Explaining Deep Neural Networks via their DC Decomposition12 Jan 2026
- 2025Interpretable Plant Leaf Disease Detection Using Attention-Enhanced CNN19 Dec 2025
- 2025Always Keep Your Promises: A Model-Agnostic Attribution Algorithm for Neural Networks7 Dec 2025
- 2025MASE: Interpretable NLP Models via Model-Agnostic Saliency Estimation4 Dec 2025
- 2025A Self-explainable Model of Long Time Series by Extracting Informative Structured Causal Patterns1 Dec 2025
- 2025Responsible LLM Deployment for High-Stake Decisions by Decentralized Technologies and Human-AI Interactions28 Nov 2025
- 2025Attention Trajectories as a Diagnostic Axis for Deep Reinforcement Learning25 Nov 2025
- 2025Matching-Based Few-Shot Semantic Segmentation Models Are Interpretable by Design22 Nov 2025
- 2025Layer-Wise Modality Decomposition for Interpretable Multimodal Sensor Fusion2 Nov 2025
- 2025When LRP Diverges from Leave-One-Out in Transformers21 Oct 2025
- 2025Onto-Epistemological Analysis of AI Explanations3 Oct 2025
- 2025TDHook: A Lightweight Framework for Interpretability29 Sep 2025
- 2025RelP: Faithful and Efficient Circuit Discovery in Language Models via Relevance Patching28 Aug 2025
- 2025Assessing the Noise Robustness of Class Activation Maps: A Framework for Reliable Model Interpretability25 Aug 2025
- 2025Attribution Explanations for Deep Neural Networks: A Theoretical Perspective11 Aug 2025
- 2025Fast and Accurate Explanations of Distance-Based Classifiers by Uncovering Latent Explanatory Structures5 Aug 2025
- 2025Breaking the Illusion of Security via Interpretation: Interpretable Vision Transformer Systems under Attack18 Jul 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Winsor-CAM: Human-Tunable Visual Explanations from Deep Networks via Layer-Wise Winsorization14 Jul 2025
- 2025Interpretability-Aware Pruning for Efficient Medical Image Analysis11 Jul 2025
- 2025Pixel-level Certified Explanations via Randomized Smoothing18 Jun 2025
- 2025Identifying Alzheimer's Disease Prediction Strategies of Convolutional Neural Network Classifiers using R2* Maps and Spectral Clustering4 Jun 2025
- 2025Revisiting LRP: Positional Attribution as the Missing Ingredient for Transformer Explainability2 Jun 2025
- 2025Relevance-driven Input Dropout: an Explanation-guided Regularization Technique27 May 2025
- 2025Nosy Layers, Noisy Fixes: Tackling DRAs in Federated Learning Systems using Explainable AI16 May 2025
- 2025A Meaningful Perturbation Metric for Evaluating Explainability Methods9 Apr 2025
50 newest of 248 All 248 (JSON)
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2022From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagationcited by 141
- 2021Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAycited by 53
- 2022Evaluation of post-hoc interpretability methods in time-series classificationcited by 53
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 45
- 2022Optimizing Relevance Maps of Vision Transformers Improves Robustnesscited by 41
- 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learningcited by 35
- 2022ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Modelcited by 34
- 2024Gradient based Feature Attribution in Explainable AI: A Technical Reviewcited by 34
- 2021Explainable AI: current status and future directionscited by 32
- 2021EXplainable Neural-Symbolic Learning (X-NeSyL) methodology to fuse deep learning representations with expert knowledge graphs: the MonuMAI cultural heritage use casecited by 30
12 most cited of 239 All 239 (JSON)
- 2026Explaining Hyperbolic Neural Networks via Geometry-Aware Relevance Propagation28 Sep 2026
- 2026ResLRP: The Role of Residual Cancellation in Attribution Instability in Vision Transformers15 Sep 2026
- 2026HiLRP: Toward One Trustworthy Explanation for Vision Transformer: Conservation-Valid Attribution via Attention Primitives1 Sep 2026
- 2026Hidden in the Request: Explaining Unethical LLM Compliance through Token Relevance24 Aug 2026
- 2026Uncertainty propagation in auto-regressive random neural network models20 Aug 2026
- 2026Local Additive Feature Attribution: A Mathematical Taxonomy and Reporting Checklist15 Jul 2026
- 2026Explaining Temporal Graph Neural Networks via Feature-induced Information Flow25 Jun 2026
- 2026SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches16 Jun 2026
- 2026Normalized Relevance Measure as a Unifying Framework to Explain Neural Network Latent Structures30 May 2026
- 2026The Neglected Baseline in Model Interpretation21 May 2026
- 2026From Clever Hans to Scientific Discovery: Interpreting EEG Foundational Transformers with LRP12 May 2026
- 2026GRALIS: Fusing Coalition and Gradient Attribution with Closed-Form Conservation Error and Finite-Sample Guarantees6 May 2026
12 newest of 239 All 239 (JSON)