Investigating the influence of noise and distractors on the interpretation of neural networks
Not on the map. Why?
Abstract (arXiv)
Understanding neural networks is becoming increasingly important. Over the last few years different types of visualisation and explanation methods have been proposed. However, none of them explicitly considered the behaviour in the presence of noise and distracting elements. In this work, we will show how noise and distracting dimensions can influence the result of an explanation model. This gives a new theoretical insights to aid selection of the most appropriate explanation model within the deep-Taylor decomposition framework.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 11; 2024: 15; 2025: 3; 2026: 1.
54 papers.
Sort:
By area:
- 2021Improving Deep Learning Interpretability by Saliency Guided Trainingcited by 68
- 2024From Understanding to Utilization: A Survey on Explainability for Large Language Modelscited by 47
- 2022GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformerscited by 44
- 2021Order in the Court: Explainable AI Methods Prone to Disagreementcited by 36
- 2023DecompX: Explaining Transformers Decisions by Propagating Token Decompositioncited by 31
- 2021Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classificationcited by 29
- 2021CAMERAS: Enhanced Resolution And Sanity preserving Class Activation Mapping for image saliencycited by 28
- 2024Mechanistic?cited by 25
- 2022An Empirical Study on Explanations in Out-of-Domain Settingscited by 21
- 2021CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understandingcited by 17
- 2021Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Saliencecited by 16
- 2023CATfOOD: Counterfactual Augmented Training for Improving Out-of-Domain Performance and Calibrationcited by 16
38 more
- 2022On the Impact of Temporal Concept Drift on Model Explanationscited by 14
- 2023Incorporating Attribution Importance for Improving Faithfulness Metricscited by 14
- 2022A Song of (Dis)agreement: Evaluating the Evaluation of Explainable Artificial Intelligence in Natural Language Processingcited by 13
- 2024ReAGent: A Model-agnostic Feature Attribution Method for Generative Language Modelscited by 12
- 2021Flexible Instance-Specific Rationalization of NLP Modelscited by 10
- 2023SMOOT: Saliency Guided Mask Optimized Online Trainingcited by 8
- 2024Full Bayesian Significance Testing for Neural Networkscited by 8
- 2021Model Doctor: A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifierscited by 6
- 2022This Patient Looks Like That Patient: Prototypical Networks for Interpretable Diagnosis Prediction from Clinical Textcited by 6
- 2024Comparing Explanation Faithfulness between Multilingual and Monolingual Fine-tuned Language Modelscited by 6
- 2024Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Modelscited by 6
- 2022Identifying and Characterizing Active Citizens who Refute Misinformation in Social Mediacited by 5
- 2023Faithfulness Measurable Masked Language Modelscited by 5
- 2024LibraGrad: Balancing Gradient Flow for Universally Better Vision Transformer Attributionscited by 5
- 2022Backdooring Explainable Machine Learningcited by 4
- 2023Towards Faithful Explanations for Text Classification with Robustness Improvement and Explanation Guided Trainingcited by 4
- 2024DUE: Dynamic Uncertainty-Aware Explanation Supervision via 3D Imputationcited by 4
- 2024Saliency Assisted Quantization for Neural Networkscited by 4
- 2024NormXLogit: The Head-on-Top Never Liescited by 4
- 2024Quantized and Interpretable Learning Scheme for Deep Neural Networks in Classification Taskcited by 4
- 2025B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainabilitycited by 4
- 2021Spatio-Temporal Perturbations for Video Attributioncited by 3
- 2022TRUST-LAPSE: An Explainable and Actionable Mistrust Scoring Framework for Model Monitoringcited by 3
- 2022Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectorscited by 3
- 2022A Rigorous Study Of The Deep Taylor Decompositioncited by 3
- 2023XAI-CLASS: Explanation-Enhanced Text Classification with Extremely Weak Supervisioncited by 3
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive reviewcited by 3
- 2023Guide the Learner: Controlling Product of Experts Debiasing Method Based on Token Attribution Similaritiescited by 2
- 2023Rethinking interpretation: Input-agnostic saliency mapping of deep visual classifierscited by 2
- 2021On the Impact of Interpretability Methods in Active Image Augmentation Methodcited by 1
- 2024Explanation Regularisation through the Lens of Attributionscited by 1
- 2021Attribution Mask: Filtering Out Irrelevant Features By Recursively Focusing Attention on Inputs of DNNscited by 0
- 2021It's FLAN time! Summing feature-wise latent representations for interpretabilitycited by 0
- 2021"How Does It Detect A Malicious App?" Explaining the Predictions of AI-based Android Malware Detectorcited by 0
- 2022Accountable and Explainable Methods for Complex Reasoning over Textcited by 0
- 2023CiteCaseLAW: Citation Worthiness Detection in Caselaw for Legal Assistive Writingcited by 0
- 2023Reconstruct Before Summarize: An Efficient Two-Step Framework for Condensing and Summarizing Meeting Transcriptscited by 0
- 2024NeuralSentinel: Safeguarding Neural Network Reliability and Trustworthinesscited by 0
50 most cited of 54 All 54 (JSON)
- 2026Legal Experts Disagree With Rationale Extraction Techniques for Explaining ECtHR Case Outcome Classification18 Jan 2026
- 2025Can LLMs Faithfully Explain Themselves in Low-Resource Languages? A Case Study on Emotion Detection in Persian24 Nov 2025
- 2025Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?26 Sep 2025
- 2025B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainability18 Feb 2025
- 2024Quantized and Interpretable Learning Scheme for Deep Neural Networks in Classification Task5 Dec 2024
- 2024NormXLogit: The Head-on-Top Never Lies25 Nov 2024
- 2024LibraGrad: Balancing Gradient Flow for Universally Better Vision Transformer Attributions24 Nov 2024
- 2024Saliency Assisted Quantization for Neural Networks7 Nov 2024
- 2024Mechanistic?7 Oct 2024
- 2024Explanation Regularisation through the Lens of Attributions23 Jul 2024
- 2024Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Models18 Jun 2024
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive review30 May 2024
38 more
- 2024Comparing Explanation Faithfulness between Multilingual and Monolingual Fine-tuned Language Models19 Mar 2024
- 2024DUE: Dynamic Uncertainty-Aware Explanation Supervision via 3D Imputation16 Mar 2024
- 2024DeepCSHAP: Utilizing Shapley Values to Explain Deep Complex-Valued Neural Networks13 Mar 2024
- 2024NeuralSentinel: Safeguarding Neural Network Reliability and Trustworthiness12 Feb 2024
- 2024ReAGent: A Model-agnostic Feature Attribution Method for Generative Language Models1 Feb 2024
- 2024Full Bayesian Significance Testing for Neural Networks24 Jan 2024
- 2024From Understanding to Utilization: A Survey on Explainability for Large Language Models23 Jan 2024
- 2023Towards Faithful Explanations for Text Classification with Robustness Improvement and Explanation Guided Training29 Dec 2023
- 2023XAI-CLASS: Explanation-Enhanced Text Classification with Extremely Weak Supervision31 Oct 2023
- 2023Faithfulness Measurable Masked Language Models11 Oct 2023
- 2023SMOOT: Saliency Guided Mask Optimized Online Training1 Oct 2023
- 2023CATfOOD: Counterfactual Augmented Training for Improving Out-of-Domain Performance and Calibration14 Sep 2023
- 2023DecompX: Explaining Transformers Decisions by Propagating Token Decomposition5 Jun 2023
- 2023Incorporating Attribution Importance for Improving Faithfulness Metrics17 May 2023
- 2023Reconstruct Before Summarize: An Efficient Two-Step Framework for Condensing and Summarizing Meeting Transcripts13 May 2023
- 2023CiteCaseLAW: Citation Worthiness Detection in Caselaw for Legal Assistive Writing3 May 2023
- 2023Rethinking interpretation: Input-agnostic saliency mapping of deep visual classifiers31 Mar 2023
- 2023Guide the Learner: Controlling Product of Experts Debiasing Method Based on Token Attribution Similarities6 Feb 2023
- 2022A Rigorous Study Of The Deep Taylor Decomposition14 Nov 2022
- 2022Accountable and Explainable Methods for Complex Reasoning over Text9 Nov 2022
- 2022On the Impact of Temporal Concept Drift on Model Explanations17 Oct 2022
- 2022This Patient Looks Like That Patient: Prototypical Networks for Interpretable Diagnosis Prediction from Clinical Text16 Oct 2022
- 2022Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors7 Oct 2022
- 2022TRUST-LAPSE: An Explainable and Actionable Mistrust Scoring Framework for Model Monitoring22 Jul 2022
- 2022A Song of (Dis)agreement: Evaluating the Evaluation of Explainable Artificial Intelligence in Natural Language Processing9 May 2022
- 2022GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers6 May 2022
- 2022Identifying and Characterizing Active Citizens who Refute Misinformation in Social Media21 Apr 2022
- 2022Backdooring Explainable Machine Learning20 Apr 2022
- 2022An Empirical Study on Explanations in Out-of-Domain Settings28 Feb 2022
- 2021Model Doctor: A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifiers9 Dec 2021
- 2021Improving Deep Learning Interpretability by Saliency Guided Training29 Nov 2021
- 2021"How Does It Detect A Malicious App?" Explaining the Predictions of AI-based Android Malware Detector6 Nov 2021
- 2021Spatio-Temporal Perturbations for Video Attribution1 Sep 2021
- 2021Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Salience31 Aug 2021
- 2021CAMERAS: Enhanced Resolution And Sanity preserving Class Activation Mapping for image saliency20 Jun 2021
- 2021It's FLAN time! Summing feature-wise latent representations for interpretability18 Jun 2021
- 2021CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding23 May 2021
- 2021Order in the Court: Explainable AI Methods Prone to Disagreement7 May 2021
50 newest of 54 All 54 (JSON)
- 2021Improving Deep Learning Interpretability by Saliency Guided Trainingcited by 68
- 2024From Understanding to Utilization: A Survey on Explainability for Large Language Modelscited by 47
- 2022GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformerscited by 44
- 2021Order in the Court: Explainable AI Methods Prone to Disagreementcited by 36
- 2023DecompX: Explaining Transformers Decisions by Propagating Token Decompositioncited by 31
- 2021Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classificationcited by 29
- 2021CAMERAS: Enhanced Resolution And Sanity preserving Class Activation Mapping for image saliencycited by 28
- 2024Mechanistic?cited by 25
- 2022An Empirical Study on Explanations in Out-of-Domain Settingscited by 21
- 2021CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understandingcited by 17
- 2021Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Saliencecited by 16
- 2023CATfOOD: Counterfactual Augmented Training for Improving Out-of-Domain Performance and Calibrationcited by 16
12 most cited of 53 All 53 (JSON)
- 2026Legal Experts Disagree With Rationale Extraction Techniques for Explaining ECtHR Case Outcome Classification18 Jan 2026
- 2025Can LLMs Faithfully Explain Themselves in Low-Resource Languages? A Case Study on Emotion Detection in Persian24 Nov 2025
- 2025Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?26 Sep 2025
- 2025B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainability18 Feb 2025
- 2024Quantized and Interpretable Learning Scheme for Deep Neural Networks in Classification Task5 Dec 2024
- 2024NormXLogit: The Head-on-Top Never Lies25 Nov 2024
- 2024LibraGrad: Balancing Gradient Flow for Universally Better Vision Transformer Attributions24 Nov 2024
- 2024Saliency Assisted Quantization for Neural Networks7 Nov 2024
- 2024Mechanistic?7 Oct 2024
- 2024Explanation Regularisation through the Lens of Attributions23 Jul 2024
- 2024Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Models18 Jun 2024
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive review30 May 2024
12 newest of 53 All 53 (JSON)