On the Robustness of Interpretability Methods
Not on the map. Why?
Abstract (arXiv)
We argue that robustness of explanations---i.e., that similar inputs should give rise to similar explanations---is a key desideratum for interpretability. We introduce metrics to quantify robustness and demonstrate that current methods do not perform well according to these metrics. Finally, we propose ways that robustness can be enforced on existing interpretability approaches.
Key facts. Cited by 310 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 50; 2022: 62; 2023: 50; 2024: 57; 2025: 44; 2026: 47.
310 papers.
Sort:
By area:
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 233
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 156
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
- 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 125
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 120
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2023Can Large Language Models Explain Themselves? A Study of LLM-Generated Self-Explanationscited by 90
- 2022Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanationscited by 77
- 2021Explaining Time Series Predictions with Dynamic Maskscited by 72
- 2022TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversationscited by 65
- 2022A Rigorous Study of Integrated Gradients Method and Extensions to Internal Neuron Attributionscited by 64
38 more
- 2021Counterfactuals and Causability in Explainable Artificial Intelligence: Theory, Algorithms, and Applicationscited by 59
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
- 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
- 2022Framework for Evaluating Faithfulness of Local Explanationscited by 55
- 2022Rethinking Explainability as a Dialogue: A Practitioner's Perspectivecited by 52
- 2022Rethinking Stability for Attribution-based Explanationscited by 52
- 2022Robust Counterfactual Explanations for Tree-Based Ensemblescited by 49
- 2021GLocalX -- From Local to Global Explanations of Black Box AI Modelscited by 48
- 2021Robust Explainability: A Tutorial on Gradient-Based Attribution Methods for Deep Neural Networkscited by 48
- 2021Towards the Unification and Robustness of Perturbation and Gradient Based Explanationscited by 47
- 2023Robust Counterfactual Explanations for Neural Networks With Probabilistic Guaranteescited by 45
- 2021Evaluating Robustness of Counterfactual Explanationscited by 41
- 2022Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanationscited by 40
- 2021A Survey on the Robustness of Feature Importance and Counterfactual Explanationscited by 38
- 2022A Comparative Study of Faithfulness Metrics for Model Interpretability Methodscited by 38
- 2021Will Artificial Intelligence supersede Earth System and Climate Models?cited by 37
- 2022Can Rationalization Improve Robustness?cited by 36
- 2022WeightedSHAP: analyzing and improving Shapley based feature attributionscited by 36
- 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learningcited by 35
- 2022Guidelines and Evaluation of Clinical Explainable AI in Medical Image Analysiscited by 34
- 2024LeGrad: An Explainability Method for Vision Transformers via Feature Formation Sensitivitycited by 32
- 20213DB: A Framework for Debugging Computer Vision Modelscited by 31
- 2021On the Sensitivity and Stability of Model Interpretations in NLPcited by 30
- 2021RKHS-SHAP: Shapley Values for Kernel Methodscited by 30
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2022SAFARI: Versatile and Efficient Evaluations for Robustness of Interpretabilitycited by 28
- 2021On Locality of Local Explanation Modelscited by 25
- 2023Finding the right XAI method -- A Guide for the Evaluation and Ranking of Explainable AI Methods in Climate Sciencecited by 25
- 2023An Empirical Evaluation of the Rashomon Effect in Explainable Machine Learningcited by 25
- 2022Explainable AI for clinical and remote health applications: a survey on tabular and time series datacited by 24
- 2021Best of both worlds: local and global explanations with human-understandable conceptscited by 22
- 2021CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Modelscited by 20
- 2022Attribution-based Explanations that Provide Recourse Cannot be Robustcited by 20
- 2022SoK: Explainable Machine Learning for Computer Security Applicationscited by 20
- 2022Evaluating Explainable AI on a Multi-Modal Medical Imaging Task: Can Existing Algorithms Fulfill Clinical Requirements?cited by 19
- 2021Logic Traps in Evaluating Attribution Scorescited by 18
- 2021Scrutinizing XAI using linear ground-truth data with suppressor variablescited by 18
50 most cited of 310 All 310 (JSON)
- 2026A Comparative Explainability Framework for DeBERTa-v3 in Zero-Shot Medical Abstract Classification1 Oct 2026
- 2026Verifying the Linear Representation Hypothesis: How Interpretable Are Vision SAEs?28 Sep 2026
- 2026Controllable GNN Explanations via Multi-Metric Preference Selection26 Sep 2026
- 2026Diverse by Design: Architectural Constraints for Prototype-Based Interpretability23 Sep 2026
- 2026Evaluating Explanation Methods by the Predictors They Induce17 Sep 2026
- 2026Probabilistic Linear Explanations16 Sep 2026
- 2026Stable and Faithful Explanations for Knowledge Tracing15 Sep 2026
- 2026XAI-Arena: Can LLMs Assess the Quality of XAI Explanations?8 Sep 2026
- 2026A Formal Methodological Framework for Auditing Robustness and Fidelity in Explainable AI: From Application to Trust Certification24 Aug 2026
- 2026Accurate Ensembles, Fragile Narratives: Multi-Scale Stacking and a Fidelity Audit of LLM-Generated Explanations for Credit Risk8 Aug 2026
- 2026Human-Centered Explainable AI for TinyML Edge Devices: A Pareto-Based Selection Framework with LLM-Guided Design7 Aug 2026
- 2026Measuring Explainer Stability via Attribution Separability3 Aug 2026
38 more
- 2026VGER: Voxel-Guided Global Event Ranking for Event Cloud Attribution2 Aug 2026
- 2026A Human-Centered Validation of the Explainability-Performance Coefficient31 Jul 2026
- 2026Consistent Evidence, Robust Recognition: Faithful Attribution Regularization under Geometric Transformations26 Jul 2026
- 2026Local Additive Feature Attribution: A Mathematical Taxonomy and Reporting Checklist15 Jul 2026
- 2026DeepPySR -- A Symbolic Regression Framework with Dynamic Pruning, Pareto Selection, and Hierarchical Composition for Real-World Scientific Discovery9 Jul 2026
- 2026Beyond Gradient-Based Attacks: Adversarial Robustness and Explainability Stability in Cybersecurity Classifiers2 Jul 2026
- 2026Does Role Specialization Matter for Explanation Faithfulness in Mixture-of-Experts?28 Jun 2026
- 2026The Failures of Marginal Influence-Based Attribution Methods for Global Time Series Explanations25 Jun 2026
- 2026Listening with Attention: Entropy-Guided Explainability for Transformer-Based Audio Models12 Jun 2026
- 2026Forecasting Future Behavior as a Learning Task9 Jun 2026
- 2026Improving Adversarial Robustness of Attribution via Implicit Regularization28 May 2026
- 2026GESD: Beyond Outcome-Oriented Fairness14 May 2026
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2026Architecture-Aware Explanation Auditing for Industrial Visual Inspection14 May 2026
- 2026Interpretability Can Be Actionable11 May 2026
- 2026Beyond the Wrapper: Identifying Artifact Reliance in Static Malware Classifiers using TRUSTEE7 May 2026
- 2026A renormalization-group inspired lattice-based framework for piecewise generalized linear models6 May 2026
- 2026NEURON: A Neuro-symbolic System for Grounded Clinical Explainability2 May 2026
- 2026Explanation of Dynamic Physical Field Predictions using WassersteinGrad: Application to Autoregressive Weather Forecasting24 Apr 2026
- 2026The Query Channel: Information-Theoretic Limits of Masking-Based Explanations17 Apr 2026
- 2026Hessian-Enhanced Token Attribution (HETA): Interpreting Autoregressive LLMs14 Apr 2026
- 2026Regional Explanations: Bridging Local and Global Variable Importance13 Apr 2026
- 2026Feature Attribution Stability Suite: How Stable Are Post-Hoc Attributions?2 Apr 2026
- 2026Uncertainty Gating for Cost-Aware Explainable Artificial Intelligence31 Mar 2026
- 2026In-Context Symbolic Regression for Robustness-Improved Kolmogorov-Arnold Networks16 Mar 2026
- 2026Informative Perturbation Selection for Uncertainty-Aware Post-hoc Explanations16 Mar 2026
- 2026Training for Trustworthy Saliency Maps: Adversarial Training Meets Feature-Map Smoothing7 Mar 2026
- 2026Measuring the Fragility of Trust: Devising Credibility Index via Explanation Stability (CIES) for Business Decision Support Systems5 Mar 2026
- 2026A Polynomial-Time Axiomatic Alternative to SHAP for Feature Attribution28 Feb 2026
- 2026Machine Learning in Epidemiology18 Feb 2026
- 2026Exploring SAIG Methods for an Objective Evaluation of XAI9 Feb 2026
- 2026A Unified Matrix-Spectral Framework for Stability and Interpretability in Deep Learning1 Feb 2026
- 2026How Understanding Forecast Uncertainty Resolves the Explainability Problem in Machine Learning Models30 Jan 2026
- 2026Explanation Multiplicity in SHAP: Characterization and Assessment19 Jan 2026
- 2026GroupSegment-SHAP: Shapley Value Explanations with Group-Segment Players for Multivariate Time Series3 Jan 2026
- 2025EvoXplain: When Machine Learning Models Agree on Predictions but Disagree on Why -- Measuring Mechanistic Multiplicity Across Training Runs23 Dec 2025
- 2025Augmenting Intelligence: A Hybrid Framework for Scalable and Stable Explanations22 Dec 2025
- 2025Rethinking Robustness: A New Approach to Evaluating Feature Attribution Methods7 Dec 2025
50 newest of 310 All 310 (JSON)
- 2023Can Large Language Models Explain Themselves? A Study of LLM-Generated Self-Explanationscited by 90
- 2022A Comparative Study of Faithfulness Metrics for Model Interpretability Methodscited by 38
- 2023Incorporating Attribution Importance for Improving Faithfulness Metricscited by 14
- 2022Towards Human-Compatible XAI: Explaining Data Differentials with Concept Induction over Background Knowledgecited by 6
- 2025Neural Probabilistic Circuits: Enabling Compositional and Interpretable Predictions through Logical Reasoningcited by 6
- 2025Neural Probabilistic Circuits: Enabling Compositional and Interpretable Predictions through Logical Reasoning13 Jan 2025
- 2023Can Large Language Models Explain Themselves? A Study of LLM-Generated Self-Explanations17 Oct 2023
- 2023Incorporating Attribution Importance for Improving Faithfulness Metrics17 May 2023
- 2022Towards Human-Compatible XAI: Explaining Data Differentials with Concept Induction over Background Knowledge27 Sep 2022
- 2022A Comparative Study of Faithfulness Metrics for Model Interpretability Methods12 Apr 2022
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 156
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
- 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 125
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 120
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2022Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanationscited by 77
- 2021Explaining Time Series Predictions with Dynamic Maskscited by 72
- 2022TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversationscited by 65
- 2022A Rigorous Study of Integrated Gradients Method and Extensions to Internal Neuron Attributionscited by 64
- 2021Counterfactuals and Causability in Explainable Artificial Intelligence: Theory, Algorithms, and Applicationscited by 59
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
12 most cited of 301 All 301 (JSON)
- 2026A Comparative Explainability Framework for DeBERTa-v3 in Zero-Shot Medical Abstract Classification1 Oct 2026
- 2026Verifying the Linear Representation Hypothesis: How Interpretable Are Vision SAEs?28 Sep 2026
- 2026Controllable GNN Explanations via Multi-Metric Preference Selection26 Sep 2026
- 2026Diverse by Design: Architectural Constraints for Prototype-Based Interpretability23 Sep 2026
- 2026Evaluating Explanation Methods by the Predictors They Induce17 Sep 2026
- 2026Probabilistic Linear Explanations16 Sep 2026
- 2026Stable and Faithful Explanations for Knowledge Tracing15 Sep 2026
- 2026XAI-Arena: Can LLMs Assess the Quality of XAI Explanations?8 Sep 2026
- 2026A Formal Methodological Framework for Auditing Robustness and Fidelity in Explainable AI: From Application to Trust Certification24 Aug 2026
- 2026Accurate Ensembles, Fragile Narratives: Multi-Scale Stacking and a Fidelity Audit of LLM-Generated Explanations for Credit Risk8 Aug 2026
- 2026Human-Centered Explainable AI for TinyML Edge Devices: A Pareto-Based Selection Framework with LLM-Guided Design7 Aug 2026
- 2026Measuring Explainer Stability via Attribution Separability3 Aug 2026
12 newest of 301 All 301 (JSON)