Do Not Trust Additive Explanations
Not on the map. Why?
Abstract (arXiv)
Explainable Artificial Intelligence (XAI)has received a great deal of attention recently. Explainability is being presented as a remedy for the distrust of complex and opaque models. Model agnostic methods such as LIME, SHAP, or Break Down promise instance-level interpretability for any complex machine learning model. But how faithful are these additive explanations? Can we rely on additive explanations for non-additive models? In this paper, we (1) examine the behavior of the most popular instance-level explanations under the presence of interactions, (2) introduce a new method that detects interactions for instance-level explanations, (3) perform a large scale benchmark to see how frequently additive explanations may be misleading.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 0; 2024: 5; 2025: 3; 2026: 3.
16 papers.
Sort:
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 367
- 2021PredDiff: Explanations and Interactions from Conditional Expectationscited by 17
- 2021Show or Suppress? Managing Input Uncertainty in Machine Learning Model Explanationscited by 15
- 2024Why do explanations fail? A typology and discussion on failures in XAIcited by 6
- 2024X Hacking: The Threat of Misguided AutoMLcited by 5
- 2024When Can You Trust Your Explanations? A Robustness Analysis on Feature Importancescited by 5
- 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Pythoncited by 5
- 2025Trustworthy AI Must Account for Interactionscited by 5
- 2021Consistent Sufficient Explanations and Minimal Local Rules for explaining regression and classification modelscited by 4
- 2025ProtoMedX: Towards Explainable Multi-Modal Prototype Learning for Bone Health Classificationcited by 2
- 2024Neuro-Symbolic Rule Listscited by 1
- 2026Interpretable and Explainable Surrogate Modeling for Simulations: A State-of-the-Art Survey and Perspectives on Explainable AI for Decision-Makingcited by 1
4 more
- 2022Causality-Aware Local Interpretable Model-Agnostic Explanationscited by 0
- 2024Succinct Interaction-Aware Explanationscited by 0
- 2026Reliable XAI Explanations in Sudden Cardiac Death Prediction for Chagas Cardiomyopathycited by 0
- 2026Beyond Explaining Predictions: Logic-Based Explanations for Confidence in Machine Learning Modelscited by 0
- 2026Beyond Explaining Predictions: Logic-Based Explanations for Confidence in Machine Learning Models9 Jun 2026
- 2026Interpretable and Explainable Surrogate Modeling for Simulations: A State-of-the-Art Survey and Perspectives on Explainable AI for Decision-Making15 Apr 2026
- 2026Reliable XAI Explanations in Sudden Cardiac Death Prediction for Chagas Cardiomyopathy25 Feb 2026
- 2025ProtoMedX: Towards Explainable Multi-Modal Prototype Learning for Bone Health Classification18 Sep 2025
- 2025Trustworthy AI Must Account for Interactions9 Apr 2025
- 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Python2 Apr 2025
- 2024Neuro-Symbolic Rule Lists10 Nov 2024
- 2024When Can You Trust Your Explanations? A Robustness Analysis on Feature Importances20 Jun 2024
- 2024Why do explanations fail? A typology and discussion on failures in XAI22 May 2024
- 2024Succinct Interaction-Aware Explanations8 Feb 2024
- 2024X Hacking: The Threat of Misguided AutoML16 Jan 2024
- 2022Causality-Aware Local Interpretable Model-Agnostic Explanations10 Dec 2022
4 more
- 2021Consistent Sufficient Explanations and Minimal Local Rules for explaining regression and classification models8 Nov 2021
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges20 Mar 2021
- 2021PredDiff: Explanations and Interactions from Conditional Expectations26 Feb 2021
- 2021Show or Suppress? Managing Input Uncertainty in Machine Learning Model Explanations23 Jan 2021
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 367
- 2021PredDiff: Explanations and Interactions from Conditional Expectationscited by 17
- 2021Show or Suppress? Managing Input Uncertainty in Machine Learning Model Explanationscited by 15
- 2024Why do explanations fail? A typology and discussion on failures in XAIcited by 6
- 2024X Hacking: The Threat of Misguided AutoMLcited by 5
- 2024When Can You Trust Your Explanations? A Robustness Analysis on Feature Importancescited by 5
- 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Pythoncited by 5
- 2025Trustworthy AI Must Account for Interactionscited by 5
- 2021Consistent Sufficient Explanations and Minimal Local Rules for explaining regression and classification modelscited by 4
- 2025ProtoMedX: Towards Explainable Multi-Modal Prototype Learning for Bone Health Classificationcited by 2
- 2024Neuro-Symbolic Rule Listscited by 1
- 2026Interpretable and Explainable Surrogate Modeling for Simulations: A State-of-the-Art Survey and Perspectives on Explainable AI for Decision-Makingcited by 1
12 most cited of 16 All 16 (JSON)
- 2026Beyond Explaining Predictions: Logic-Based Explanations for Confidence in Machine Learning Models9 Jun 2026
- 2026Interpretable and Explainable Surrogate Modeling for Simulations: A State-of-the-Art Survey and Perspectives on Explainable AI for Decision-Making15 Apr 2026
- 2026Reliable XAI Explanations in Sudden Cardiac Death Prediction for Chagas Cardiomyopathy25 Feb 2026
- 2025ProtoMedX: Towards Explainable Multi-Modal Prototype Learning for Bone Health Classification18 Sep 2025
- 2025Trustworthy AI Must Account for Interactions9 Apr 2025
- 2025shapr: Explaining Machine Learning Models with Conditional Shapley Values in R and Python2 Apr 2025
- 2024Neuro-Symbolic Rule Lists10 Nov 2024
- 2024When Can You Trust Your Explanations? A Robustness Analysis on Feature Importances20 Jun 2024
- 2024Why do explanations fail? A typology and discussion on failures in XAI22 May 2024
- 2024Succinct Interaction-Aware Explanations8 Feb 2024
- 2024X Hacking: The Threat of Misguided AutoML16 Jan 2024
- 2022Causality-Aware Local Interpretable Model-Agnostic Explanations10 Dec 2022
12 newest of 16 All 16 (JSON)