Local Explanations via Necessity and Sufficiency: Unifying Theory and Practice
Not on the map. Why?
Abstract (arXiv)
Necessity and sufficiency are the building blocks of all successful explanations. Yet despite their importance, these notions have been conceptually underdeveloped and inconsistently applied in explainable artificial intelligence (XAI), a fast-growing research area that is so far lacking in firm theoretical foundations. Building on work in logic, probability, and causality, we establish the central role of necessity and sufficiency in XAI, unifying seemingly disparate methods in a single formal framework. We provide a sound and complete algorithm for computing explanatory factors with respect to a given context, and demonstrate its flexibility and competitive performance against state of the art alternatives on various tasks.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 37 of its 105 references that are in the map. First posted on arXiv 27 Mar 2021.
Builds on
37 of 105 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2020Concept Bottleneck Modelscited by 1,022
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2016The Mythos of Model Interpretabilitycited by 716
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2019The many Shapley values for model explanationcited by 341
- 2018Actionable Recourse in Linear Classificationcited by 327
25 more
- 2019Interpretable machine learning: definitions, methods, and applicationscited by 303
- 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 261
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
- 2019Explaining individual predictions when features are dependent: More accurate approximations to Shapley valuescited by 205
- 2020Problems with Shapley-value-based explanations as feature importance measurescited by 198
- 2018Abduction-Based Explanations for Machine Learning Modelscited by 159
- 2015Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelcited by 140
- 2020Algorithmic recourse under imperfect causal knowledge: a probabilistic approachcited by 139
- 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
- 2019The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasonscited by 115
- 2019"How do I fool you?": Manipulating User Trust via Misleading Black Box Explanationscited by 111
- 2020Causal Shapley Values: Exploiting Causal Knowledge to Explain Individual Predictions of Complex Modelscited by 107
- 2020On The Reasons Behind Decisionscited by 99
- 2013Probabilities of Causation: Bounds and Identificationcited by 89
- 2020Towards Unifying Feature Attribution and Counterfactual Explanations: Different Means to the Same Endcited by 66
- 2019Approximate Causal Abstractioncited by 62
- 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
- 2021Causal Sufficiency and Actual Causationcited by 29
- 2019Counterfactual Explanation Algorithms for Behavioral and Textual Datacited by 26
- 2020Explaining Data-Driven Decisions made by AI Systems: The Counterfactual Approachcited by 26
- 2018Interpreting Neural Network Judgments via Minimal, Stable, and Symbolic Correctionscited by 19
- 2019Learning Representations by Humans, for Humanscited by 18
- 2020Causal Feature Learning for Utility-Maximizing Agentscited by 5
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 10; 2024: 13; 2025: 5; 2026: 5.
45 papers.
Sort:
- 2022Impossibility Theorems for Feature Attributioncited by 78
- 2021Desiderata for Representation Learning: A Causal Perspectivecited by 76
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2022Causal Explanations and XAIcited by 30
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 30
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2023Towards Trustworthy Explanation: On Causal Rationalizationcited by 19
- 2021Rational Shapley Valuescited by 18
- 2022Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detectioncited by 18
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2022On the Probability of Necessity and Sufficiency of Explaining Graph Neural Networks: A Lower Bound Optimization Approachcited by 11
33 more
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasonscited by 11
- 2023Axiomatic Aggregations of Abductive Explanationscited by 10
- 2022XInsight: eXplainable Data Analysis Through The Lens of Causalitycited by 9
- 2023The Utility of "Even if..." Semifactual Explanation to Optimise Positive Outcomescited by 8
- 2024Probabilities of Causation for Continuous and Vector Variablescited by 8
- 2024Feature Attribution with Necessity and Sufficiency via Dual-stage Perturbation Test for Causal Explanationcited by 6
- 2024Beyond Model Interpretability: Socio-Structural Explanations in Machine Learningcited by 6
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspectivecited by 5
- 2022Explaining Image Classifiers Using Contrastive Counterfactuals in Generative Latent Spacescited by 4
- 2023A Refutation of Shapley Values for Explainabilitycited by 4
- 2022Local Interpretable Model Agnostic Shap Explanations for machine learning modelscited by 3
- 2023Concept-Based Explanations to Test for False Causal Relationships Learned by Abusive Language Classifierscited by 3
- 2024Unifying Invariance and Spuriousity for Graph Out-of-Distribution via Probability of Necessity and Sufficiencycited by 3
- 2024Sequential Conditional Transport on Probabilistic Graphs for Interpretable Counterfactual Fairnesscited by 3
- 2024Sufficient and Necessary Explanations (and What Lies in Between)cited by 3
- 2021When Stability meets Sufficiency: Informative Explanations that do not Overwhelmcited by 2
- 2023Fixing confirmation bias in feature attribution methods via semantic matchcited by 2
- 2024SIDEs: Separating Idealization from Deceptive Explanations in xAIcited by 2
- 2024Challenges and Opportunities in Text Generation Explainabilitycited by 2
- 2024Are Objective Explanatory Evaluation metrics Trustworthy? An Adversarial Analysiscited by 2
- 2024Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiencycited by 2
- 2024Monetizing Currency Pair Sentiments through LLM Explainabilitycited by 2
- 2025Attribution Explanations for Deep Neural Networks: A Theoretical Perspectivecited by 2
- 2021Model Explanations via the Axiomatic Causal Lenscited by 1
- 2025Learning Probabilities of Causation with Mask-Augmented Datacited by 1
- 2026A unified framework for evaluating the robustness of machine-learning interpretability for prospect riskingcited by 1
- 2022Effective Explanations for Entity Resolution Modelscited by 0
- 2025Fixed Point Explainabilitycited by 0
- 2025Unifying Post-hoc Explanations of Knowledge Graph Completionscited by 0
- 2026Fairness under Graph Uncertainty: Achieving Interventional Fairness with Partially Known Causal Graphs over Clusters of Variablescited by 0
- 2026Explainable Control Framework (XCF) based on Fuzzy Model-Agnostic Explanation and LLM Agent-Supported Interfacecited by 0
- 2026Regional Explanations via Causal Sufficiency and Necessitycited by 0
- 2026Where MLLMs Fail and Why: Causal Task Decomposition for Capability Failure Diagnosiscited by 0
- 2026Where MLLMs Fail and Why: Causal Task Decomposition for Capability Failure Diagnosis30 Sep 2026
- 2026Regional Explanations via Causal Sufficiency and Necessity16 Sep 2026
- 2026Explainable Control Framework (XCF) based on Fuzzy Model-Agnostic Explanation and LLM Agent-Supported Interface24 Jun 2026
- 2026Fairness under Graph Uncertainty: Achieving Interventional Fairness with Partially Known Causal Graphs over Clusters of Variables27 Feb 2026
- 2026A unified framework for evaluating the robustness of machine-learning interpretability for prospect risking16 Feb 2026
- 2025Attribution Explanations for Deep Neural Networks: A Theoretical Perspective11 Aug 2025
- 2025Unifying Post-hoc Explanations of Knowledge Graph Completions29 Jul 2025
- 2025Learning Probabilities of Causation with Mask-Augmented Data22 May 2025
- 2025Fixed Point Explainability18 May 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2024Sufficient and Necessary Explanations (and What Lies in Between)30 Sep 2024
- 2024Beyond Model Interpretability: Socio-Structural Explanations in Machine Learning5 Sep 2024
33 more
- 2024Sequential Conditional Transport on Probabilistic Graphs for Interpretable Counterfactual Fairness6 Aug 2024
- 2024Monetizing Currency Pair Sentiments through LLM Explainability29 Jul 2024
- 2024Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiency21 Jul 2024
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs21 Jun 2024
- 2024Are Objective Explanatory Evaluation metrics Trustworthy? An Adversarial Analysis12 Jun 2024
- 2024Local vs. Global Interpretability: A Computational Complexity Perspective5 Jun 2024
- 2024Probabilities of Causation for Continuous and Vector Variables30 May 2024
- 2024Challenges and Opportunities in Text Generation Explainability14 May 2024
- 2024SIDEs: Separating Idealization from Deceptive Explanations in xAI25 Apr 2024
- 2024Unifying Invariance and Spuriousity for Graph Out-of-Distribution via Probability of Necessity and Sufficiency14 Feb 2024
- 2024Feature Attribution with Necessity and Sufficiency via Dual-stage Perturbation Test for Causal Explanation13 Feb 2024
- 2023The Utility of "Even if..." Semifactual Explanation to Optimise Positive Outcomes29 Oct 2023
- 2023Axiomatic Aggregations of Abductive Explanations29 Sep 2023
- 2023The role of causality in explainable artificial intelligence18 Sep 2023
- 2023A Refutation of Shapley Values for Explainability6 Sep 2023
- 2023Concept-Based Explanations to Test for False Causal Relationships Learned by Abusive Language Classifiers4 Jul 2023
- 2023Fixing confirmation bias in feature attribution methods via semantic match3 Jul 2023
- 2023Towards Trustworthy Explanation: On Causal Rationalization25 Jun 2023
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Values9 Jun 2023
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspective1 Mar 2023
- 2023The Inadequacy of Shapley Values for Explainability16 Feb 2023
- 2022Impossibility Theorems for Feature Attribution22 Dec 2022
- 2022On the Probability of Necessity and Sufficiency of Explaining Graph Neural Networks: A Lower Bound Optimization Approach14 Dec 2022
- 2022Local Interpretable Model Agnostic Shap Explanations for machine learning models10 Oct 2022
- 2022XInsight: eXplainable Data Analysis Through The Lens of Causality26 Jul 2022
- 2022Explaining Image Classifiers Using Contrastive Counterfactuals in Generative Latent Spaces10 Jun 2022
- 2022Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detection6 May 2022
- 2022Effective Explanations for Entity Resolution Models24 Mar 2022
- 2022Causal Explanations and XAI31 Jan 2022
- 2021When Stability meets Sufficiency: Informative Explanations that do not Overwhelm13 Sep 2021
- 2021Model Explanations via the Axiomatic Causal Lens8 Sep 2021
- 2021Desiderata for Representation Learning: A Causal Perspective8 Sep 2021
- 2021Rational Shapley Values18 Jun 2021
- 2022Impossibility Theorems for Feature Attributioncited by 78
- 2021Desiderata for Representation Learning: A Causal Perspectivecited by 76
- 2023Explaining Predictive Uncertainty with Information Theoretic Shapley Valuescited by 36
- 2022Causal Explanations and XAIcited by 30
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 30
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2023Towards Trustworthy Explanation: On Causal Rationalizationcited by 19
- 2021Rational Shapley Valuescited by 18
- 2022Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detectioncited by 18
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2022On the Probability of Necessity and Sufficiency of Explaining Graph Neural Networks: A Lower Bound Optimization Approachcited by 11
12 most cited of 45 All 45 (JSON)
- 2026Where MLLMs Fail and Why: Causal Task Decomposition for Capability Failure Diagnosis30 Sep 2026
- 2026Regional Explanations via Causal Sufficiency and Necessity16 Sep 2026
- 2026Explainable Control Framework (XCF) based on Fuzzy Model-Agnostic Explanation and LLM Agent-Supported Interface24 Jun 2026
- 2026Fairness under Graph Uncertainty: Achieving Interventional Fairness with Partially Known Causal Graphs over Clusters of Variables27 Feb 2026
- 2026A unified framework for evaluating the robustness of machine-learning interpretability for prospect risking16 Feb 2026
- 2025Attribution Explanations for Deep Neural Networks: A Theoretical Perspective11 Aug 2025
- 2025Unifying Post-hoc Explanations of Knowledge Graph Completions29 Jul 2025
- 2025Learning Probabilities of Causation with Mask-Augmented Data22 May 2025
- 2025Fixed Point Explainability18 May 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2024Sufficient and Necessary Explanations (and What Lies in Between)30 Sep 2024
- 2024Beyond Model Interpretability: Socio-Structural Explanations in Machine Learning5 Sep 2024
12 newest of 45 All 45 (JSON)