On Efficiently Explaining Graph-Based Classifiers
Not on the map. Why?
Abstract (arXiv)
Recent work has shown that not only decision trees (DTs) may not be interpretable but also proposed a polynomial-time algorithm for computing one PI-explanation of a DT. This paper shows that for a wide range of classifiers, globally referred to as decision graphs, and which include decision trees and binary decision diagrams, but also their multi-valued variants, there exist polynomial-time algorithms for computing one PI-explanation. In addition, the paper also proposes a polynomial-time algorithm for computing one contrastive explanation. These novel algorithms build on explanation graphs (XpG's). XpG's denote a graph representation that enables both theoretical and practically efficient computation of explanations for decision graphs. Furthermore, the paper proposes a practically efficient solution for the enumeration of explanations, and studies the complexity of deciding whether a given feature is included in some explanation. For the concrete case of decision trees, the paper shows that the set of all contrastive explanations can be enumerated in polynomial time. Finally, the experimental results validate the practical applicability of the algorithms proposed in the paper on a wide range of publicly available benchmarks.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Builds on 26 of its 96 references that are in the map. First posted on arXiv 2 Jun 2021.
Builds on
26 of 96 references.
References · 26
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2016The Mythos of Model Interpretabilitycited by 721
- 2014OpenML: networked science in machine learningcited by 526
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
- 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 345
- 2016Model-Agnostic Interpretability of Machine Learningcited by 219
- 2018Abduction-Based Explanations for Machine Learning Modelscited by 160
- 2017PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparisoncited by 140
- 2018A Symbolic Approach to Explaining Bayesian Network Classifierscited by 131
14 more
- 2019"How do I fool you?": Manipulating User Trust via Misleading Black Box Explanationscited by 111
- 2020On The Reasons Behind Decisionscited by 100
- 2020On the Tractability of SHAP Explanationscited by 92
- 2020Model Interpretability through the Lens of Computational Complexitycited by 75
- 2020Explaining Naive Bayes and Other Linear Classifiers with Polynomial Time and Delaycited by 57
- 2021On Explaining Random Forests with SATcited by 57
- 2020On Explaining Decision Treescited by 49
- 2018The Challenge of Crafting Intelligible Intelligencecited by 47
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021SAT-Based Rigorous Explanations for Decision Listscited by 40
- 2021Explanations for Monotonic Classifierscited by 39
- 2019Can I Trust the Explainer? Verifying Post-hoc Explanatory Methodscited by 38
- 2019On Validating, Repairing and Refining Heuristic ML Explanationscited by 32
- 2021Efficient Explanations With Relevant Setscited by 12
Built on by
Citing papers per year: 2021: 1; 2022: 9; 2023: 7; 2024: 4; 2025: 9; 2026: 7.
37 papers.
Sort:
- 2022Logic-Based Explainability in Machine Learningcited by 48
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 31
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2022On the Computation of Necessary and Sufficient Explanationscited by 23
- 2022Computing Abductive Explanations for Boosted Treescited by 23
- 2023Logic for Explainable AIcited by 23
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2024Distance-Restricted Explanations: Theoretical Underpinnings & Efficient Implementationcited by 21
- 2022On Computing Probabilistic Abductive Explanationscited by 18
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanationscited by 13
25 more
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasonscited by 12
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2025Explaining k-Nearest Neighbors: Abductive and Counterfactual Explanationscited by 10
- 2021On the Explanatory Power of Decision Treescited by 6
- 2022On Computing Relevant Features for Explaining NBCscited by 5
- 2023A Refutation of Shapley Values for Explainabilitycited by 4
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
- 2025Additive Models Explained: A Computational Complexity Approachcited by 3
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networkscited by 3
- 2022On Deciding Feature Membership in Explanations of SDD & Related Classifierscited by 2
- 2024Learning Model Agnostic Explanations via Constraint Programmingcited by 2
- 2026Unifying Formal Explanations: A Complexity-Theoretic Perspectivecited by 2
- 2023Finding Minimum-Cost Explanations for Predictions made by Tree Ensemblescited by 1
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithmscited by 1
- 2025Uncovering Bugs in Formal Explainers: A Case Study with PyXAIcited by 1
- 2025Extracting Robust Register Automata from Neural Networks over Data Sequencescited by 1
- 2026Provably Explaining Neural Additive Modelscited by 1
- 2022Rectifying Mono-Label Boolean Classifierscited by 0
- 2025Rigorous Feature Importance Scores based on Shapley Value and Banzhaf Indexcited by 0
- 2025Efficient & Correct Predictive Equivalence for Decision Treescited by 0
- 2026On the Hardness of Computing Counterfactual and Semifactual Explanations in XAIcited by 0
- 2026Rigorous Explanations for Tree Ensemblescited by 0
- 2026Towards Rigorous Explainability by Feature Attributioncited by 0
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Modelscited by 0
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Towards Rigorous Explainability by Feature Attribution17 Apr 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2026Unifying Formal Explanations: A Complexity-Theoretic Perspective20 Feb 2026
- 2026Provably Explaining Neural Additive Models19 Feb 2026
- 2026On the Hardness of Computing Counterfactual and Semifactual Explanations in XAI14 Jan 2026
- 2025Extracting Robust Register Automata from Neural Networks over Data Sequences24 Nov 2025
- 2025Uncovering Bugs in Formal Explainers: A Case Study with PyXAI5 Nov 2025
- 2025Additive Models Explained: A Computational Complexity Approach24 Oct 2025
- 2025Efficient & Correct Predictive Equivalence for Decision Trees22 Sep 2025
- 2025Rigorous Feature Importance Scores based on Shapley Value and Banzhaf Index16 Aug 2025
25 more
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanations10 Jun 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2025Explaining k-Nearest Neighbors: Abductive and Counterfactual Explanations10 Jan 2025
- 2024Learning Model Agnostic Explanations via Constraint Programming13 Nov 2024
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Local vs. Global Interpretability: A Computational Complexity Perspective5 Jun 2024
- 2024Distance-Restricted Explanations: Theoretical Underpinnings & Efficient Implementation14 May 2024
- 2023Refutation of Shapley Values for XAI -- Additional Evidence30 Sep 2023
- 2023A Refutation of Shapley Values for Explainability6 Sep 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023Disproving XAI Myths with Formal Methods -- Initial Results13 May 2023
- 2023Logic for Explainable AI9 May 2023
- 2023Finding Minimum-Cost Explanations for Predictions made by Tree Ensembles16 Mar 2023
- 2023The Inadequacy of Shapley Values for Explainability16 Feb 2023
- 2022On Computing Probabilistic Abductive Explanations12 Dec 2022
- 2022Logic-Based Explainability in Machine Learning24 Oct 2022
- 2022Computing Abductive Explanations for Boosted Trees16 Sep 2022
- 2022On Computing Relevant Features for Explaining NBCs11 Jul 2022
- 2022On Computing Probabilistic Explanations for Decision Trees30 Jun 2022
- 2022Rectifying Mono-Label Boolean Classifiers17 Jun 2022
- 2022On Tackling Explanation Redundancy in Decision Trees20 May 2022
- 2022On the Computation of Necessary and Sufficient Explanations20 Mar 2022
- 2022On Deciding Feature Membership in Explanations of SDD & Related Classifiers15 Feb 2022
- 2021On the Explanatory Power of Decision Trees11 Aug 2021
- 2022Logic-Based Explainability in Machine Learningcited by 48
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 31
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2022On the Computation of Necessary and Sufficient Explanationscited by 23
- 2022Computing Abductive Explanations for Boosted Treescited by 23
- 2023Logic for Explainable AIcited by 23
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2024Distance-Restricted Explanations: Theoretical Underpinnings & Efficient Implementationcited by 21
- 2022On Computing Probabilistic Abductive Explanationscited by 18
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanationscited by 13
12 most cited of 37 All 37 (JSON)
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Towards Rigorous Explainability by Feature Attribution17 Apr 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2026Unifying Formal Explanations: A Complexity-Theoretic Perspective20 Feb 2026
- 2026Provably Explaining Neural Additive Models19 Feb 2026
- 2026On the Hardness of Computing Counterfactual and Semifactual Explanations in XAI14 Jan 2026
- 2025Extracting Robust Register Automata from Neural Networks over Data Sequences24 Nov 2025
- 2025Uncovering Bugs in Formal Explainers: A Case Study with PyXAI5 Nov 2025
- 2025Additive Models Explained: A Computational Complexity Approach24 Oct 2025
- 2025Efficient & Correct Predictive Equivalence for Decision Trees22 Sep 2025
- 2025Rigorous Feature Importance Scores based on Shapley Value and Banzhaf Index16 Aug 2025
12 newest of 37 All 37 (JSON)