On Explaining Decision Trees
Not on the map. Why?
Abstract (arXiv)
Decision trees (DTs) epitomize what have become to be known as interpretable machine learning (ML) models. This is informally motivated by paths in DTs being often much smaller than the total number of features. This paper shows that in some settings DTs can hardly be deemed interpretable, with paths in a DT being arbitrarily larger than a PI-explanation, i.e. a subset-minimal set of feature values that entails the prediction. As a result, the paper proposes a novel model for computing PI-explanations of DTs, which enables computing one PI-explanation in polynomial time. Moreover, it is shown that enumeration of PI-explanations can be reduced to the enumeration of minimal hitting sets. Experimental results were obtained on a wide range of publicly available datasets with well-known DT-learning tools, and confirm that in most cases DTs have paths that are proper supersets of PI-explanations.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 15; 2023: 4; 2024: 4; 2025: 9; 2026: 6.
49 papers.
Sort:
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021SAT-Based Rigorous Explanations for Decision Listscited by 40
- 2021Explanations for Monotonic Classifierscited by 39
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2021Trading Complexity for Sparsity in Random Forest Explanationscited by 32
- 2021Foundations of Symbolic Languages for Model Interpretabilitycited by 26
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanationscited by 26
37 more
- 2021Probabilistic Sufficient Explanationscited by 24
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2022Computing Abductive Explanations for Boosted Treescited by 23
- 2023Logic for Explainable AIcited by 23
- 2022On Computing Probabilistic Abductive Explanationscited by 18
- 2021Efficient Explanations With Relevant Setscited by 12
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasonscited by 11
- 2021Model Learning with Personalized Interpretability Estimation (ML-PIE)cited by 9
- 2022Interpretability Guarantees with Merlin-Arthur Classifierscited by 8
- 2021On the Explanatory Power of Decision Treescited by 6
- 2025A Mathematical Philosophy of Explanations in Mechanistic Interpretability -- The Strange Science Part I.icited by 6
- 2022Efficient Learning of Interpretable Classification Rulescited by 5
- 2022On Computing Relevant Features for Explaining NBCscited by 5
- 2025Self-Explaining Neural Networks for Business Process Monitoringcited by 5
- 2021From global to local MDI variable importances for random forests and when they are Shapley valuescited by 4
- 2023A Uniform Language to Explain Decision Treescited by 4
- 2022Explaining a Deep Reinforcement Learning Docking Agent Using Linear Model Trees with User Adapted Visualizationcited by 3
- 2024Logic-based Explanations for Linear Support Vector Classifiers with Reject Optioncited by 3
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networkscited by 3
- 2024Logic-Based Explainability: Past, Present & Futurecited by 2
- 2026Generalizing Logic-based Explanations for Machine Learning Classifiers via Optimizationcited by 2
- 2022A Nested Genetic Algorithm for Explaining Classification Data Sets with Decision Rulescited by 1
- 2024Efficient Contrastive Explanations on Demandcited by 1
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithmscited by 1
- 2025Extracting Robust Register Automata from Neural Networks over Data Sequencescited by 1
- 2022Classifying Human Activities using Machine Learning and Deep Learning Techniquescited by 0
- 2022A Model-Agnostic SAT-based Approach for Symbolic Explanation Enumerationcited by 0
- 2024Conceptual Learning via Embedding Approximations for Reinforcing Interpretability and Transparencycited by 0
- 2025Fixed Point Explainabilitycited by 0
- 2025Interpretable reinforcement learning for heat pump control through asymmetric differentiable decision treescited by 0
- 2025Next-Depth Lookahead Treecited by 0
- 2025Efficient & Correct Predictive Equivalence for Decision Treescited by 0
- 2026Formally Explaining Decision Tree Models with Answer Set Programmingcited by 0
- 2026On the Hardness of Computing Counterfactual and Semifactual Explanations in XAIcited by 0
- 2026Rigorous Explanations for Tree Ensemblescited by 0
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Modelscited by 0
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2026Generalizing Logic-based Explanations for Machine Learning Classifiers via Optimization2 Mar 2026
- 2026On the Hardness of Computing Counterfactual and Semifactual Explanations in XAI14 Jan 2026
- 2026Formally Explaining Decision Tree Models with Answer Set Programming7 Jan 2026
- 2025Extracting Robust Register Automata from Neural Networks over Data Sequences24 Nov 2025
- 2025Efficient & Correct Predictive Equivalence for Decision Trees22 Sep 2025
- 2025Next-Depth Lookahead Tree18 Sep 2025
- 2025Interpretable reinforcement learning for heat pump control through asymmetric differentiable decision trees2 Jun 2025
- 2025Fixed Point Explainability18 May 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
37 more
- 2025A Mathematical Philosophy of Explanations in Mechanistic Interpretability -- The Strange Science Part I.i1 May 2025
- 2025Self-Explaining Neural Networks for Business Process Monitoring23 Mar 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2024Efficient Contrastive Explanations on Demand24 Dec 2024
- 2024Conceptual Learning via Embedding Approximations for Reinforcing Interpretability and Transparency13 Jun 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2024Logic-based Explanations for Linear Support Vector Classifiers with Reject Option24 Mar 2024
- 2023A Uniform Language to Explain Decision Trees18 Oct 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023Disproving XAI Myths with Formal Methods -- Initial Results13 May 2023
- 2023Logic for Explainable AI9 May 2023
- 2022On Computing Probabilistic Abductive Explanations12 Dec 2022
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networks25 Oct 2022
- 2022Logic-Based Explainability in Machine Learning24 Oct 2022
- 2022Computing Abductive Explanations for Boosted Trees16 Sep 2022
- 2022A Nested Genetic Algorithm for Explaining Classification Data Sets with Decision Rules23 Aug 2022
- 2022Leveraging Explanations in Interactive Machine Learning: An Overview29 Jul 2022
- 2022On Computing Relevant Features for Explaining NBCs11 Jul 2022
- 2022On Computing Probabilistic Explanations for Decision Trees30 Jun 2022
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanations23 Jun 2022
- 2022A Model-Agnostic SAT-based Approach for Symbolic Explanation Enumeration23 Jun 2022
- 2022Interpretability Guarantees with Merlin-Arthur Classifiers1 Jun 2022
- 2022On Tackling Explanation Redundancy in Decision Trees20 May 2022
- 2022Classifying Human Activities using Machine Learning and Deep Learning Techniques19 May 2022
- 2022Efficient Learning of Interpretable Classification Rules14 May 2022
- 2022Explaining a Deep Reinforcement Learning Docking Agent Using Linear Model Trees with User Adapted Visualization1 Mar 2022
- 2021From global to local MDI variable importances for random forests and when they are Shapley values3 Nov 2021
- 2021Foundations of Symbolic Languages for Model Interpretability5 Oct 2021
- 2021Trading Complexity for Sparsity in Random Forest Explanations11 Aug 2021
- 2021On the Explanatory Power of Decision Trees11 Aug 2021
- 2021On Efficiently Explaining Graph-Based Classifiers2 Jun 2021
- 2021Efficient Explanations With Relevant Sets1 Jun 2021
- 2021Explanations for Monotonic Classifiers1 Jun 2021
- 2021Probabilistic Sufficient Explanations21 May 2021
- 2021SAT-Based Rigorous Explanations for Decision Lists14 May 2021
- 2021On the Computational Intelligibility of Boolean Classifiers13 Apr 2021
- 2021Model Learning with Personalized Interpretability Estimation (ML-PIE)13 Apr 2021
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021SAT-Based Rigorous Explanations for Decision Listscited by 40
- 2021Explanations for Monotonic Classifierscited by 39
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2021Trading Complexity for Sparsity in Random Forest Explanationscited by 32
- 2021Foundations of Symbolic Languages for Model Interpretabilitycited by 26
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanationscited by 26
12 most cited of 49 All 49 (JSON)
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2026Generalizing Logic-based Explanations for Machine Learning Classifiers via Optimization2 Mar 2026
- 2026On the Hardness of Computing Counterfactual and Semifactual Explanations in XAI14 Jan 2026
- 2026Formally Explaining Decision Tree Models with Answer Set Programming7 Jan 2026
- 2025Extracting Robust Register Automata from Neural Networks over Data Sequences24 Nov 2025
- 2025Efficient & Correct Predictive Equivalence for Decision Trees22 Sep 2025
- 2025Next-Depth Lookahead Tree18 Sep 2025
- 2025Interpretable reinforcement learning for heat pump control through asymmetric differentiable decision trees2 Jun 2025
- 2025Fixed Point Explainability18 May 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
12 newest of 49 All 49 (JSON)