On The Reasons Behind Decisions
Not on the map. Why?
Abstract (arXiv)
Recent work has shown that some common machine learning classifiers can be compiled into Boolean circuits that have the same input-output behavior. We present a theory for unveiling the reasons behind the decisions made by Boolean classifiers and study some of its theoretical and practical implications. We define notions such as sufficient, necessary and complete reasons behind decisions, in addition to classifier and decision bias. We show how these notions can be used to evaluate counterfactual statements such as "a decision will stick even if ... because ... ." We present efficient algorithms for computing these notions, which are based on new advances on tractable Boolean circuits, and illustrate them using a case study.
Key facts. Cited by 100 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 14; 2023: 13; 2024: 13; 2025: 18; 2026: 20.
100 papers.
Sort:
By area:
- 2021Argumentative XAI: A Surveycited by 67
- 2021On Explaining Random Forests with SATcited by 57
- 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2022Logic-Based Explainability in Machine Learningcited by 48
- 2021Local Explanations via Necessity and Sufficiency: Unifying Theory and Practicecited by 45
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021SAT-Based Rigorous Explanations for Decision Listscited by 40
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2021On the Complexity of SHAP-Score-Based Explanations: Tractability via Knowledge Compilation and Non-Approximability Resultscited by 32
- 2021Trading Complexity for Sparsity in Random Forest Explanationscited by 32
38 more
- 2021Provably efficient, succinct, and precise explanationscited by 32
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 31
- 2021Interpretable Data-Based Explanations for Fairness Debuggingcited by 30
- 2022Causal Explanations and XAIcited by 30
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2021Foundations of Symbolic Languages for Model Interpretabilitycited by 26
- 2021Probabilistic Sufficient Explanationscited by 24
- 2022On the Computation of Necessary and Sufficient Explanationscited by 23
- 2022Eliminating The Impossible, Whatever Remains Must Be Truecited by 23
- 2022Computing Abductive Explanations for Boosted Treescited by 23
- 2023Logic for Explainable AIcited by 23
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2022On Computing Probabilistic Abductive Explanationscited by 18
- 2023SpArX: Sparse Argumentative Explanations for Neural Networks [Technical Report]cited by 18
- 2021On Quantifying Literals in Boolean Logic and Its Applications to Explainable AIcited by 16
- 2021A unified logical framework for explanations in classifier systemscited by 15
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanationscited by 13
- 2021Efficient Explanations With Relevant Setscited by 12
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasonscited by 12
- 2023On Formal Feature Attribution and Its Approximationcited by 11
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guaranteescited by 11
- 2021Efficient Explanations for Knowledge Compilation Languagescited by 10
- 2023Language Models as a Service: Overview of a New Paradigm and its Challengescited by 10
- 2025Explaining k-Nearest Neighbors: Abductive and Counterfactual Explanationscited by 10
- 2022Tractable Boolean and Arithmetic Circuitscited by 9
- 2022Provably Precise, Succinct and Efficient Explanations for Decision Treescited by 8
- 2023A New Class of Explanations for Classifiers with Non-Binary Featurescited by 8
- 2025SHAP Meets Tensor Networks: Provably Tractable Explanations with Parallelismcited by 8
- 2024Abductive explanations of classifiers under constraints: Complexity and propertiescited by 7
- 2021On the Explanatory Power of Decision Treescited by 6
- 2024Why do explanations fail? A typology and discussion on failures in XAIcited by 6
- 2022On Computing Relevant Features for Explaining NBCscited by 5
- 2023On the Complexity of Enumerating Prime Implicants from Decision-DNNF Circuitscited by 5
- 2025Self-Explaining Neural Networks for Business Process Monitoringcited by 5
- 2021Consistent Sufficient Explanations and Minimal Local Rules for explaining regression and classification modelscited by 4
- 2023A Uniform Language to Explain Decision Treescited by 4
- 2024Efficiently Computing Compact Formal Explanationscited by 4
50 most cited of 100 All 100 (JSON)
- 2026Beyond Trained Models: Compiling GNNs for a Sound Explainer Benchmark2 Oct 2026
- 2026Probabilistic Linear Explanations16 Sep 2026
- 2026No Judgment Without a Reason: Counterfactual Receipts for Versioned AI Evaluators21 Aug 2026
- 2026Beyond L2: Generalizing Abductive Latent Explanations to Diverse Prototype-Based Architectures17 Aug 2026
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Hoeffding Concept Bottleneck Models with Applications to Overhead Images22 May 2026
- 2026Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks22 May 2026
- 2026Binary Spiking Neural Networks as Causal Models29 Apr 2026
- 2026Med-CAM: Minimal Evidence for Explaining Medical Decision Making15 Apr 2026
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2026Scaling the Explanation of Multi-Class Bayesian Network Classifiers15 Mar 2026
38 more
- 2026Concisely Explaining the Doubt: Minimum-Size Abductive Explanations for Linear Models with a Reject Option14 Mar 2026
- 2026Formal Abductive Explanations for Navigating Mental Health Help-Seeking and Diversity in Tech Workplaces14 Mar 2026
- 2026Unifying Formal Explanations: A Complexity-Theoretic Perspective20 Feb 2026
- 2026Provably Explaining Neural Additive Models19 Feb 2026
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guarantees18 Feb 2026
- 2026Bridging AI and Clinical Reasoning: Abductive Explanations for Alignment on Critical Symptoms15 Feb 2026
- 2026Circuit Representations of Random Forests with Applications to XAI9 Feb 2026
- 2026Axiomatic Foundations of Counterfactual Explanations3 Feb 2026
- 2025Faster Verified Explanations for Neural Networks28 Nov 2025
- 2025Uncovering Bugs in Formal Explainers: A Case Study with PyXAI5 Nov 2025
- 2025SHAP Meets Tensor Networks: Provably Tractable Explanations with Parallelism24 Oct 2025
- 2025Additive Models Explained: A Computational Complexity Approach24 Oct 2025
- 2025Leveraging Association Rules for Better Predictions and Better Explanations21 Oct 2025
- 2025A Rectification-Based Approach for Distilling Boosted Trees into Decision Trees21 Oct 2025
- 2025Prime Implicant Explanations for Reaction Feasibility Prediction10 Oct 2025
- 2025On Explaining Proxy Discrimination and Unfairness in Individual Decisions Made by AI Systems30 Sep 2025
- 2025Efficient & Correct Predictive Equivalence for Decision Trees22 Sep 2025
- 2025Explaining Tournament Solutions with Minimal Supports11 Sep 2025
- 2025Robust Explanations Through Uncertainty Decomposition: A Path to Trustworthier AI17 Jul 2025
- 2025Why this and not that? A Logic-based Framework for Contrastive Explanations11 Jul 2025
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanations10 Jun 2025
- 2025Learning Small Decision Trees with Few Outliers: A Parameterized Perspective21 May 2025
- 2025Self-Explaining Neural Networks for Business Process Monitoring23 Mar 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2025On the Complexity of Global Necessary Reasons to Explain Classification12 Jan 2025
- 2025Explaining k-Nearest Neighbors: Abductive and Counterfactual Explanations10 Jan 2025
- 2024Learning Visually Grounded Domain Ontologies via Embodied Conversation and Explanation13 Dec 2024
- 2024Modeling and Discovering Direct Causes for Predictive Models3 Dec 2024
- 2024Learning Model Agnostic Explanations via Constraint Programming13 Nov 2024
- 2024Sufficient and Necessary Explanations (and What Lies in Between)30 Sep 2024
- 2024Abductive explanations of classifiers under constraints: Complexity and properties18 Sep 2024
- 2024Efficiently Computing Compact Formal Explanations4 Sep 2024
- 2024Abductive and Contrastive Explanations for Scoring Rules in Voting23 Aug 2024
- 2024Axiomatic Characterisations of Sample-based Explainers9 Aug 2024
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Local vs. Global Interpretability: A Computational Complexity Perspective5 Jun 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2024Why do explanations fail? A typology and discussion on failures in XAI22 May 2024
50 newest of 100 All 100 (JSON)
- 2021Argumentative XAI: A Surveycited by 67
- 2021On Explaining Random Forests with SATcited by 57
- 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2022Logic-Based Explainability in Machine Learningcited by 48
- 2021Local Explanations via Necessity and Sufficiency: Unifying Theory and Practicecited by 45
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021SAT-Based Rigorous Explanations for Decision Listscited by 40
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2021On the Complexity of SHAP-Score-Based Explanations: Tractability via Knowledge Compilation and Non-Approximability Resultscited by 32
- 2021Trading Complexity for Sparsity in Random Forest Explanationscited by 32
12 most cited of 98 All 98 (JSON)
- 2026Beyond Trained Models: Compiling GNNs for a Sound Explainer Benchmark2 Oct 2026
- 2026Probabilistic Linear Explanations16 Sep 2026
- 2026Beyond L2: Generalizing Abductive Latent Explanations to Diverse Prototype-Based Architectures17 Aug 2026
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Hoeffding Concept Bottleneck Models with Applications to Overhead Images22 May 2026
- 2026Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks22 May 2026
- 2026Binary Spiking Neural Networks as Causal Models29 Apr 2026
- 2026Med-CAM: Minimal Evidence for Explaining Medical Decision Making15 Apr 2026
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2026Scaling the Explanation of Multi-Class Bayesian Network Classifiers15 Mar 2026
- 2026Concisely Explaining the Doubt: Minimum-Size Abductive Explanations for Linear Models with a Reject Option14 Mar 2026
12 newest of 98 All 98 (JSON)