Efficient Explanations With Relevant Sets
Not on the map. Why?
Abstract (arXiv)
Recent work proposed δ-relevant inputs (or sets) as a probabilistic explanation for the predictions made by a classifier on a given input. δ-relevant sets are significant because they serve to relate (model-agnostic) Anchors with (model-accurate) PI- explanations, among other explanation approaches. Unfortunately, the computation of smallest size δ-relevant sets is complete for NPPP, rendering their computation largely infeasible in practice. This paper investigates solutions for tackling the practical limitations of δ-relevant sets. First, the paper alternatively considers the computation of subset-minimal sets. Second, the paper studies concrete families of classifiers, including decision trees among others. For these cases, the paper shows that the computation of subset-minimal δ-relevant sets is in NP, and can be solved with a polynomial number of calls to an NP oracle. The experimental evaluation compares the proposed approach with heuristic explainers for the concrete case of the classifiers studied in the paper, and confirms the advantage of the proposed solution over the state of the art.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 19 of its 45 references that are in the map. First posted on arXiv 1 Jun 2021.
Builds on
19 of 45 references.
References · 19
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2016The Mythos of Model Interpretabilitycited by 716
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 342
- 2018Abduction-Based Explanations for Machine Learning Modelscited by 159
- 2017PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparisoncited by 139
- 2018A Symbolic Approach to Explaining Bayesian Network Classifierscited by 130
- 2019"How do I fool you?": Manipulating User Trust via Misleading Black Box Explanationscited by 111
- 2020On The Reasons Behind Decisionscited by 99
7 more
- 2020Model Interpretability through the Lens of Computational Complexitycited by 75
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2020On Explaining Decision Treescited by 49
- 2018The Challenge of Crafting Intelligible Intelligencecited by 46
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2019Can I Trust the Explainer? Verifying Post-hoc Explanatory Methodscited by 37
- 2019What to Expect of Classifiers? Reasoning about Logistic Regression with Missing Featurescited by 12
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 1; 2024: 2; 2025: 2; 2026: 1.
12 papers.
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2021On Efficiently Explaining Graph-Based Classifierscited by 37
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2022On Computing Probabilistic Abductive Explanationscited by 18
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2025Explaining k-Nearest Neighbors: Abductive and Counterfactual Explanationscited by 10
- 2025Additive Models Explained: A Computational Complexity Approachcited by 3
- 2024Logic-Based Explainability: Past, Present & Futurecited by 2
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Modelscited by 0
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2025Additive Models Explained: A Computational Complexity Approach24 Oct 2025
- 2025Explaining k-Nearest Neighbors: Abductive and Counterfactual Explanations10 Jan 2025
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2022On Computing Probabilistic Abductive Explanations12 Dec 2022
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networks25 Oct 2022
- 2022Logic-Based Explainability in Machine Learning24 Oct 2022
- 2022On Computing Probabilistic Explanations for Decision Trees30 Jun 2022
- 2022On Tackling Explanation Redundancy in Decision Trees20 May 2022
- 2021On Efficiently Explaining Graph-Based Classifiers2 Jun 2021