Feature Necessity & Relevancy in ML Classifier Explanations
Not on the map. Why?
Abstract (arXiv)
Given a machine learning (ML) model and a prediction, explanations can be defined as sets of features which are sufficient for the prediction. In some applications, and besides asking for an explanation, it is also critical to understand whether sensitive features can occur in some explanation, or whether a non-interesting feature must occur in all explanations. This paper starts by relating such queries respectively with the problems of relevancy and necessity in logic-based abduction. The paper then proves membership and hardness results for several families of ML classifiers. Afterwards the paper proposes concrete algorithms for two classes of classifiers. The experimental results confirm the scalability of the proposed algorithms.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 23 of its 71 references that are in the map. First posted on arXiv 27 Oct 2022.
Builds on
23 of 71 references.
References · 23
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2018Abduction-Based Explanations for Machine Learning Modelscited by 159
- 2017PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparisoncited by 139
- 2018A Symbolic Approach to Explaining Bayesian Network Classifierscited by 130
- 2019Unconstrained Monotonic Neural Networkscited by 91
- 2020Model Interpretability through the Lens of Computational Complexitycited by 75
- 2017Deep Lattice Networks and Partial Monotonic Functionscited by 62
- 2021On Explaining Random Forests with SATcited by 57
- 2020Explaining Naive Bayes and Other Linear Classifiers with Polynomial Time and Delaycited by 56
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
11 more
- 2020Certified Monotonic Neural Networkscited by 51
- 2022On Tackling Explanation Redundancy in Decision Treescited by 44
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2021SAT-Based Rigorous Explanations for Decision Listscited by 40
- 2021Explanations for Monotonic Classifierscited by 39
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2020Counterexample-Guided Learning of Monotonic Neural Networkscited by 34
- 2021Provably efficient, succinct, and precise explanationscited by 32
- 2021Foundations of Symbolic Languages for Model Interpretabilitycited by 26
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanationscited by 26
- 2021On Quantifying Literals in Boolean Logic and Its Applications to Explainable AIcited by 16
Built on by
Citing papers per year: 2023: 10; 2024: 4; 2025: 6; 2026: 2.
22 papers.
Sort:
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 30
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2024Distance-Restricted Explanations: Theoretical Underpinnings & Efficient Implementationcited by 20
- 2023From Robustness to Explainability and Back Againcited by 14
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanationscited by 13
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2023On Formal Feature Attribution and Its Approximationcited by 11
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2023Anytime Approximate Formal Feature Attributioncited by 9
- 2023A Refutation of Shapley Values for Explainabilitycited by 4
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
10 more
- 2023A Uniform Language to Explain Decision Treescited by 4
- 2025Shapley Revisited: Tractable Responsibility Measures for Query Answerscited by 4
- 2025Additive Models Explained: A Computational Complexity Approachcited by 3
- 2024Logic-Based Explainability: Past, Present & Futurecited by 2
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithmscited by 1
- 2025Uncovering Bugs in Formal Explainers: A Case Study with PyXAIcited by 1
- 2023On Logic-Based Explainability with Partially Specified Inputscited by 0
- 2025Efficient & Correct Predictive Equivalence for Decision Treescited by 0
- 2026Rigorous Explanations for Tree Ensemblescited by 0
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Modelscited by 0
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2025Uncovering Bugs in Formal Explainers: A Case Study with PyXAI5 Nov 2025
- 2025Additive Models Explained: A Computational Complexity Approach24 Oct 2025
- 2025Efficient & Correct Predictive Equivalence for Decision Trees22 Sep 2025
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanations10 Jun 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Shapley Revisited: Tractable Responsibility Measures for Query Answers28 Mar 2025
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Local vs. Global Interpretability: A Computational Complexity Perspective5 Jun 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2024Distance-Restricted Explanations: Theoretical Underpinnings & Efficient Implementation14 May 2024
10 more
- 2023Anytime Approximate Formal Feature Attribution12 Dec 2023
- 2023A Uniform Language to Explain Decision Trees18 Oct 2023
- 2023Refutation of Shapley Values for XAI -- Additional Evidence30 Sep 2023
- 2023A Refutation of Shapley Values for Explainability6 Sep 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023On Formal Feature Attribution and Its Approximation7 Jul 2023
- 2023On Logic-Based Explainability with Partially Specified Inputs27 Jun 2023
- 2023From Robustness to Explainability and Back Again5 Jun 2023
- 2023Disproving XAI Myths with Formal Methods -- Initial Results13 May 2023
- 2023The Inadequacy of Shapley Values for Explainability16 Feb 2023
- 2023The Inadequacy of Shapley Values for Explainabilitycited by 30
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2024Distance-Restricted Explanations: Theoretical Underpinnings & Efficient Implementationcited by 20
- 2023From Robustness to Explainability and Back Againcited by 14
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanationscited by 13
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2023On Formal Feature Attribution and Its Approximationcited by 11
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2023Anytime Approximate Formal Feature Attributioncited by 9
- 2023A Refutation of Shapley Values for Explainabilitycited by 4
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
12 most cited of 22 All 22 (JSON)
- 2026ExplAIner: A Declarative Query Language for Explaining Classification Models7 Jul 2026
- 2026Rigorous Explanations for Tree Ensembles31 Mar 2026
- 2025Uncovering Bugs in Formal Explainers: A Case Study with PyXAI5 Nov 2025
- 2025Additive Models Explained: A Computational Complexity Approach24 Oct 2025
- 2025Efficient & Correct Predictive Equivalence for Decision Trees22 Sep 2025
- 2025Explaining, Fast and Slow: Abstraction and Refinement of Provable Explanations10 Jun 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Shapley Revisited: Tractable Responsibility Measures for Query Answers28 Mar 2025
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Local vs. Global Interpretability: A Computational Complexity Perspective5 Jun 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2024Distance-Restricted Explanations: Theoretical Underpinnings & Efficient Implementation14 May 2024
12 newest of 22 All 22 (JSON)