From Robustness to Explainability and Back Again
Not on the map. Why?
Abstract (arXiv)
Formal explainability guarantees the rigor of computed explanations, and so it is paramount in domains where rigor is critical, including those deemed high-risk. Unfortunately, since its inception formal explainability has been hampered by poor scalability. At present, this limitation still holds true for some families of classifiers, the most significant being deep neural networks. This paper addresses the poor scalability of formal explainability and proposes novel efficient algorithms for computing formal explanations. The novel algorithm computes explanations by answering instead a number of robustness queries, and such that the number of such queries is at most linear on the number of features. Consequently, the proposed algorithm establishes a direct relationship between the practical complexity of formal explainability and that of robustness. To achieve the proposed goals, the paper generalizes the definition of formal explanations, thereby allowing the use of robustness tools that are based on different distance norms, and also by reasoning in terms of some target degree of robustness. Preliminary experiments validate the practical efficiency of the proposed approach.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 47 of its 77 references that are in the map. First posted on arXiv 5 Jun 2023.
Builds on
47 of 77 references.
References · 47
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2016Safety Verification of Deep Neural Networkscited by 262
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
35 more
- 2019Algorithms for Verifying Deep Neural Networkscited by 221
- 2019Are Labels Required for Improving Adversarial Robustness?cited by 162
- 2018Abduction-Based Explanations for Machine Learning Modelscited by 159
- 2019Adversarial Robustness through Local Linearizationcited by 146
- 2019Branch and Bound for Piecewise Linear Neural Network Verificationcited by 138
- 2018Constructing Unrestricted Adversarial Examples with Generative Modelscited by 135
- 2018A Symbolic Approach to Explaining Bayesian Network Classifierscited by 130
- 2020Certified Robustness to Label-Flipping Attacks via Randomized Smoothingcited by 103
- 2018Reachability Analysis of Deep Neural Networks with Provable Guaranteescited by 93
- 2022Complete Verification via Multi-Neuron Relaxation Guided Branch-and-Boundcited by 92
- 2019Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagationcited by 87
- 2021PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximationscited by 77
- 2019Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablationcited by 59
- 2019Robustness of 3D Deep Learning in an Adversarial Settingcited by 55
- 2018A Statistical Approach to Assessing Neural Network Robustnesscited by 54
- 2017Feature-Guided Black-Box Safety Testing of Deep Neural Networkscited by 48
- 2021Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Themcited by 46
- 2019Neural Network Branching for Neural Network Verificationcited by 45
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2016Towards Verified Artificial Intelligencecited by 36
- 2020Adversarial Robustness for Codecited by 36
- 2020Lagrangian Decomposition for Neural Network Verificationcited by 35
- 2022On Computing Probabilistic Explanations for Decision Treescited by 35
- 2018A Game-Based Approximate Verification of Deep Neural Networks with Provable Guaranteescited by 33
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2022Eliminating The Impossible, Whatever Remains Must Be Truecited by 23
- 2022Feature Necessity & Relevancy in ML Classifier Explanationscited by 22
- 2020Robustness Certification of Generative Modelscited by 19
- 2021A unified logical framework for explanations in classifier systemscited by 15
- 2019Robustness Guarantees for Deep Neural Networks on Videoscited by 14
- 2020Efficient Certification of Spatial Robustnesscited by 11
- 2020Provably Robust Adversarial Examplescited by 8
- 2021Provable Guarantees on the Robustness of Decision Rules to Causal Interventionscited by 6
Built on by
Citing papers per year: 2023: 5; 2024: 6; 2025: 1; 2026: 2.
14 papers.
Sort:
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2023Explainability is NOT a Gamecited by 23
- 2023On Formal Feature Attribution and Its Approximationcited by 11
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2024Formal Explanations for Neuro-Symbolic AIcited by 5
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networkscited by 3
- 2024Logic-Based Explainability: Past, Present & Futurecited by 2
- 2023The Pros and Cons of Adversarial Robustnesscited by 1
- 2024The Distributional Uncertainty of the SHAP score in Explainable Machine Learningcited by 1
- 2024Efficient Contrastive Explanations on Demandcited by 1
- 2026Formal Abductive Explanations for Navigating Mental Health Help-Seeking and Diversity in Tech Workplaces14 Mar 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2025Rethinking Robustness: A New Approach to Evaluating Feature Attribution Methods7 Dec 2025
- 2024Efficient Contrastive Explanations on Demand24 Dec 2024
- 2024Formal Explanations for Neuro-Symbolic AI18 Oct 2024
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networks25 Jan 2024
- 2024The Distributional Uncertainty of the SHAP score in Explainable Machine Learning23 Jan 2024
- 2023The Pros and Cons of Adversarial Robustness18 Dec 2023
- 2023Refutation of Shapley Values for XAI -- Additional Evidence30 Sep 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
2 more
- 2023On Formal Feature Attribution and Its Approximation7 Jul 2023
- 2023Explainability is NOT a Game27 Jun 2023
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2023Explainability is NOT a Gamecited by 23
- 2023On Formal Feature Attribution and Its Approximationcited by 11
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretationcited by 11
- 2024Formal Explanations for Neuro-Symbolic AIcited by 5
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networkscited by 3
- 2024Logic-Based Explainability: Past, Present & Futurecited by 2
- 2023The Pros and Cons of Adversarial Robustnesscited by 1
- 2024The Distributional Uncertainty of the SHAP score in Explainable Machine Learningcited by 1
- 2024Efficient Contrastive Explanations on Demandcited by 1
12 most cited of 14 All 14 (JSON)
- 2026Formal Abductive Explanations for Navigating Mental Health Help-Seeking and Diversity in Tech Workplaces14 Mar 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2025Rethinking Robustness: A New Approach to Evaluating Feature Attribution Methods7 Dec 2025
- 2024Efficient Contrastive Explanations on Demand24 Dec 2024
- 2024Formal Explanations for Neuro-Symbolic AI18 Oct 2024
- 2024Hard to Explain: On the Computational Hardness of In-Distribution Model Interpretation7 Aug 2024
- 2024Logic-Based Explainability: Past, Present & Future4 Jun 2024
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networks25 Jan 2024
- 2024The Distributional Uncertainty of the SHAP score in Explainable Machine Learning23 Jan 2024
- 2023The Pros and Cons of Adversarial Robustness18 Dec 2023
- 2023Refutation of Shapley Values for XAI -- Additional Evidence30 Sep 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
12 newest of 14 All 14 (JSON)