mlsanityData to 14 Oct 2026

On the Trade-offs between Adversarial Robustness and Actionable Explanations

arXiv 2309.16452 ↗First posted 28 Sep 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

As machine learning models are increasingly being employed in various high-stakes settings, it becomes important to ensure that predictions of these models are not only adversarially robust, but also readily explainable to relevant stakeholders. However, it is unclear if these two notions can be simultaneously achieved or if there exist trade-offs between them. In this work, we make one of the first attempts at studying the impact of adversarially robust models on actionable explanations which provide end users with a means for recourse. We theoretically and empirically analyze the cost (ease of implementation) and validity (probability of obtaining a positive model prediction) of recourses output by state-of-the-art algorithms when the underlying models are adversarially robust vs. non-robust. More specifically, we derive theoretical bounds on the differences between the cost and the validity of the recourses generated by state-of-the-art algorithms for adversarially robust vs. non-robust linear and non-linear models. Our empirical results with multiple real-world datasets validate our theoretical results and show the impact of varying degrees of model robustness on the cost and validity of the resulting recourses. Our analyses demonstrate that adversarially robust models significantly increase the cost and reduce the validity of the resulting recourses, thus shedding light on the inherent trade-offs between adversarial robustness and actionable explanations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 28 Sep 2023.

Builds on

27 of 41 references.

References · 27

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  3. 2013Intriguing properties of neural networkscited by 5,155
  4. 2016Adversarial examples in the physical worldcited by 1,769
  5. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
  6. 2018Gradient Descent Provably Optimizes Over-parameterized Neural Networkscited by 659
  7. 2017Compressed Sensing using Generative Modelscited by 339
  8. 2018Actionable Recourse in Linear Classificationcited by 328
  9. 2018Adversarial Attacks and Defences: A Surveycited by 259
  10. 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
  11. 2019Model-Agnostic Counterfactual Explanations for Consequential Decisionscited by 204
  12. 2017Generating Natural Adversarial Examplescited by 183
15 more
  1. 2019Learning Model-Agnostic Counterfactual Explanations for Tabular Datacited by 146
  2. 2019Preserving Causal Constraints in Counterfactual Explanations for Machine Learning Classifierscited by 144
  3. 2020Algorithmic recourse under imperfect causal knowledge: a probabilistic approachcited by 140
  4. 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
  5. 2021Counterfactual Explanations Can Be Manipulatedcited by 113
  6. 2021Towards Robust and Reliable Algorithmic Recoursecited by 102
  7. 2021On the Adversarial Robustness of Causal Algorithmic Recoursecited by 56
  8. 2021Do Input Gradients Highlight Discriminative Features?cited by 52
  9. 2021Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysiscited by 52
  10. 2017Houdini: Fooling Deep Structured Prediction Modelscited by 50
  11. 2017Inverse Classification for Comparison-based Interpretability in Machine Learningcited by 50
  12. 2020The Intriguing Relation Between Counterfactual Explanations and Adversarial Examplescited by 44
  13. 2020Algorithmic Recourse in the Wild: Understanding the Impact of Data and Model Shiftscited by 36
  14. 2021Rethinking Influence Functions of Neural Networks in the Over-parameterized Regimecited by 26
  15. 2022On the Trade-Off between Actionable Explanations and the Right to be Forgottencited by 20

Built on by

Not cited yet.