Feature Responsiveness Scores: Model-Agnostic Explanations for Recourse
Not on the map. Why?
Abstract (arXiv)
Consumer protection rules require companies that deploy models to automate decisions in high-stakes settings to explain predictions to decision subjects. These rules are motivated, in part, by the belief that explanations can promote recourse by revealing information that decision subjects can use to contest or overturn their predictions. In practice, companies provide individuals with a list of principal reasons based on feature importance derived from methods like SHAP and LIME. In this work, we show how common practices can fail to provide recourse and propose to highlight features based on their responsiveness -- the probability that a decision subject can attain a target prediction through an arbitrary intervention on the feature. We develop efficient methods to compute responsiveness scores for any model and actionability constraints. We show that standard practices in lending can undermine decision subjects by highlighting unresponsive features and explaining predictions that are fixed.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 45 of its 91 references that are in the map. First posted on arXiv 29 Oct 2024.
Builds on
45 of 91 references.
References · 45
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2020Concept Bottleneck Modelscited by 1,032
- 2016Distribution-Free Predictive Inference For Regressioncited by 668
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 614
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
- 2018Actionable Recourse in Linear Classificationcited by 328
- 2015Strategic Classificationcited by 257
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2019Model-Agnostic Counterfactual Explanations for Consequential Decisionscited by 204
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 174
33 more
- 2019Predictive Multiplicity in Classificationcited by 166
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 159
- 2018Aequitas: A Bias and Fairness Audit Toolkitcited by 147
- 2020Debugging Tests for Model Explanationscited by 147
- 2020Algorithmic recourse under imperfect causal knowledge: a probabilistic approachcited by 140
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 125
- 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
- 2019The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasonscited by 115
- 2021Counterfactual Explanations Can Be Manipulatedcited by 113
- 2021Towards Robust and Reliable Algorithmic Recoursecited by 102
- 2021Do Feature Attribution Methods Correctly Attribute Features?cited by 98
- 2019Fairwashing: the risk of rationalizationcited by 81
- 2022Impossibility Theorems for Feature Attributioncited by 78
- 2020On the Fairness of Causal Algorithmic Recoursecited by 70
- 2019DLIME: A Deterministic Local Interpretable Model-Agnostic Explanations Approach for Computer-Aided Diagnosis Systemscited by 59
- 2021On the Adversarial Robustness of Causal Algorithmic Recoursecited by 56
- 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
- 2021S-LIME: Stabilized-LIME for Model Explanationcited by 52
- 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 51
- 2022Predictive Multiplicity in Probabilistic Classificationcited by 44
- 2016Auditing Black-box Models for Indirect Influencecited by 41
- 2022Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recoursecited by 40
- 2023Algorithmic Collective Action in Machine Learningcited by 31
- 2022Attribution-based Explanations that Provide Recourse Cannot be Robustcited by 20
- 2019bLIMEy: Surrogate Prediction Explanations Beyond LIMEcited by 17
- 2023Distributionally Robust Recourse Actioncited by 12
- 2019Disentangling Influence: Using Disentangled Representations to Audit Model Predictionscited by 11
- 2022Personalized Algorithmic Recourse with Preference Elicitationcited by 9
- 2024Exploiting Preference Elicitation in Interactive and User-centered Algorithmic Recourse: An Initial Explorationcited by 8
- 2023Manipulation Risks in Explainable AI: The Implications of the Disagreement Problemcited by 7
- 2023Confident Feature Rankingcited by 6
- 2023Participatory Personalization in Classificationcited by 5
- 2023Prediction without Preclusion: Recourse Verification with Reachable Setscited by 4
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025Reinforcement Learning for Durable Algorithmic Recoursecited by 3
- 2026Fair Recourse for All: Ensuring Individual and Group Fairness in Counterfactual Explanationscited by 2
- 2025Regretful Decisions under Label Noisecited by 1
- 2025Explanations are a Means to an End: Decision Theoretic Explanation Evaluationcited by 1
- 2026From Universal to Individualized Actionability: Revisiting Personalization in Algorithmic Recoursecited by 1
- 2026The Role of Causality in Algorithmic Recoursecited by 1
- 2025Responsiveness Verification: Will Predictions Change? How Much? How Often?cited by 0
- 2026Algorithmic Recourse Under Competitioncited by 0
- 2026Algorithmic Recourse Under Competition30 Sep 2026
- 2026The Role of Causality in Algorithmic Recourse30 Jul 2026
- 2026From Universal to Individualized Actionability: Revisiting Personalization in Algorithmic Recourse9 Apr 2026
- 2026Fair Recourse for All: Ensuring Individual and Group Fairness in Counterfactual Explanations28 Jan 2026
- 2025Reinforcement Learning for Durable Algorithmic Recourse26 Sep 2025
- 2025Responsiveness Verification: Will Predictions Change? How Much? How Often?2 Jul 2025
- 2025Explanations are a Means to an End: Decision Theoretic Explanation Evaluation28 Jun 2025
- 2025Regretful Decisions under Label Noise12 Apr 2025