Explanation Design in Strategic Learning: Sufficient Explanations that Induce Non-harmful Responses
Not on the map. Why?
Abstract (arXiv)
We study explanation design in algorithmic decision making with strategic agents, individuals who may modify their inputs in response to explanations of a decision maker's (DM's) predictive model. As the demand for transparent algorithmic systems continues to grow, most prior work assumes full model disclosure as the default solution. In practice, however, DMs such as financial institutions typically disclose only partial model information via explanations. Such partial disclosure can lead agents to misinterpret the model and take actions that unknowingly harm their utility. A key open question is how DMs can communicate explanations in a way that avoids harming strategic agents, while still supporting their own decision-making goals, e.g., minimising predictive error. In this work, we analyse well-known explanation methods, and establish a necessary condition to prevent explanations from misleading agents into self-harming actions. Moreover, with a conditional homogeneity assumption, we prove that action recommendation-based explanations (ARexes) are sufficient for non-harmful responses, mirroring the revelation principle in information design. To demonstrate how ARexes can be operationalised in practice, we propose a simple learning procedure that jointly optimises the predictive model and explanation policy. Experiments on synthetic and real-world tasks show that ARexes allow the DM to optimise their model's predictive performance while preserving agents' utility, offering a more refined strategy for safe and effective partial model disclosure.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 64 references that are in the map. First posted on arXiv 6 Feb 2025.
Builds on
37 of 64 references.
References · 37
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2019Modeling Tabular data using Conditional GANcited by 695
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
- 2020Performative Predictioncited by 318
- 2015Strategic Classificationcited by 256
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2017Strategic Classification from Revealed Preferencescited by 126
- 2018The Social Cost of Strategic Classificationcited by 105
- 2019Strategic Classification is Causal Modeling in Disguisecited by 92
- 2018How Do Classifiers Induce Agents To Invest Effort Strategically?cited by 82
25 more
- 2018The Disparate Effects of Strategic Manipulationcited by 75
- 2021Strategic Classification in the Darkcited by 66
- 2020Causal Strategic Linear Regressioncited by 65
- 2021Strategic Classification Made Practicalcited by 58
- 2020PAC-Learning for Strategic Classificationcited by 50
- 2020The Strategic Perceptroncited by 48
- 2021Information Discrepancy in Strategic Learningcited by 48
- 2021Alternative Microfoundations for Strategic Classificationcited by 47
- 2020Decisions, Counterfactual Explanations and Strategic Behaviorcited by 44
- 2021Stateful Strategic Regressioncited by 32
- 2021Strategic Instrumental Variable Regression: Recovering Causal Relationships From Strategic Responsescited by 32
- 2021RKHS-SHAP: Shapley Values for Kernel Methodscited by 30
- 2023Calibrated Stackelberg Games: Learning Optimal Commitments Against Calibrated Agentscited by 25
- 2023Strategic Classification under Unknown Personalized Manipulationcited by 23
- 2020From Predictions to Decisions: Using Lookahead Regularizationcited by 19
- 2023Explaining the Uncertain: Stochastic Shapley Values for Gaussian Process Modelscited by 19
- 2023Fundamental Bounds on Online Strategic Classificationcited by 17
- 2021Bayesian Persuasion for Algorithmic Recoursecited by 14
- 2022On the Relationship Between Explanation and Prediction: A Causal Viewcited by 14
- 2024Bayesian Strategic Classificationcited by 12
- 2024Non-linear Welfare-Aware Strategic Learningcited by 12
- 2023Causal Strategic Learning with Competitive Selectioncited by 9
- 2023Sequential Strategic Screeningcited by 8
- 2024Learning under Imitative Strategic Behavior with Unforeseeable Outcomescited by 8
- 2024DAVED: Data Acquisition via Experimental Design for Data Marketscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.