Privacy-Preserving Algorithmic Recourse
Not on the map. Why?
Abstract (arXiv)
When individuals are subject to adverse outcomes from machine learning models, providing a recourse path to help achieve a positive outcome is desirable. Recent work has shown that counterfactual explanations - which can be used as a means of single-step recourse - are vulnerable to privacy issues, putting an individuals' privacy at risk. Providing a sequential multi-step path for recourse can amplify this risk. Furthermore, simply adding noise to recourse paths found from existing methods can impact the realism and actionability of the path for an end-user. In this work, we address privacy issues when generating realistic recourse paths based on instance-based counterfactual explanations, and provide PrivRecourse: an end-to-end privacy preserving pipeline that can provide realistic recourse paths. PrivRecourse uses differentially private (DP) clustering to represent non-overlapping subsets of the private dataset. These DP cluster centers are then used to generate recourse paths by forming a graph with cluster centers as the nodes, so that we can generate realistic - feasible and actionable - recourse paths. We empirically evaluate our approach on finance datasets and compare it to simply adding noise to data instances, and to using DP synthetic data, to generate the graph. We observe that PrivRecourse can provide paths that are private and realistic.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 20 of its 46 references that are in the map. First posted on arXiv 23 Nov 2023.
Builds on
20 of 46 references.
References · 20
- 2016Deep Learning with Differential Privacycited by 2,682
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
- 2018Scalable Private Learning with PATEcited by 266
- 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
- 2021Counterfactual Explanations Can Be Manipulatedcited by 113
- 2021CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithmscited by 85
- 2018Model Reconstruction from Model Explanationscited by 84
- 2021NICE: An Algorithm for Nearest Instance Counterfactual Explanationscited by 62
- 2019Diffprivlib: The IBM Differential Privacy Librarycited by 51
- 2021Exploiting Explanations for Model Inversion Attackscited by 48
8 more
- 2019Interpret Federated Learning with Shapley Valuescited by 33
- 2022On the Privacy Risks of Algorithmic Recoursecited by 32
- 2019Interpretable and Differentially Private Predictionscited by 28
- 2022The privacy issue of counterfactual explanations: explanation linkage attackscited by 20
- 2022Inferring Sensitive Attributes from Model Explanationscited by 15
- 2022XRand: Differentially Private Defense against Explanation-Guided Attackscited by 11
- 2023Balancing Privacy Protection and Interpretability in Federated Learningcited by 6
- 2023k-Means SubClustering: A Differentially Private Algorithm with Improved Clustering Qualitycited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 2.
5 papers.
- 2024Collective Counterfactual Explanations: Balancing Individual Goals and Collective Dynamicscited by 1
- 2024Knowledge Distillation-Based Model Extraction Attack using GAN-based Private Counterfactual Explanationscited by 1
- 2024Private Counterfactual Retrieval With Immutable Featurescited by 0
- 2025On the interplay of Explainability, Privacy and Predictive Performance with Explanation-assisted Model Extractioncited by 0
- 2025What If, But Privately: Private Counterfactual Retrievalcited by 0
- 2025What If, But Privately: Private Counterfactual Retrieval5 Aug 2025
- 2025On the interplay of Explainability, Privacy and Predictive Performance with Explanation-assisted Model Extraction13 May 2025
- 2024Private Counterfactual Retrieval With Immutable Features15 Nov 2024
- 2024Knowledge Distillation-Based Model Extraction Attack using GAN-based Private Counterfactual Explanations4 Apr 2024
- 2024Collective Counterfactual Explanations: Balancing Individual Goals and Collective Dynamics7 Feb 2024