(Local) Differential Privacy has NO Disparate Impact on Fairness
Not on the map. Why?
Abstract (arXiv)
In recent years, Local Differential Privacy (LDP), a robust privacy-preserving methodology, has gained widespread adoption in real-world applications. With LDP, users can perturb their data on their devices before sending it out for analysis. However, as the collection of multiple sensitive information becomes more prevalent across various industries, collecting a single sensitive attribute under LDP may not be sufficient. Correlated attributes in the data may still lead to inferences about the sensitive attribute. This paper empirically studies the impact of collecting multiple sensitive attributes under LDP on fairness. We propose a novel privacy budget allocation scheme that considers the varying domain size of sensitive attributes. This generally led to a better privacy-utility-fairness trade-off in our experiments than the state-of-art solution. Our results show that LDP leads to slightly improved fairness in learning problems without significantly affecting the performance of the models. We conduct extensive experiments evaluating three benchmark datasets using several group fairness metrics and seven state-of-the-art LDP protocols. Overall, this study challenges the common belief that differential privacy necessarily leads to worsened fairness in machine learning.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 25 Apr 2023.
Builds on
24 of 42 references.
References · 24
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 262
- 2019Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learningcited by 117
- 2019Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combinationcited by 79
- 2020When Machine Learning Meets Privacy: A Survey and Outlookcited by 67
- 2016Discrete Distribution Estimation under Local Privacycited by 58
- 2019Fair Decision Making using Privacy-Protected Datacited by 58
12 more
- 2021Robin Hood and Matthew Effects: Differential Privacy Has Disparate Impact on Synthetic Datacited by 48
- 2022Differential Privacy and Fairness in Decisions and Learning Tasks: A Surveycited by 47
- 2019Collecting and Analyzing Multidimensional Data with Local Differential Privacycited by 46
- 2020Fair Learning with Private Demographic Datacited by 46
- 2015Local, Private, Efficient Protocols for Succinct Histogramscited by 35
- 2017Optimal Schemes for Discrete Distribution Estimation under Locally Differential Privacycited by 28
- 2020Machine learning fairness notions: Bridging the gap with real-world applicationscited by 19
- 2022Fairness Score and Process Standardization: Framework for Fairness Certification in Artificial Intelligence Systemscited by 14
- 2022Survey on Fairness Notions and Related Tensionscited by 9
- 2023An Empirical Analysis of Fairness Notions under Differential Privacycited by 9
- 2021Random Sampling Plus Fake Data: Multidimensional Frequency Estimates With Local Differential Privacycited by 6
- 2022Multi-Freq-LDPy: Multiple Frequency Estimation Under Local Differential Privacy in Pythoncited by 5
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 2.
5 papers.
- 2024A Systematic and Formal Study of the Impact of Local Differential Privacy on Fairness: Preliminary Resultscited by 6
- 2023On the Impact of Multi-dimensional Local Differential Privacy on Fairnesscited by 4
- 2023Automated discovery of trade-off between utility, privacy and fairness in machine learning modelscited by 2
- 2025Fair Play for Individuals, Foul Play for Groups? Auditing Anonymization's Impact on ML Fairnesscited by 0
- 2025Optimal Fairness under Local Differential Privacycited by 0
- 2025Optimal Fairness under Local Differential Privacy20 Nov 2025
- 2025Fair Play for Individuals, Foul Play for Groups? Auditing Anonymization's Impact on ML Fairness12 May 2025
- 2024A Systematic and Formal Study of the Impact of Local Differential Privacy on Fairness: Preliminary Results23 May 2024
- 2023On the Impact of Multi-dimensional Local Differential Privacy on Fairness7 Dec 2023
- 2023Automated discovery of trade-off between utility, privacy and fairness in machine learning models27 Nov 2023