mlsanityData to 7 Oct 2026

(Local) Differential Privacy has NO Disparate Impact on Fairness

arXiv 2304.12845 ↗First posted 25 Apr 2023cs.LG cs.CRcited by 5

Not on the map. Why?

Abstract (arXiv)

In recent years, Local Differential Privacy (LDP), a robust privacy-preserving methodology, has gained widespread adoption in real-world applications. With LDP, users can perturb their data on their devices before sending it out for analysis. However, as the collection of multiple sensitive information becomes more prevalent across various industries, collecting a single sensitive attribute under LDP may not be sufficient. Correlated attributes in the data may still lead to inferences about the sensitive attribute. This paper empirically studies the impact of collecting multiple sensitive attributes under LDP on fairness. We propose a novel privacy budget allocation scheme that considers the varying domain size of sensitive attributes. This generally led to a better privacy-utility-fairness trade-off in our experiments than the state-of-art solution. Our results show that LDP leads to slightly improved fairness in learning problems without significantly affecting the performance of the models. We conduct extensive experiments evaluating three benchmark datasets using several group fairness metrics and seven state-of-the-art LDP protocols. Overall, this study challenges the common belief that differential privacy necessarily leads to worsened fairness in machine learning.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 25 Apr 2023.

Builds on

24 of 42 references.

References · 24

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  2. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  3. 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
  4. 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
  5. 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
  6. 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
  7. 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 262
  8. 2019Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learningcited by 117
  9. 2019Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combinationcited by 79
  10. 2020When Machine Learning Meets Privacy: A Survey and Outlookcited by 67
  11. 2016Discrete Distribution Estimation under Local Privacycited by 58
  12. 2019Fair Decision Making using Privacy-Protected Datacited by 58
12 more
  1. 2021Robin Hood and Matthew Effects: Differential Privacy Has Disparate Impact on Synthetic Datacited by 48
  2. 2022Differential Privacy and Fairness in Decisions and Learning Tasks: A Surveycited by 47
  3. 2019Collecting and Analyzing Multidimensional Data with Local Differential Privacycited by 46
  4. 2020Fair Learning with Private Demographic Datacited by 46
  5. 2015Local, Private, Efficient Protocols for Succinct Histogramscited by 35
  6. 2017Optimal Schemes for Discrete Distribution Estimation under Locally Differential Privacycited by 28
  7. 2020Machine learning fairness notions: Bridging the gap with real-world applicationscited by 19
  8. 2022Fairness Score and Process Standardization: Framework for Fairness Certification in Artificial Intelligence Systemscited by 14
  9. 2022Survey on Fairness Notions and Related Tensionscited by 9
  10. 2023An Empirical Analysis of Fairness Notions under Differential Privacycited by 9
  11. 2021Random Sampling Plus Fake Data: Multidimensional Frequency Estimates With Local Differential Privacycited by 6
  12. 2022Multi-Freq-LDPy: Multiple Frequency Estimation Under Local Differential Privacy in Pythoncited by 5

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 1; 2025: 2.

5 papers.