Optimal Fairness under Local Differential Privacy
Not on the map. Why?
Abstract (arXiv)
We investigate how to optimally design local differential privacy (LDP) mechanisms that reduce data unfairness and thereby improve fairness in downstream classification. We first derive a closed-form optimal mechanism for binary sensitive attributes and then develop a tractable optimization framework that yields the corresponding optimal mechanism for multi-valued attributes. As a theoretical contribution, we establish that for discrimination-accuracy optimal classifiers, reducing data unfairness necessarily leads to lower classification unfairness, thus providing a direct link between privacy-aware pre-processing and classification fairness. Empirically, we demonstrate that our approach consistently outperforms existing LDP mechanisms in reducing data unfairness across diverse datasets and fairness metrics, while maintaining accuracy close to that of non-private models. Moreover, compared with leading pre-processing and post-processing fairness methods, our mechanism achieves a more favorable accuracy-fairness trade-off while simultaneously preserving the privacy of sensitive attributes. Taken together, these results highlight LDP as a principled and effective pre-processing fairness intervention technique.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 72 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
42 of 72 references.
References · 42
- 2016Deep Learning with Differential Privacycited by 2,728
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2017Counterfactual Fairnesscited by 804
- 2014Certifying and removing disparate impactcited by 715
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2018A Reductions Approach to Fair Classificationcited by 587
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 586
- 2017On Fairness and Calibrationcited by 406
- 2017Algorithmic decision making and the cost of fairnesscited by 403
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
30 more
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 272
- 2017Avoiding Discrimination through Causal Reasoningcited by 194
- 2017Collecting Telemetry Data Privatelycited by 149
- 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
- 2019Wasserstein Fair Classificationcited by 131
- 2021Bias in Machine Learning Software: Why? How? What to do?cited by 93
- 2020On the Privacy Risks of Algorithmic Fairnesscited by 82
- 2020Neither Private Nor Fair: Impact of Data Imbalance on Utility and Fairness in Differential Privacycited by 61
- 2019Leveraging Labeled and Unlabeled Data for Consistent Fair Binary Classificationcited by 60
- 2019Fair Decision Making using Privacy-Protected Datacited by 58
- 2019Repairing without Retraining: Avoiding Disparate Impact with Counterfactual Distributionscited by 48
- 2021Robin Hood and Matthew Effects: Differential Privacy Has Disparate Impact on Synthetic Datacited by 48
- 2020Fair Learning with Private Demographic Datacited by 46
- 2019Toward a better trade-off between performance and fairness with kernel-based distribution matchingcited by 36
- 2017Optimal Schemes for Discrete Distribution Estimation under Locally Differential Privacycited by 29
- 2021A Stochastic Optimization Framework for Fair Risk Minimizationcited by 26
- 2021FairMask: Better Fairness via Model-based Rebalancing of Protected Attributescited by 19
- 2023Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventionscited by 19
- 2022Towards Understanding Fairness and its Composition in Ensemble Machine Learningcited by 17
- 2022Software Fairness: An Analysis and Surveycited by 8
- 2019Optimized Score Transformation for Consistent Fair Classificationcited by 7
- 2022When Fairness Meets Privacy: Fair Classification with Semi-Private Sensitive Attributescited by 6
- 2024A Systematic and Formal Study of the Impact of Local Differential Privacy on Fairness: Preliminary Resultscited by 6
- 2021FairBalance: How to Achieve Equalized Odds With Data Pre-processingcited by 5
- 2023(Local) Differential Privacy has NO Disparate Impact on Fairnesscited by 5
- 2023On the Impact of Multi-dimensional Local Differential Privacy on Fairnesscited by 4
- 2020Fair Densities via Boosting the Sufficient Statistics of Exponential Familiescited by 2
- 2024Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processescited by 2
- 2024Privacy for Fairness: Information Obfuscation for Fair Representation Learning with Local Differential Privacycited by 1
Built on by
Not cited yet.