Decision Making with Differential Privacy under a Fairness Lens
Not on the map. Why?
Abstract (arXiv)
Agencies, such as the U.S. Census Bureau, release data sets and statistics about groups of individuals that are used as input to a number of critical decision processes. To conform to privacy and confidentiality requirements, these agencies are often required to release privacy-preserving versions of the data. This paper studies the release of differentially private data sets and analyzes their impact on some critical resource allocation tasks under a fairness perspective. {The paper shows that, when the decisions take as input differentially private data}, the noise added to achieve privacy disproportionately impacts some groups over others. The paper analyzes the reasons for these disproportionate impacts and proposes guidelines to mitigate these effects. The proposed approaches are evaluated on critical decision problems that use differentially private census data.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 16 May 2021.
Builds on
12 of 29 references.
References · 12
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2013The Composition Theorem for Differential Privacycited by 290
- 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 262
- 2020Fairness in Machine Learningcited by 194
- 2018Differentially Private Fair Learningcited by 76
- 2019Fair Decision Making using Privacy-Protected Datacited by 58
- 2020Differentially Private and Fair Deep Learning: A Lagrangian Dual Approachcited by 53
- 2020LinkedIn's Audience Engagements API: A Privacy Preserving Data Analytics System at Scalecited by 26
- 2017Towards Practical Differential Privacy for SQL Queriescited by 19
- 2020Bias and Variance of Post-processing in Differential Privacycited by 14
- 2020Differential Privacy of Hierarchical Census Data: An Optimization Approachcited by 9
- 2018An Economic Analysis of Privacy Protection and Statistical Accuracy as Social Choicescited by 6
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 8; 2024: 4; 2025: 4; 2026: 3.
32 papers.
Sort:
- 2021Iterative Methods for Private Synthetic Data: Unifying Framework and New Methodscited by 58
- 2022Differential Privacy and Fairness in Decisions and Learning Tasks: A Surveycited by 47
- 2021Node-Level Differentially Private Graph Neural Networkscited by 43
- 2022Pruning has a disparate impact on model accuracycited by 43
- 2021DP-SGD vs PATE: Which Has Less Disparate Impact on Model Accuracy?cited by 32
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imagingcited by 17
- 2022Stochastic Differentially Private and Fair Learningcited by 16
- 2021A Fairness Analysis on Private Aggregation of Teacher Ensemblescited by 11
- 2022Post-processing of Differentially Private Data: A Fairness Perspectivecited by 9
- 2022SF-PATE: Scalable, Fair, and Private Aggregation of Teacher Ensemblescited by 8
- 2022Doubly Fair Dynamic Pricingcited by 8
20 more
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implicationscited by 7
- 2021DP-SGD vs PATE: Which Has Less Disparate Impact on GANs?cited by 6
- 2023Preserving privacy in domain transfer of medical AI models comes at no performance costs: The integral role of differential privacycited by 6
- 2023On the Fairness Impacts of Private Ensembles Modelscited by 4
- 2024Differential privacy enables fair and accurate AI-based analysis of speech disorders while protecting patient datacited by 4
- 2025Trustworthy AI Must Account for Interactionscited by 4
- 2025Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacycited by 4
- 2022Exploring the Unfairness of DP-SGD Across Settingscited by 3
- 2023FairDP: Certified Fairness with Differential Privacycited by 3
- 2023Privacy and Bias Analysis of Disclosure Avoidance Systemscited by 2
- 2023On The Fairness Impacts of Hardware Selection in Machine Learningcited by 2
- 2024Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processescited by 2
- 2024Privacy at a Price: Exploring its Dual Impact on AI Fairnesscited by 1
- 2021Partial sensitivity analysis in differential privacycited by 0
- 2023Price-Aware Deep Learning for Electricity Marketscited by 0
- 2024Differentially Private Data Release on Graphs: Inefficiencies and Unfairnesscited by 0
- 2025Optimal Allocation of Privacy Budget on Hierarchical Data Releasecited by 0
- 2026Does Privacy Always Harm Fairness? Data-Dependent Trade-offs via Chernoff Information Neural Estimationcited by 0
- 2026Auditing Fairness-Privacy Trade-offs: Subpopulation-Level Effects of Fairness-Enhancing Algorithmscited by 0
- 2026The Privacy-Hallucination Tradeoff in Differentially Private Language Modelscited by 0
- 2026The Privacy-Hallucination Tradeoff in Differentially Private Language Models31 Aug 2026
- 2026Auditing Fairness-Privacy Trade-offs: Subpopulation-Level Effects of Fairness-Enhancing Algorithms16 Jul 2026
- 2026Does Privacy Always Harm Fairness? Data-Dependent Trade-offs via Chernoff Information Neural Estimation20 Jan 2026
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications31 May 2025
- 2025Optimal Allocation of Privacy Budget on Hierarchical Data Release16 May 2025
- 2025Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacy9 May 2025
- 2025Trustworthy AI Must Account for Interactions9 Apr 2025
- 2024Differential privacy enables fair and accurate AI-based analysis of speech disorders while protecting patient data27 Sep 2024
- 2024Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processes16 Aug 2024
- 2024Differentially Private Data Release on Graphs: Inefficiencies and Unfairness8 Aug 2024
- 2024Privacy at a Price: Exploring its Dual Impact on AI Fairness15 Apr 2024
- 2023On The Fairness Impacts of Hardware Selection in Machine Learning6 Dec 2023
20 more
- 2023Price-Aware Deep Learning for Electricity Markets2 Aug 2023
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-off25 Jun 2023
- 2023Preserving privacy in domain transfer of medical AI models comes at no performance costs: The integral role of differential privacy10 Jun 2023
- 2023FairDP: Certified Fairness with Differential Privacy25 May 2023
- 2023On the Fairness Impacts of Private Ensembles Models19 May 2023
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imaging3 Feb 2023
- 2023Privacy and Bias Analysis of Disclosure Avoidance Systems28 Jan 2023
- 2022Stochastic Differentially Private and Fair Learning17 Oct 2022
- 2022Doubly Fair Dynamic Pricing23 Sep 2022
- 2022Pruning has a disparate impact on model accuracy26 May 2022
- 2022SF-PATE: Scalable, Fair, and Private Aggregation of Teacher Ensembles11 Apr 2022
- 2022Exploring the Unfairness of DP-SGD Across Settings24 Feb 2022
- 2022Differential Privacy and Fairness in Decisions and Learning Tasks: A Survey16 Feb 2022
- 2022Post-processing of Differentially Private Data: A Fairness Perspective24 Jan 2022
- 2021DP-SGD vs PATE: Which Has Less Disparate Impact on GANs?26 Nov 2021
- 2021Node-Level Differentially Private Graph Neural Networks23 Nov 2021
- 2021Partial sensitivity analysis in differential privacy22 Sep 2021
- 2021A Fairness Analysis on Private Aggregation of Teacher Ensembles17 Sep 2021
- 2021DP-SGD vs PATE: Which Has Less Disparate Impact on Model Accuracy?22 Jun 2021
- 2021Iterative Methods for Private Synthetic Data: Unifying Framework and New Methods14 Jun 2021
- 2021Iterative Methods for Private Synthetic Data: Unifying Framework and New Methodscited by 58
- 2022Differential Privacy and Fairness in Decisions and Learning Tasks: A Surveycited by 47
- 2021Node-Level Differentially Private Graph Neural Networkscited by 43
- 2022Pruning has a disparate impact on model accuracycited by 43
- 2021DP-SGD vs PATE: Which Has Less Disparate Impact on Model Accuracy?cited by 32
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imagingcited by 17
- 2022Stochastic Differentially Private and Fair Learningcited by 16
- 2021A Fairness Analysis on Private Aggregation of Teacher Ensemblescited by 11
- 2022Post-processing of Differentially Private Data: A Fairness Perspectivecited by 9
- 2022SF-PATE: Scalable, Fair, and Private Aggregation of Teacher Ensemblescited by 8
- 2022Doubly Fair Dynamic Pricingcited by 8
12 most cited of 32 All 32 (JSON)
- 2026The Privacy-Hallucination Tradeoff in Differentially Private Language Models31 Aug 2026
- 2026Auditing Fairness-Privacy Trade-offs: Subpopulation-Level Effects of Fairness-Enhancing Algorithms16 Jul 2026
- 2026Does Privacy Always Harm Fairness? Data-Dependent Trade-offs via Chernoff Information Neural Estimation20 Jan 2026
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications31 May 2025
- 2025Optimal Allocation of Privacy Budget on Hierarchical Data Release16 May 2025
- 2025Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacy9 May 2025
- 2025Trustworthy AI Must Account for Interactions9 Apr 2025
- 2024Differential privacy enables fair and accurate AI-based analysis of speech disorders while protecting patient data27 Sep 2024
- 2024Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processes16 Aug 2024
- 2024Differentially Private Data Release on Graphs: Inefficiencies and Unfairness8 Aug 2024
- 2024Privacy at a Price: Exploring its Dual Impact on AI Fairness15 Apr 2024
- 2023On The Fairness Impacts of Hardware Selection in Machine Learning6 Dec 2023
12 newest of 32 All 32 (JSON)