Risk-Equalized Differentially Private Synthetic Data: Protecting Outliers by Controlling Record-Level Influence
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
When synthetic data is released, some individuals are harder to protect than others. A patient with a rare disease combination or a transaction with unusual characteristics stands out from the crowd. Differential privacy provides worst-case guarantees, but empirical attacks -- particularly membership inference -- succeed far more often against such outliers, especially under moderate privacy budgets and with auxiliary information. This paper introduces risk-equalized DP synthesis, a framework that prioritizes protection for high-risk records by reducing their influence on the learned generator. The mechanism operates in two stages: first, a small privacy budget estimates each record's "outlierness"; second, a DP learning procedure weights each record inversely to its risk score. Under Gaussian mechanisms, a record's privacy loss is proportional to its influence on the output -- so deliberately shrinking outliers' contributions yields tighter per-instance privacy bounds for precisely those records that need them most. We prove end-to-end DP guarantees via composition and derive closed-form per-record bounds for the synthesis stage (the scoring stage adds a uniform per-record term). Experiments on simulated data with controlled outlier injection show that risk-weighting substantially reduces membership inference success against high-outlierness records; ablations confirm that targeting -- not random downweighting -- drives the improvement. On real-world benchmarks (Breast Cancer, Adult, German Credit), gains are dataset-dependent, highlighting the interplay between scorer quality and synthesis pipeline.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 15 of its 29 references that are in the map. First posted on arXiv 10 Feb 2026.
Builds on
15 of 29 references.
Closest ancestors · 3
Same direction, newest first
- 2024Free Record-Level Privacy Risk Evaluation Through Artifact-Based Methods8 Nov
- 2023Membership Inference Attacks against Synthetic Data through Overfitting Detection24 Feb
- 2021Membership Inference Attacks From First Principles7 Dec
Other references · 12
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2020Revisiting Membership Inference Under Realistic Assumptionscited by 108
- 2020Individual Privacy Accounting via a Renyi Filtercited by 57
- 2022A Unified Framework for Quantifying Privacy Risk in Synthetic Datacited by 45
- 2019Disparate Vulnerability to Membership Inference Attackscited by 33
- 2023Have it your way: Individualized Privacy Assignment for DP-SGDcited by 21
- 2023Gradients Look Alike: Sensitivity is Often Overestimated in DP-SGDcited by 11
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Datacited by 10
- 2022Differentially-Private Data Synthetisation for Efficient Re-Identification Risk Controlcited by 4
- 2024Synthetic Data Outliers: Navigating Identity Disclosurecited by 3
- 2023Privately Answering Queries on Skewed Data via Per Record Differential Privacycited by 1
- 2024Slowly Scaling Per-Record Differential Privacycited by 1
Built on by
Not cited yet.