Tight End-to-End Accounting for Differentially Private Synthetic Data
Not on the map. Why?
Abstract (arXiv)
Differentially private (DP) pipelines often combine heterogeneous mechanisms, yet their guarantees are best analyzed using different notions of privacy (e.g., bounded range, zCDP, ADP). When composing them, we have to analyze the guarantees through a reduced common representation that loses accounting precision. This issue is particularly relevant in DP synthetic data generation, where data preprocessing, generation algorithms, and DP-SGD could appear within the same pipeline. We develop novel tools for tight end-to-end accounting of such compositions using privacy loss distributions (PLD), f-DP, and Gaussian DP (GDP). In particular, we derive PLD and GDP analyses of bounded-range mechanisms such as the Exponential mechanism. Building on these theoretical results, we introduce AIM-GDP, a GDP-native variant of AIM (a state-of-the-art DP synthetic data mechanism) that enables easy composability with complex pipelines via PLD, attack-aware risk calibration, and tight end-to-end auditing while consistently achieving better utility; and MixCal, an algorithm for calibrating adaptive mixed compositions using PLD accounting. Overall, our tools enable tighter end-to-end accounting and thus less noise at the same privacy level in DP synthetic data pipelines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 71 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
53 of 71 references.
References · 53
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016Deep Learning with Differential Privacycited by 2,728
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2021Membership Inference Attacks From First Principlescited by 878
- 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
- 2013The Composition Theorem for Differential Privacycited by 297
- 2018Scalable Private Learning with PATEcited by 269
- 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 242
- 2021Numerical Composition of Differential Privacycited by 180
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
- 2016Concentrated Differential Privacycited by 144
- 2020The Discrete Gaussian for Differential Privacycited by 135
38 more
- 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
- 2022AIM: An Adaptive and Iterative Mechanism for Differentially Private Synthetic Datacited by 90
- 2021Optimal Accounting of Differential Privacy via Characteristic Functioncited by 86
- 2021Benchmarking Differentially Private Synthetic Data Generation Algorithmscited by 81
- 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Textcited by 76
- 2019Graphical-model based estimation and inference for differential privacycited by 74
- 2020Individual Privacy Accounting via a Renyi Filtercited by 59
- 2021Iterative Methods for Private Synthetic Data: Unifying Framework and New Methodscited by 59
- 2021Differentially Private Query Release Through Adaptive Projectioncited by 52
- 2022Connect the Dots: Tighter Discrete Approximations of Privacy Loss Distributionscited by 52
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2019Practical Differentially Private Top-k Selection with Pay-what-you-get Compositioncited by 39
- 2022MAUVE Scores for Generative Models: Theory and Practicecited by 36
- 2016Privacy Odometers and Filters: Pay-as-you-Go Compositioncited by 33
- 2022Bayesian Estimation of Differential Privacycited by 33
- 2021Differentially Private Quantilescited by 23
- 2024"What do you want from theory alone?" Experimenting with Tight Auditing of Differentially Private Synthetic Data Generationcited by 21
- 2022Individual Privacy Accounting with Gaussian Differential Privacycited by 20
- 2025Synthesizing Privacy-Preserving Text Data via Finetuning without Finetuning Billion-Scale LLMscited by 16
- 2025Privacy amplification by random allocationcited by 15
- 2025Unifying Re-Identification, Attribute Inference, and Data Reconstruction Risks in Differential Privacycited by 15
- 2020Differentially Private Set Unioncited by 14
- 2025Benchmarking Differentially Private Tabular Data Synthesiscited by 14
- 2024Scaling up the Banded Matrix Factorization Mechanism for Differentially Private MLcited by 13
- 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debuggingcited by 13
- 2025How to DP-fy Your Data: A Practical Guide to Generating Synthetic Data With Differential Privacycited by 13
- 2021Differentially Private Approximate Quantilescited by 12
- 2022What You See is What You Get: Principled Deep Learning via Distributional Generalizationcited by 11
- 2024Attack-Aware Noise Calibration for Differential Privacycited by 8
- 2020Differentially private partition selectioncited by 6
- 2021Relaxed Marginal Consistency for Differentially Private Query Answeringcited by 6
- 2022Fully Adaptive Composition for Gaussian Differential Privacycited by 5
- 2025The Importance of Being Discrete: Measuring the Impact of Discretization in End-to-End Differentially Private Synthetic Datacited by 5
- 2025dpmm: Differentially Private Marginal Models, a Library for Synthetic Tabular Data Generationcited by 3
- 2025ACTG-ARL: Differentially Private Conditional Text Generation with RL-Boosted Controlcited by 3
- 2026Optimal conversion from R'enyi Differential Privacy to f-Differential Privacycited by 3
- 2025Exact zCDP Characterizations for Fundamental Differentially Private Mechanismscited by 2
- 2026Privacy Filters are Captured by Residues: A Characterization of Free Natural Filters and the Cost of Adaptivitycited by 2
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.