mlsanityData to 14 Oct 2026

Tight End-to-End Accounting for Differentially Private Synthetic Data

arXiv 2610.17249 ↗First posted 12 Oct 2026cs.CR cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Differentially private (DP) pipelines often combine heterogeneous mechanisms, yet their guarantees are best analyzed using different notions of privacy (e.g., bounded range, zCDP, ADP). When composing them, we have to analyze the guarantees through a reduced common representation that loses accounting precision. This issue is particularly relevant in DP synthetic data generation, where data preprocessing, generation algorithms, and DP-SGD could appear within the same pipeline. We develop novel tools for tight end-to-end accounting of such compositions using privacy loss distributions (PLD), f-DP, and Gaussian DP (GDP). In particular, we derive PLD and GDP analyses of bounded-range mechanisms such as the Exponential mechanism. Building on these theoretical results, we introduce AIM-GDP, a GDP-native variant of AIM (a state-of-the-art DP synthetic data mechanism) that enables easy composability with complex pipelines via PLD, attack-aware risk calibration, and tight end-to-end auditing while consistently achieving better utility; and MixCal, an algorithm for calibrating adaptive mixed compositions using PLD accounting. Overall, our tools enable tighter end-to-end accounting and thus less noise at the same privacy level in DP synthetic data pipelines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 71 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

53 of 71 references.

References · 53

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  2. 2016Deep Learning with Differential Privacycited by 2,728
  3. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  4. 2021Membership Inference Attacks From First Principlescited by 878
  5. 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
  6. 2013The Composition Theorem for Differential Privacycited by 297
  7. 2018Scalable Private Learning with PATEcited by 269
  8. 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 242
  9. 2021Numerical Composition of Differential Privacycited by 180
  10. 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
  11. 2016Concentrated Differential Privacycited by 144
  12. 2020The Discrete Gaussian for Differential Privacycited by 135
38 more
  1. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
  2. 2022AIM: An Adaptive and Iterative Mechanism for Differentially Private Synthetic Datacited by 90
  3. 2021Optimal Accounting of Differential Privacy via Characteristic Functioncited by 86
  4. 2021Benchmarking Differentially Private Synthetic Data Generation Algorithmscited by 81
  5. 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Textcited by 76
  6. 2019Graphical-model based estimation and inference for differential privacycited by 74
  7. 2020Individual Privacy Accounting via a Renyi Filtercited by 59
  8. 2021Iterative Methods for Private Synthetic Data: Unifying Framework and New Methodscited by 59
  9. 2021Differentially Private Query Release Through Adaptive Projectioncited by 52
  10. 2022Connect the Dots: Tighter Discrete Approximations of Privacy Loss Distributionscited by 52
  11. 2022Private Convex Optimization via Exponential Mechanismcited by 49
  12. 2019Practical Differentially Private Top-k Selection with Pay-what-you-get Compositioncited by 39
  13. 2022MAUVE Scores for Generative Models: Theory and Practicecited by 36
  14. 2016Privacy Odometers and Filters: Pay-as-you-Go Compositioncited by 33
  15. 2022Bayesian Estimation of Differential Privacycited by 33
  16. 2021Differentially Private Quantilescited by 23
  17. 2024"What do you want from theory alone?" Experimenting with Tight Auditing of Differentially Private Synthetic Data Generationcited by 21
  18. 2022Individual Privacy Accounting with Gaussian Differential Privacycited by 20
  19. 2025Synthesizing Privacy-Preserving Text Data via Finetuning without Finetuning Billion-Scale LLMscited by 16
  20. 2025Privacy amplification by random allocationcited by 15
  21. 2025Unifying Re-Identification, Attribute Inference, and Data Reconstruction Risks in Differential Privacycited by 15
  22. 2020Differentially Private Set Unioncited by 14
  23. 2025Benchmarking Differentially Private Tabular Data Synthesiscited by 14
  24. 2024Scaling up the Banded Matrix Factorization Mechanism for Differentially Private MLcited by 13
  25. 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debuggingcited by 13
  26. 2025How to DP-fy Your Data: A Practical Guide to Generating Synthetic Data With Differential Privacycited by 13
  27. 2021Differentially Private Approximate Quantilescited by 12
  28. 2022What You See is What You Get: Principled Deep Learning via Distributional Generalizationcited by 11
  29. 2024Attack-Aware Noise Calibration for Differential Privacycited by 8
  30. 2020Differentially private partition selectioncited by 6
  31. 2021Relaxed Marginal Consistency for Differentially Private Query Answeringcited by 6
  32. 2022Fully Adaptive Composition for Gaussian Differential Privacycited by 5
  33. 2025The Importance of Being Discrete: Measuring the Impact of Discretization in End-to-End Differentially Private Synthetic Datacited by 5
  34. 2025dpmm: Differentially Private Marginal Models, a Library for Synthetic Tabular Data Generationcited by 3
  35. 2025ACTG-ARL: Differentially Private Conditional Text Generation with RL-Boosted Controlcited by 3
  36. 2026Optimal conversion from R'enyi Differential Privacy to f-Differential Privacycited by 3
  37. 2025Exact zCDP Characterizations for Fundamental Differentially Private Mechanismscited by 2
  38. 2026Privacy Filters are Captured by Residues: A Characterization of Free Natural Filters and the Cost of Adaptivitycited by 2

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.