mlsanityData to 14 Oct 2026

Privacy Amplification Persists under Unlimited Synthetic Data Release

arXiv 2602.04895 ↗First posted 3 Feb 2026cs.CR cs.DS cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study privacy amplification by synthetic data release, a phenomenon in which differential privacy guarantees are improved by releasing only synthetic data rather than the private generative model itself. Recent work by Pierquin et al. (2025) established the first formal amplification guarantees for a linear generator, but they apply only in asymptotic regimes where the model dimension far exceeds the number of released synthetic records, limiting their practical relevance. In this work, we show a surprising result: under a bounded-parameter assumption, privacy amplification persists even when releasing an unbounded number of synthetic records, thereby improving upon the bounds of Pierquin et al. (2025). Our analysis provides structural insights that may guide the development of tighter privacy guarantees for more complex release mechanisms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 54 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

24 of 54 references.

References · 24

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016Deep Learning with Differential Privacycited by 2,728
  3. 2017Renyi Differential Privacycited by 650
  4. 2018Differentially Private Generative Adversarial Networkcited by 235
  5. 2024Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Datacited by 151
  6. 2019Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapsecited by 121
  7. 2022Differentially Private Diffusion Modelscited by 119
  8. 2021Winning the NIST Contest: A scalable and general approach to differentially private synthetic datacited by 102
  9. 2018Privacy Amplification by Iterationcited by 100
  10. 2024Model Collapse Demystified: The Case of Regressioncited by 82
  11. 2019Graphical-model based estimation and inference for differential privacycited by 74
  12. 2017Efficient Private ERM for Smooth Objectivescited by 61
12 more
  1. 2022Privacy of Noisy Stochastic Gradient Descent: More Iterations without More Privacy Losscited by 61
  2. 2022TAPAS: a Toolbox for Adversarial Privacy Auditing of Synthetic Datacited by 57
  3. 2024"What do you want from theory alone?" Experimenting with Tight Auditing of Differentially Private Synthetic Data Generationcited by 21
  4. 2023Private GANs, Revisitedcited by 17
  5. 2018Global Convergence to the Equilibrium of GANs using Variational Inequalitiescited by 15
  6. 2025How to DP-fy Your Data: A Practical Guide to Generating Synthetic Data With Differential Privacycited by 13
  7. 2024Private Gradient Descent for Linear Regression: Tighter Error Bounds and Instance-Specific Uncertainty Estimationcited by 12
  8. 2025Does Training with Synthetic Data Truly Protect Privacy?cited by 12
  9. 2021Output Perturbation for Differentially Private Convex Optimization: Faster and More Generalcited by 7
  10. 2022Function-space regularized R'enyi divergencescited by 7
  11. 2015A Pessimistic Approximation for the Fisher Information Measurecited by 2
  12. 2025Privacy Amplification Through Synthetic Data: Insights from Linear Regressioncited by 2

Built on by

Not cited yet.