Winning the NIST Contest: A scalable and general approach to differentially private synthetic data
Not on the map. Why?
Abstract (arXiv)
We propose a general approach for differentially private synthetic data generation, that consists of three steps: (1) select a collection of low-dimensional marginals, (2) measure those marginals with a noise addition mechanism, and (3) generate synthetic data that preserves the measured marginals well. Central to this approach is Private-PGM, a post-processing method that is used to estimate a high-dimensional data distribution from noisy measurements of its marginals. We present two mechanisms, NIST-MST and MST, that are instances of this general approach. NIST-MST was the winning mechanism in the 2018 NIST differential privacy synthetic data competition, and MST is a new mechanism that can work in more general settings, while still performing comparably to NIST-MST. We believe our general approach should be of broad interest, and can be adopted in future mechanisms for synthetic data generation.
Key facts. Cited by 102 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Aug 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 11; 2023: 19; 2024: 27; 2025: 18; 2026: 24.
102 papers.
Sort:
By area:
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
- 2022Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipecited by 108
- 2022Synthetic Data -- what, why and how?cited by 67
- 2021Robin Hood and Matthew Effects: Differential Privacy Has Disparate Impact on Synthetic Datacited by 48
- 2023SoK: Privacy-Preserving Data Synthesiscited by 38
- 2024Privacy-Preserving Instructions for Aligning Large Language Modelscited by 35
- 2023A Linear Reconstruction Approach for Attribute Inference Attacks against Synthetic Datacited by 24
- 2024Systematic Assessment of Tabular Data Synthesiscited by 18
- 2024PANORAMIA: Privacy Auditing of Machine Learning Models without Retrainingcited by 17
- 2023The Inadequacy of Similarity-based Privacy Metrics: Privacy Attacks against "Truly Anonymous" Synthetic Datasetscited by 14
- 2023Auditing and Generating Synthetic Data with Controllable Trust Trade-offscited by 13
- 2023Graphical vs. Deep Generative Models: Measuring the Impact of Differentially Private Mechanisms and Budgets on Utilitycited by 13
38 more
- 2023CuTS: Customizable Tabular Synthetic Data Generationcited by 13
- 2023Unified Enhancement of Privacy Bounds for Mixture Mechanisms via f-Differential Privacycited by 13
- 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debuggingcited by 13
- 2022dpart: Differentially Private Autoregressive Tabular, a General Framework for Synthetic Data Generationcited by 12
- 2025The DCR Delusion: Measuring the Privacy Risk of Synthetic Datacited by 11
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Datacited by 10
- 2022Evaluating the Fairness Impact of Differentially Private Synthetic Datacited by 9
- 2022Noise-Aware Statistical Inference with Differentially Private Synthetic Datacited by 9
- 2023Post-processing Private Synthetic Data for Improving Utility on Selected Measurescited by 9
- 2025Synthetic Tabular Data: Methods, Attacks and Defensescited by 9
- 2022On the Utility Recovery Incapability of Neural Net-based Differential Private Tabular Training Data Synthesizer under Privacy Deregulationcited by 8
- 2023Assessment of Differentially Private Synthetic Data for Utility and Fairness in End-to-End Machine Learning Pipelines for Tabular Datacited by 8
- 2024Privacy-preserving data release leveraging optimal transport and particle gradient descentcited by 8
- 2024Joint Selection: Adaptively Incorporating Public Information for Private Synthetic Datacited by 8
- 2024Neural Collapse Meets Differential Privacy: Curious Behaviors of NoisyGD with Near-perfect Representation Learningcited by 8
- 2023Statistical Theory of Differentially Private Marginal-based Data Synthesis Algorithmscited by 7
- 2021Relaxed Marginal Consistency for Differentially Private Query Answeringcited by 6
- 2022Secure Multiparty Computation for Synthetic Data Generation from Distributed Datacited by 6
- 2023Diverse Community Data for Benchmarking Data Privacy Algorithmscited by 6
- 2024Tabular Data Synthesis with Differential Privacy: A Surveycited by 6
- 2022Private Quantiles Estimation in the Presence of Atomscited by 5
- 2023Privately generating tabular data using language modelscited by 5
- 2024DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generatorscited by 5
- 2025Is API Access to LLMs Useful for Generating Private Synthetic Tabular Data?cited by 5
- 2025The Importance of Being Discrete: Measuring the Impact of Discretization in End-to-End Differentially Private Synthetic Datacited by 5
- 2023Privacy Measurement in Tabular Synthetic Data: State of the Art and Future Research Directionscited by 4
- 2023A Simple and Practical Method for Reducing the Disparate Impact of Differential Privacycited by 4
- 2024Does Differentially Private Synthetic Data Lead to Synthetic Discoveries?cited by 4
- 2024Private Regression via Data-Dependent Sufficient Statistic Perturbationcited by 4
- 2025Improving the Generation and Evaluation of Synthetic Data for Downstream Medical Causal Inferencecited by 4
- 2024Bounding the Excess Risk for Linear Models Trained on Marginal-Preserving, Differentially-Private, Synthetic Datacited by 3
- 2025dpmm: Differentially Private Marginal Models, a Library for Synthetic Tabular Data Generationcited by 3
- 2022NeuroMixGDP: A Neural Collapse-Inspired Random Mixup for Private Data Releasecited by 2
- 2022Spending Privacy Budget Fairly and Wiselycited by 2
- 2022Answering Private Linear Queries Adaptively using the Common Mechanismcited by 2
- 2024An Algorithm for Streaming Differentially Private Datacited by 2
- 2024A Bias-Variance Decomposition for Ensembles over Multiple Synthetic Datasetscited by 2
- 2024Differentially Private Synthetic Data with Private Density Estimationcited by 2
50 most cited of 102 All 102 (JSON)
- 2026PEG-Tab: Sampling-Time Record Repair and Release Control for Tabular Synthesis30 Sep 2026
- 2026Geometry-Adaptive Mechanisms for Private Synthetic Data27 Sep 2026
- 2026Portable Causal Fairness Across Synthetic Data Generator Families2 Sep 2026
- 2026Workload-Preserving Differentially Private Synthetic Data for Causal Inference via Maximum-Entropy Calibration9 Jul 2026
- 2026Where to Intervene? Benchmarking Fairness-Aware Learning on Differentially Private Synthetic Tabular Data8 Jul 2026
- 2026TabPATE: Differentially Private Tabular In-Context Learning Without Public Data30 Jun 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026Fixed-Parameter Tractability of Private Synthetic Data Generation9 Jun 2026
- 2026SoK: Reconstruction Attacks on Synthetic Tabular Data (Insights from Winning the NIST CRC)6 Jun 2026
- 2026Differentially Private Synthetic Data via APIs 4: Tabular Data6 Jun 2026
- 2026Quantifying the Privacy of Counterfactuals by Leveraging Membership Inference Attacks Against Synthetic Data4 Jun 2026
- 2026It does what it says on the tin: safe synthetic data from coarsened margins1 Jun 2026
38 more
- 2026A Dual Perspective on Synthetic Trajectory Generators: Utility Framework and Privacy Vulnerabilities21 Apr 2026
- 2026Tight Auditing of Differential Privacy in MST and AIM20 Apr 2026
- 2026Evaluating LLM Simulators as Differentially Private Data Generators16 Apr 2026
- 2026Decoupling Identity from Utility: Privacy-by-Design Frameworks for Financial Ecosystems16 Apr 2026
- 2026Accurate and Scalable Matrix Mechanisms via Divide and Conquer1 Apr 2026
- 2026Amalgam: Hybrid LLM-PGM Synthesis Algorithm for Accuracy and Realism28 Mar 2026
- 2026Noise-Calibrated Inference from Differentially Private Sufficient Statistics in Exponential Families2 Mar 2026
- 2026PRISM: Differentially Private Synthetic Data with Structure-Aware Budget Allocation for Prediction10 Feb 2026
- 2026FHAIM: Fully Homomorphic AIM For Private Synthetic Data Generation5 Feb 2026
- 2026Privacy Amplification Persists under Unlimited Synthetic Data Release3 Feb 2026
- 2026Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentation3 Feb 2026
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspective30 Jan 2026
- 2025Differentially Private Synthetic Data Generation Using Context-Aware GANs9 Dec 2025
- 2025Beyond One-Size-Fits-All: Neural Networks for Differentially Private Tabular Data Synthesis17 Nov 2025
- 2025Improving the Generation and Evaluation of Synthetic Data for Downstream Medical Causal Inference21 Oct 2025
- 2025Differentially Private Wasserstein Barycenters3 Oct 2025
- 2025Beyond Internal Data: Constructing Complete Datasets for Fairness Testing24 Jul 2025
- 2025A Unified Framework for Adversary-Aware Differential Privacy Bounds10 Jul 2025
- 2025Differential Privacy in Machine Learning: A Survey from Symbolic AI to LLMs13 Jun 2025
- 2025Synthetic Tabular Data: Methods, Attacks and Defenses6 Jun 2025
- 2025Privacy Amplification Through Synthetic Data: Insights from Linear Regression5 Jun 2025
- 2025dpmm: Differentially Private Marginal Models, a Library for Synthetic Tabular Data Generation31 May 2025
- 2025The DCR Delusion: Measuring the Privacy Risk of Synthetic Data2 May 2025
- 2025Quantitative Auditing of AI Fairness with Differentially Private Synthetic Data30 Apr 2025
- 2025Understanding the Impact of Data Domain Extraction on Synthetic Data Privacy11 Apr 2025
- 2025The Importance of Being Discrete: Measuring the Impact of Discretization in End-to-End Differentially Private Synthetic Data9 Apr 2025
- 2025P2NIA: Privacy-Preserving Non-Iterative Auditing1 Apr 2025
- 2025TAMIS: Tailored Membership Inference Attacks on Synthetic Data1 Apr 2025
- 2025Privacy-Preserving Fair Synthetic Tabular Data4 Mar 2025
- 2025Is API Access to LLMs Useful for Generating Private Synthetic Tabular Data?10 Feb 2025
- 2024Optimal Bounds for Private Minimum Spanning Trees via Input Perturbation13 Dec 2024
- 2024End to End Collaborative Synthetic Data Generation4 Dec 2024
- 2024DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generators3 Dec 2024
- 2024SAFES: Sequential Privacy and Fairness Enhancing Data Synthesis for Responsible AI14 Nov 2024
- 2024Tabular Data Synthesis with Differential Privacy: A Survey4 Nov 2024
- 2024Evaluating utility in synthetic banking microdata applications29 Oct 2024
- 2024Privacy without Noisy Gradients: Slicing Mechanism for Generative Model Training25 Oct 2024
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Data7 Oct 2024
50 newest of 102 All 102 (JSON)
- 2024PANORAMIA: Privacy Auditing of Machine Learning Models without Retrainingcited by 17
- 2025The DCR Delusion: Measuring the Privacy Risk of Synthetic Datacited by 11
- 2025A Unified Framework for Adversary-Aware Differential Privacy Boundscited by 2
- 2025TAMIS: Tailored Membership Inference Attacks on Synthetic Datacited by 1
- 2025Understanding the Impact of Data Domain Extraction on Synthetic Data Privacycited by 0
- 2026Quantifying the Privacy of Counterfactuals by Leveraging Membership Inference Attacks Against Synthetic Datacited by 0
- 2026TabPATE: Differentially Private Tabular In-Context Learning Without Public Datacited by 0
- 2026TabPATE: Differentially Private Tabular In-Context Learning Without Public Data30 Jun 2026
- 2026Quantifying the Privacy of Counterfactuals by Leveraging Membership Inference Attacks Against Synthetic Data4 Jun 2026
- 2025A Unified Framework for Adversary-Aware Differential Privacy Bounds10 Jul 2025
- 2025The DCR Delusion: Measuring the Privacy Risk of Synthetic Data2 May 2025
- 2025Understanding the Impact of Data Domain Extraction on Synthetic Data Privacy11 Apr 2025
- 2025TAMIS: Tailored Membership Inference Attacks on Synthetic Data1 Apr 2025
- 2024PANORAMIA: Privacy Auditing of Machine Learning Models without Retraining12 Feb 2024
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
- 2022Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipecited by 108
- 2022Synthetic Data -- what, why and how?cited by 67
- 2021Robin Hood and Matthew Effects: Differential Privacy Has Disparate Impact on Synthetic Datacited by 48
- 2023SoK: Privacy-Preserving Data Synthesiscited by 38
- 2023A Linear Reconstruction Approach for Attribute Inference Attacks against Synthetic Datacited by 24
- 2023The Inadequacy of Similarity-based Privacy Metrics: Privacy Attacks against "Truly Anonymous" Synthetic Datasetscited by 14
- 2023Auditing and Generating Synthetic Data with Controllable Trust Trade-offscited by 13
- 2023Graphical vs. Deep Generative Models: Measuring the Impact of Differentially Private Mechanisms and Budgets on Utilitycited by 13
- 2023CuTS: Customizable Tabular Synthetic Data Generationcited by 13
- 2023Unified Enhancement of Privacy Bounds for Mixture Mechanisms via f-Differential Privacycited by 13
- 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debuggingcited by 13
12 most cited of 91 All 91 (JSON)
- 2026PEG-Tab: Sampling-Time Record Repair and Release Control for Tabular Synthesis30 Sep 2026
- 2026Geometry-Adaptive Mechanisms for Private Synthetic Data27 Sep 2026
- 2026Portable Causal Fairness Across Synthetic Data Generator Families2 Sep 2026
- 2026Workload-Preserving Differentially Private Synthetic Data for Causal Inference via Maximum-Entropy Calibration9 Jul 2026
- 2026Where to Intervene? Benchmarking Fairness-Aware Learning on Differentially Private Synthetic Tabular Data8 Jul 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026Fixed-Parameter Tractability of Private Synthetic Data Generation9 Jun 2026
- 2026SoK: Reconstruction Attacks on Synthetic Tabular Data (Insights from Winning the NIST CRC)6 Jun 2026
- 2026It does what it says on the tin: safe synthetic data from coarsened margins1 Jun 2026
- 2026A Dual Perspective on Synthetic Trajectory Generators: Utility Framework and Privacy Vulnerabilities21 Apr 2026
- 2026Tight Auditing of Differential Privacy in MST and AIM20 Apr 2026
- 2026Evaluating LLM Simulators as Differentially Private Data Generators16 Apr 2026
12 newest of 91 All 91 (JSON)