Benchmarking Differentially Private Synthetic Data Generation Algorithms
Not on the map. Why?
Abstract (arXiv)
This work presents a systematic benchmark of differentially private synthetic data generation algorithms that can generate tabular data. Utility of the synthetic data is evaluated by measuring whether the synthetic data preserve the distribution of individual and pairs of attributes, pairwise correlation as well as on the accuracy of an ML classification model. In a comprehensive empirical evaluation we identify the top performing algorithms and those that consistently fail to beat baseline approaches.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Dec 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 12; 2023: 21; 2024: 18; 2025: 17; 2026: 11.
80 papers.
Sort:
By area:
- 2023Data-centric Artificial Intelligence: A Surveycited by 202
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 150
- 2022Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipecited by 108
- 2022Synthetic Data -- what, why and how?cited by 66
- 2023Harnessing large-language models to generate private synthetic textcited by 65
- 2021Generating Synthetic Mixed-type Longitudinal Electronic Health Records for Artificial Intelligent Applicationscited by 47
- 2022Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluationcited by 39
- 2023SoK: Privacy-Preserving Data Synthesiscited by 37
- 2022Private Synthetic Data for Multitask Learning and Marginal Queriescited by 35
- 2024Privacy-Preserving Instructions for Aligning Large Language Modelscited by 34
- 2023A Linear Reconstruction Approach for Attribute Inference Attacks against Synthetic Datacited by 23
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
38 more
- 2023Generating Private Synthetic Data with Genetic Algorithmscited by 18
- 2023Private GANs, Revisitedcited by 17
- 2023The Inadequacy of Similarity-based Privacy Metrics: Privacy Attacks against "Truly Anonymous" Synthetic Datasetscited by 14
- 2023Graphical vs. Deep Generative Models: Measuring the Impact of Differentially Private Mechanisms and Budgets on Utilitycited by 13
- 2023DP-TBART: A Transformer-based Autoregressive Model for Differentially Private Tabular Data Generationcited by 13
- 2025Differentially Private Synthetic Data via APIs 3: Using Simulators Instead of Foundation Modelcited by 13
- 2022dpart: Differentially Private Autoregressive Tabular, a General Framework for Synthetic Data Generationcited by 12
- 2023CuTS: Customizable Tabular Synthetic Data Generationcited by 12
- 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debuggingcited by 12
- 2025DPImageBench: A Unified Benchmark for Differentially Private Image Synthesiscited by 11
- 2024Discriminative Estimation of Total Variation Distance: A Fidelity Auditor for Generative Datacited by 10
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Datacited by 10
- 2025Modeling Annotator Disagreement with Demographic-Aware Experts and Synthetic Perspectivescited by 10
- 2022Noise-Aware Statistical Inference with Differentially Private Synthetic Datacited by 9
- 2023Post-processing Private Synthetic Data for Improving Utility on Selected Measurescited by 9
- 2022On the Utility Recovery Incapability of Neural Net-based Differential Private Tabular Training Data Synthesizer under Privacy Deregulationcited by 8
- 2023Assessment of Differentially Private Synthetic Data for Utility and Fairness in End-to-End Machine Learning Pipelines for Tabular Datacited by 8
- 2024Privacy-preserving data release leveraging optimal transport and particle gradient descentcited by 8
- 2025Synthetic Tabular Data: Methods, Attacks and Defensescited by 8
- 2025Struct-Bench: A Benchmark for Differentially Private Structured Text Generationcited by 7
- 2023Diverse Community Data for Benchmarking Data Privacy Algorithmscited by 6
- 2023FLAIM: AIM-based Synthetic Data Generation in the Federated Settingcited by 6
- 2024Synthetic Data: Revisiting the Privacy-Utility Trade-offcited by 6
- 2024Differential Privacy Under Class Imbalance: Methods and Empirical Insightscited by 6
- 2023Privately generating tabular data using language modelscited by 5
- 2023The Real Deal Behind the Artificial Appeal: Inferential Utility of Tabular Synthetic Datacited by 5
- 2024DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generatorscited by 5
- 2025Is API Access to LLMs Useful for Generating Private Synthetic Tabular Data?cited by 5
- 2022Decouple-and-Sample: Protecting sensitive information in task agnostic data releasecited by 4
- 2022Provable Membership Inference Privacycited by 4
- 2023A Unified View of Differentially Private Deep Generative Modelingcited by 4
- 2023A Simple and Practical Method for Reducing the Disparate Impact of Differential Privacycited by 4
- 2024Private Regression via Data-Dependent Sufficient Statistic Perturbationcited by 4
- 2025The Importance of Being Discrete: Measuring the Impact of Discretization in End-to-End Differentially Private Synthetic Datacited by 4
- 2024Synthetic Data Outliers: Navigating Identity Disclosurecited by 3
- 2022Spending Privacy Budget Fairly and Wiselycited by 2
- 2024An Algorithm for Streaming Differentially Private Datacited by 2
- 2024Differentially Private Synthetic Data Generation for Relational Databasescited by 2
50 most cited of 80 All 80 (JSON)
- 2026PEARL: A Task-Aware Framework for Evaluating Differentially Private Synthetic Educational Data8 Sep 2026
- 2026Differentially Private Paired Table-Image Multimodal Synthesis1 Sep 2026
- 2026Benchmarking Time Series Generation Methods for Privacy-Preserving Forecasting11 Aug 2026
- 2026Workload-Preserving Differentially Private Synthetic Data for Causal Inference via Maximum-Entropy Calibration9 Jul 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026Differentially Private Synthetic Data via APIs 4: Tabular Data6 Jun 2026
- 2026Tight Auditing of Differential Privacy in MST and AIM20 Apr 2026
- 2026Amalgam: Hybrid LLM-PGM Synthesis Algorithm for Accuracy and Realism28 Mar 2026
- 2026Noise-Calibrated Inference from Differentially Private Sufficient Statistics in Exponential Families2 Mar 2026
- 2026FHAIM: Fully Homomorphic AIM For Private Synthetic Data Generation5 Feb 2026
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspective30 Jan 2026
- 2025Beyond One-Size-Fits-All: Neural Networks for Differentially Private Tabular Data Synthesis17 Nov 2025
38 more
- 2025PrAda-GAN: A Private Adaptive Generative Adversarial Network with Bayes Network Structure11 Nov 2025
- 2025ACTG-ARL: Differentially Private Conditional Text Generation with RL-Boosted Control21 Oct 2025
- 2025Differentially Private Linear Regression and Synthetic Data Generation with Statistical Guarantees19 Oct 2025
- 2025Struct-Bench: A Benchmark for Differentially Private Structured Text Generation12 Sep 2025
- 2025Modeling Annotator Disagreement with Demographic-Aware Experts and Synthetic Perspectives4 Aug 2025
- 2025Beyond Internal Data: Constructing Complete Datasets for Fairness Testing24 Jul 2025
- 2025SoK: Can Synthetic Images Replace Real Data? A Survey of Utility and Privacy of Synthetic Image Generation24 Jun 2025
- 2025Synthetic Tabular Data: Methods, Attacks and Defenses6 Jun 2025
- 2025dpmm: Differentially Private Marginal Models, a Library for Synthetic Tabular Data Generation31 May 2025
- 2025Quantitative Auditing of AI Fairness with Differentially Private Synthetic Data30 Apr 2025
- 2025The Importance of Being Discrete: Measuring the Impact of Discretization in End-to-End Differentially Private Synthetic Data9 Apr 2025
- 2025P2NIA: Privacy-Preserving Non-Iterative Auditing1 Apr 2025
- 2025DPImageBench: A Unified Benchmark for Differentially Private Image Synthesis18 Mar 2025
- 2025Privacy-Preserving Fair Synthetic Tabular Data4 Mar 2025
- 2025Is API Access to LLMs Useful for Generating Private Synthetic Tabular Data?10 Feb 2025
- 2025Differentially Private Synthetic Data via APIs 3: Using Simulators Instead of Foundation Model8 Feb 2025
- 2024End to End Collaborative Synthetic Data Generation4 Dec 2024
- 2024DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generators3 Dec 2024
- 2024Differential Privacy Under Class Imbalance: Methods and Empirical Insights8 Nov 2024
- 2024Evaluating utility in synthetic banking microdata applications29 Oct 2024
- 2024Privacy without Noisy Gradients: Slicing Mechanism for Generative Model Training25 Oct 2024
- 2024Privacy-hardened and hallucination-resistant synthetic data generation with logic-solvers22 Oct 2024
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Data7 Oct 2024
- 2024Defining 'Good': Evaluation Framework for Synthetic Smart Meter Data16 Jul 2024
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)10 Jul 2024
- 2024Synthetic Data: Revisiting the Privacy-Utility Trade-off9 Jul 2024
- 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debugging20 Jun 2024
- 2024Synthetic Data Outliers: Navigating Identity Disclosure4 Jun 2024
- 2024Differentially Private Synthetic Data Generation for Relational Databases29 May 2024
- 2024Discriminative Estimation of Total Variation Distance: A Fidelity Auditor for Generative Data24 May 2024
- 2024Private Regression via Data-Dependent Sufficient Statistic Perturbation23 May 2024
- 2024Privacy-Preserving Instructions for Aligning Large Language Models21 Feb 2024
- 2024Privacy-preserving data release leveraging optimal transport and particle gradient descent31 Jan 2024
- 2024An Algorithm for Streaming Differentially Private Data26 Jan 2024
- 2023A Simple and Practical Method for Reducing the Disparate Impact of Differential Privacy18 Dec 2023
- 2023The Real Deal Behind the Artificial Appeal: Inferential Utility of Tabular Synthetic Data13 Dec 2023
- 2023The Inadequacy of Similarity-based Privacy Metrics: Privacy Attacks against "Truly Anonymous" Synthetic Datasets8 Dec 2023
- 2023Assessment of Differentially Private Synthetic Data for Utility and Fairness in End-to-End Machine Learning Pipelines for Tabular Data30 Oct 2023
50 newest of 80 All 80 (JSON)
- 2022Provable Membership Inference Privacycited by 4
- 2022Provable Membership Inference Privacy12 Nov 2022
- 2023Data-centric Artificial Intelligence: A Surveycited by 202
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 150
- 2022Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipecited by 108
- 2022Synthetic Data -- what, why and how?cited by 66
- 2023Harnessing large-language models to generate private synthetic textcited by 65
- 2021Generating Synthetic Mixed-type Longitudinal Electronic Health Records for Artificial Intelligent Applicationscited by 47
- 2022Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluationcited by 39
- 2023SoK: Privacy-Preserving Data Synthesiscited by 37
- 2022Private Synthetic Data for Multitask Learning and Marginal Queriescited by 35
- 2023A Linear Reconstruction Approach for Attribute Inference Attacks against Synthetic Datacited by 23
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
- 2023Generating Private Synthetic Data with Genetic Algorithmscited by 18
12 most cited of 75 All 75 (JSON)
- 2026PEARL: A Task-Aware Framework for Evaluating Differentially Private Synthetic Educational Data8 Sep 2026
- 2026Differentially Private Paired Table-Image Multimodal Synthesis1 Sep 2026
- 2026Benchmarking Time Series Generation Methods for Privacy-Preserving Forecasting11 Aug 2026
- 2026Workload-Preserving Differentially Private Synthetic Data for Causal Inference via Maximum-Entropy Calibration9 Jul 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026Tight Auditing of Differential Privacy in MST and AIM20 Apr 2026
- 2026Amalgam: Hybrid LLM-PGM Synthesis Algorithm for Accuracy and Realism28 Mar 2026
- 2026Noise-Calibrated Inference from Differentially Private Sufficient Statistics in Exponential Families2 Mar 2026
- 2026FHAIM: Fully Homomorphic AIM For Private Synthetic Data Generation5 Feb 2026
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspective30 Jan 2026
- 2025Beyond One-Size-Fits-All: Neural Networks for Differentially Private Tabular Data Synthesis17 Nov 2025
- 2025PrAda-GAN: A Private Adaptive Generative Adversarial Network with Bayes Network Structure11 Nov 2025
12 newest of 75 All 75 (JSON)