Synthetic Data -- Anonymisation Groundhog Day
Not on the map. Why?
Abstract (arXiv)
Synthetic data has been advertised as a silver-bullet solution to privacy-preserving data publishing that addresses the shortcomings of traditional anonymisation techniques. The promise is that synthetic data drawn from generative models preserves the statistical properties of the original dataset but, at the same time, provides perfect protection against privacy attacks. In this work, we present the first quantitative evaluation of the privacy gain of synthetic data publishing and compare it to that of previous anonymisation techniques. Our evaluation of a wide range of state-of-the-art generative models demonstrates that synthetic data either does not prevent inference attacks or does not retain data utility. In other words, we empirically show that synthetic data does not provide a better tradeoff between privacy and utility than traditional anonymisation techniques. Furthermore, in contrast to traditional anonymisation, the privacy-utility tradeoff of synthetic data publishing is hard to predict. Because it is impossible to predict what signals a synthetic dataset will preserve and what information will be lost, synthetic data leads to a highly variable privacy gain and unpredictable utility loss. In summary, we find that synthetic data is far from the holy grail of privacy-preserving data publishing.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 12; 2023: 28; 2024: 25; 2025: 15; 2026: 22.
105 papers.
Sort:
By area:
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2023Differentially Private Diffusion Models Generate Useful Synthetic Imagescited by 85
- 2023Membership Inference Attacks against Diffusion Modelscited by 84
- 2022Synthetic Data -- what, why and how?cited by 66
- 2022TAPAS: a Toolbox for Adversarial Privacy Auditing of Synthetic Datacited by 56
- 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
- 2024SoK: Membership Inference Attacks on LLMs are Rushing Nowhere (and How to Fix It)cited by 54
- 2022Privacy-friendly Synthetic Data for the Development of Face Morphing Attack Detectorscited by 47
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2023SoK: Privacy-Preserving Data Synthesiscited by 37
- 2023Beyond Privacy: Navigating the Opportunities and Challenges of Synthetic Datacited by 29
38 more
- 2023Achilles' Heels: Vulnerable Record Identification in Synthetic Data Publishingcited by 28
- 2024ClavaDDPM: Multi-relational Data Synthesis with Cluster-guided Diffusion Modelscited by 28
- 2022Generating multivariate time series with COmmon Source CoordInated GAN (COSCI-GAN)cited by 23
- 2023A Linear Reconstruction Approach for Attribute Inference Attacks against Synthetic Datacited by 23
- 2024Nearly Tight Black-Box Auditing of Differentially Private Machine Learningcited by 19
- 2023Synthetic is all you need: removing the auxiliary data assumption for membership inference attacks against synthetic datacited by 18
- 2025The Canary's Echo: Auditing Privacy Risks of LLM-Generated Synthetic Textcited by 18
- 2023Membership Inference Attacks on Diffusion Models via Quantile Regressioncited by 17
- 2024Systematic Assessment of Tabular Data Synthesiscited by 17
- 2021Data synthesis and adversarial networks: A review and meta-analysis in cancer imagingcited by 15
- 2025A False Sense of Privacy: Evaluating Textual Data Sanitization Beyond Surface-level Privacy Leakagecited by 15
- 2022medigan: a Python library of pretrained generative models for medical image synthesiscited by 14
- 2023CuTS: Customizable Tabular Synthetic Data Generationcited by 12
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Surveycited by 12
- 2024Establishing and Evaluating Trustworthy AI: Overview and Research Challengescited by 12
- 2023Synthetic Data: Methods, Use Cases, and Riskscited by 10
- 2023You Don't Have to Be Perfect to Be Amazing: Unveil the Utility of Synthetic Imagescited by 10
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Datacited by 10
- 2024Private Synthetic Text Generation with Diffusion Modelscited by 10
- 2022Non-Imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive Surveycited by 9
- 2023Investigating the Effect of Misalignment on Membership Privacy in the White-box Settingcited by 9
- 2022On the Utility Recovery Incapability of Neural Net-based Differential Private Tabular Training Data Synthesizer under Privacy Deregulationcited by 8
- 2025A Consensus Privacy Metrics Framework for Synthetic Datacited by 8
- 2025Synthetic Tabular Data: Methods, Attacks and Defensescited by 8
- 2024Downstream Task-Oriented Generative Model Selections on Synthetic Data Training for Fraud Detection Modelscited by 7
- 2025Synthetic Data Privacy Metricscited by 7
- 2022QuerySnout: Automating the Discovery of Attribute Inference Attacks against Query-Based Systemscited by 6
- 2023FLAIM: AIM-based Synthetic Data Generation in the Federated Settingcited by 6
- 2024Synthetic Data: Revisiting the Privacy-Utility Trade-offcited by 6
- 2024Tabular Data Synthesis with Differential Privacy: A Surveycited by 6
- 2023The Real Deal Behind the Artificial Appeal: Inferential Utility of Tabular Synthetic Datacited by 5
- 2024Generating Synthetic Health Sensor Data for Privacy-Preserving Wearable Stress Detectioncited by 5
- 2024DP-TLDM: Differentially Private Tabular Latent Diffusion Modelcited by 5
- 2024DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generatorscited by 5
- 2025Trustworthy AI: Safety, Bias, and Privacy -- A Surveycited by 5
- 2025Privacy Auditing Synthetic Data Release through Local Likelihood Attackscited by 5
- 2022Provable Membership Inference Privacycited by 4
- 2022Differentially-Private Data Synthetisation for Efficient Re-Identification Risk Controlcited by 4
50 most cited of 105 All 105 (JSON)
- 2026Collaborative Synthetic Data for Privacy-Preserving Financial Fraud Detection Across Organizational Silos27 Sep 2026
- 2026Subgroup Membership Inference Audits of Differentially Private Synthetic Text9 Sep 2026
- 2026PEARL: A Task-Aware Framework for Evaluating Differentially Private Synthetic Educational Data8 Sep 2026
- 2026Position: Privacy Is a Claim, Not a Property of Synthetic Data1 Sep 2026
- 2026Protecting patient privacy in clinical foundation models: Technical and legal perspectives7 Aug 2026
- 2026Privacy-Aware Synthetic Video Benchmarking and Relational Evaluation for Worker-Under-Suspended-Load Detection17 Jul 2026
- 2026Privacy Leakage in Federated Learning in Radiology Reports: A Comparative Evaluation of Tokenizer-Driven Privacy Risks15 Jul 2026
- 2026Where to Intervene? Benchmarking Fairness-Aware Learning on Differentially Private Synthetic Tabular Data8 Jul 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026LLM-as-a-Discriminator: When Synthetic Tables Still Look Real1 Jun 2026
- 2026PrivFusion: A Privacy-preserving Multi-Agent Framework for Harmonizing Distributed Datasets22 May 2026
- 2026ReMIA: a Powerful and Efficient Alternative to Membership Inference Attacks against Synthetic Data Generators14 May 2026
38 more
- 2026On Privacy in Data-Space Tabular Diffusion Models: Influential Factors, Attacker Knowledge, and Metrics7 May 2026
- 2026Decoupling Identity from Utility: Privacy-by-Design Frameworks for Financial Ecosystems16 Apr 2026
- 2026SYNTHONY: A Stress-Aware, Intent-Conditioned Agent for Deep Tabular Generative Models Selection31 Mar 2026
- 2026MIDST Challenge at SaTML 2025: Membership Inference over Diffusion-models-based Synthetic Tabular data19 Mar 2026
- 2026Quantifying Membership Disclosure Risk for Tabular Synthetic Data Using Kernel Density Estimators11 Mar 2026
- 2026Controllable Generative Sandbox for Causal Inference3 Mar 2026
- 2026Turning Black Box into White Box: Dataset Distillation Leaks1 Mar 2026
- 2026Finding Connections: Membership Inference Attacks for the Multi-Table Synthetic Data Setting6 Feb 2026
- 2026Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentation3 Feb 2026
- 2026SoK: Privacy-aware LLM in Healthcare: Threat Model, Privacy Techniques, Challenges and Recommendations15 Jan 2026
- 2025Aegis: A Correlation-Based Data Masking Advisor for Data Sharing Ecosystems12 Oct 2025
- 2025Privacy Auditing Synthetic Data Release through Local Likelihood Attacks28 Aug 2025
- 2025SoK: Data Minimization in Machine Learning14 Aug 2025
- 2025SoK: Can Synthetic Images Replace Real Data? A Survey of Utility and Privacy of Synthetic Image Generation24 Jun 2025
- 2025Synthetic Tabular Data: Methods, Attacks and Defenses6 Jun 2025
- 2025SMOTE-DP: Improving Privacy-Utility Tradeoff with Synthetic Data2 Jun 2025
- 2025Quantitative Auditing of AI Fairness with Differentially Private Synthetic Data30 Apr 2025
- 2025A False Sense of Privacy: Evaluating Textual Data Sanitization Beyond Surface-level Privacy Leakage28 Apr 2025
- 2025DeSIA: Attribute Inference Attacks Against Limited Fixed Aggregate Statistics25 Apr 2025
- 2025GenEAva: Generating Cartoon Avatars with Fine-Grained Facial Expressions from Realistic Diffusion-based Faces10 Apr 2025
- 2025Generating Synthetic Data with Formal Privacy Guarantees: State of the Art and the Road Ahead26 Mar 2025
- 2025A Consensus Privacy Metrics Framework for Synthetic Data6 Mar 2025
- 2025The Canary's Echo: Auditing Privacy Risks of LLM-Generated Synthetic Text19 Feb 2025
- 2025Trustworthy AI: Safety, Bias, and Privacy -- A Survey11 Feb 2025
- 2025Synthetic Data Privacy Metrics7 Jan 2025
- 2024DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generators3 Dec 2024
- 2024Adversarial Sample-Based Approach for Tighter Privacy Auditing in Final Model-Only Scenarios2 Dec 2024
- 2024Establishing and Evaluating Trustworthy AI: Overview and Research Challenges15 Nov 2024
- 2024Tabular Data Synthesis with Differential Privacy: A Survey4 Nov 2024
- 2024Private Synthetic Text Generation with Diffusion Models30 Oct 2024
- 2024Privacy without Noisy Gradients: Slicing Mechanism for Generative Model Training25 Oct 2024
- 2024Privacy-hardened and hallucination-resistant synthetic data generation with logic-solvers22 Oct 2024
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Data7 Oct 2024
- 2024Synthetic Data: Revisiting the Privacy-Utility Trade-off9 Jul 2024
- 2024A Zero Auxiliary Knowledge Membership Inference Attack on Aggregate Location Data26 Jun 2024
- 2024SoK: Membership Inference Attacks on LLMs are Rushing Nowhere (and How to Fix It)25 Jun 2024
- 2024Automated Privacy-Preserving Techniques via Meta-Learning24 Jun 2024
- 2024Synthetic Data Outliers: Navigating Identity Disclosure4 Jun 2024
50 newest of 105 All 105 (JSON)
- 2023Differentially Private Diffusion Models Generate Useful Synthetic Imagescited by 85
- 2023Membership Inference Attacks against Diffusion Modelscited by 84
- 2024ClavaDDPM: Multi-relational Data Synthesis with Cluster-guided Diffusion Modelscited by 28
- 2023Membership Inference Attacks on Diffusion Models via Quantile Regressioncited by 17
- 2024Private Synthetic Text Generation with Diffusion Modelscited by 10
- 2024DP-TLDM: Differentially Private Tabular Latent Diffusion Modelcited by 5
- 2026MIDST Challenge at SaTML 2025: Membership Inference over Diffusion-models-based Synthetic Tabular datacited by 2
- 2025GenEAva: Generating Cartoon Avatars with Fine-Grained Facial Expressions from Realistic Diffusion-based Facescited by 0
- 2026SYNTHONY: A Stress-Aware, Intent-Conditioned Agent for Deep Tabular Generative Models Selectioncited by 0
- 2026SYNTHONY: A Stress-Aware, Intent-Conditioned Agent for Deep Tabular Generative Models Selection31 Mar 2026
- 2026MIDST Challenge at SaTML 2025: Membership Inference over Diffusion-models-based Synthetic Tabular data19 Mar 2026
- 2025GenEAva: Generating Cartoon Avatars with Fine-Grained Facial Expressions from Realistic Diffusion-based Faces10 Apr 2025
- 2024Private Synthetic Text Generation with Diffusion Models30 Oct 2024
- 2024ClavaDDPM: Multi-relational Data Synthesis with Cluster-guided Diffusion Models28 May 2024
- 2024DP-TLDM: Differentially Private Tabular Latent Diffusion Model12 Mar 2024
- 2023Membership Inference Attacks on Diffusion Models via Quantile Regression8 Dec 2023
- 2023Differentially Private Diffusion Models Generate Useful Synthetic Images27 Feb 2023
- 2023Membership Inference Attacks against Diffusion Models7 Feb 2023
- 2024SoK: Membership Inference Attacks on LLMs are Rushing Nowhere (and How to Fix It)cited by 54
- 2023Synthetic is all you need: removing the auxiliary data assumption for membership inference attacks against synthetic datacited by 18
- 2025Trustworthy AI: Safety, Bias, and Privacy -- A Surveycited by 5
- 2022Provable Membership Inference Privacycited by 4
- 2024A Zero Auxiliary Knowledge Membership Inference Attack on Aggregate Location Datacited by 3
- 2026Finding Connections: Membership Inference Attacks for the Multi-Table Synthetic Data Settingcited by 2
- 2024Lost in the Averages: A New Specific Setup to Evaluate Membership Inference Attacks Against Machine Learning Modelscited by 0
- 2026ReMIA: a Powerful and Efficient Alternative to Membership Inference Attacks against Synthetic Data Generatorscited by 0
- 2026Subgroup Membership Inference Audits of Differentially Private Synthetic Textcited by 0
- 2026Subgroup Membership Inference Audits of Differentially Private Synthetic Text9 Sep 2026
- 2026ReMIA: a Powerful and Efficient Alternative to Membership Inference Attacks against Synthetic Data Generators14 May 2026
- 2026Finding Connections: Membership Inference Attacks for the Multi-Table Synthetic Data Setting6 Feb 2026
- 2025Trustworthy AI: Safety, Bias, and Privacy -- A Survey11 Feb 2025
- 2024A Zero Auxiliary Knowledge Membership Inference Attack on Aggregate Location Data26 Jun 2024
- 2024SoK: Membership Inference Attacks on LLMs are Rushing Nowhere (and How to Fix It)25 Jun 2024
- 2024Lost in the Averages: A New Specific Setup to Evaluate Membership Inference Attacks Against Machine Learning Models24 May 2024
- 2023Synthetic is all you need: removing the auxiliary data assumption for membership inference attacks against synthetic data4 Jul 2023
- 2022Provable Membership Inference Privacy12 Nov 2022
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2022Synthetic Data -- what, why and how?cited by 66
- 2022TAPAS: a Toolbox for Adversarial Privacy Auditing of Synthetic Datacited by 56
- 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
- 2022Privacy-friendly Synthetic Data for the Development of Face Morphing Attack Detectorscited by 47
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2023SoK: Privacy-Preserving Data Synthesiscited by 37
- 2023Beyond Privacy: Navigating the Opportunities and Challenges of Synthetic Datacited by 29
- 2023Achilles' Heels: Vulnerable Record Identification in Synthetic Data Publishingcited by 28
- 2022Generating multivariate time series with COmmon Source CoordInated GAN (COSCI-GAN)cited by 23
- 2023A Linear Reconstruction Approach for Attribute Inference Attacks against Synthetic Datacited by 23
12 most cited of 84 All 84 (JSON)
- 2026Collaborative Synthetic Data for Privacy-Preserving Financial Fraud Detection Across Organizational Silos27 Sep 2026
- 2026PEARL: A Task-Aware Framework for Evaluating Differentially Private Synthetic Educational Data8 Sep 2026
- 2026Position: Privacy Is a Claim, Not a Property of Synthetic Data1 Sep 2026
- 2026Protecting patient privacy in clinical foundation models: Technical and legal perspectives7 Aug 2026
- 2026Privacy-Aware Synthetic Video Benchmarking and Relational Evaluation for Worker-Under-Suspended-Load Detection17 Jul 2026
- 2026Privacy Leakage in Federated Learning in Radiology Reports: A Comparative Evaluation of Tokenizer-Driven Privacy Risks15 Jul 2026
- 2026Where to Intervene? Benchmarking Fairness-Aware Learning on Differentially Private Synthetic Tabular Data8 Jul 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026LLM-as-a-Discriminator: When Synthetic Tables Still Look Real1 Jun 2026
- 2026PrivFusion: A Privacy-preserving Multi-Agent Framework for Harmonizing Distributed Datasets22 May 2026
- 2026On Privacy in Data-Space Tabular Diffusion Models: Influential Factors, Attacker Knowledge, and Metrics7 May 2026
- 2026Decoupling Identity from Utility: Privacy-by-Design Frameworks for Financial Ecosystems16 Apr 2026
12 newest of 84 All 84 (JSON)