Privacy-Preserving Synthetic Review Generation with Diverse Writing Styles Using LLMs
On the map: Synthetic data and self-improvement for LLMs → Privacy-preserving tabular data synthesis
Abstract (arXiv)
The increasing use of synthetic data generated by Large Language Models (LLMs) presents both opportunities and challenges in data-driven applications. While synthetic data provides a cost-effective, scalable alternative to real-world data to facilitate model training, its diversity and privacy risks remain underexplored. Focusing on text-based synthetic data, we propose a comprehensive set of metrics to quantitatively assess the diversity (i.e., linguistic expression, sentiment, and user perspective), and privacy (i.e., re-identification risk and stylistic outliers) of synthetic datasets generated by several state-of-the-art LLMs. Experiment results reveal significant limitations in LLMs' capabilities in generating diverse and privacy-preserving synthetic data. Guided by the evaluation results, a prompt-based approach is proposed to enhance the diversity of synthetic reviews while preserving reviewer privacy.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Privacy-preserving tabular data synthesis, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 10 of its 16 references that are in the map. First posted on arXiv 24 Jul 2025.
Builds on
10 of 16 references.
References · 10
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 186
- 2019Jointly Measuring Diversity and Quality in Text Generation Modelscited by 61
- 2024On the Diversity of Synthetic Data and its Impact on Training Large Language Modelscited by 59
- 2024Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scorescited by 50
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Futurecited by 33
- 2024SynthEval: A Framework for Detailed Utility and Privacy Evaluation of Tabular Synthetic Datacited by 27
- 2021Directed Diversity: Leveraging Language Embedding Distances for Collective Creativity in Crowd Ideationcited by 23
- 2024Synthetic Data in AI: Challenges, Applications, and Ethical Implicationscited by 21
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumventioncited by 21
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024A Multi-Faceted Evaluation Framework for Assessing Synthetic Data Generated by Large Language Models
- 2024A Synthetic Dataset for Personal Attribute Inference
- 2024Evaluating Differentially Private Synthetic Data Generation in High-Stakes Domains
- 2024Generated Data with Fake Privacy: Hidden Dangers of Fine-tuning Large Language Models on Generated Data
- 2025SynBench: A Benchmark for Differentially Private Text Generation
- 2024Private Synthetic Text Generation with Diffusion Models
- 2026Private Seeds, Public LLMs: Realistic and Privacy-Preserving Synthetic Data Generation
- 2025Synthetic Eggs in Many Baskets: The Impact of Synthetic Data Diversity on LLM Fine-Tuning