Synthesize Privacy-Preserving High-Resolution Images via Private Textual Intermediaries
Not on the map. Why?
Abstract (arXiv)
Generating high fidelity, differentially private (DP) synthetic images offers a promising route to share and analyze sensitive visual data without compromising individual privacy. However, existing DP image synthesis methods struggle to produce high resolution outputs that faithfully capture the structure of the original data. In this paper, we introduce a novel method, referred to as Synthesis via Private Textual Intermediaries (SPTI), that can generate high resolution DP images with easy adoption. The key idea is to shift the challenge of DP image synthesis from the image domain to the text domain by leveraging state of the art DP text generation methods. SPTI first summarizes each private image into a concise textual description using image to text models, then applies a modified Private Evolution algorithm to generate DP text, and finally reconstructs images using text to image models. Notably, SPTI requires no model training, only inference with off the shelf models. Given a private dataset, SPTI produces synthetic images of substantially higher quality than prior DP approaches. On the LSUN Bedroom dataset, SPTI attains an FID equal to 26.71 under epsilon equal to 1.0, improving over Private Evolution FID of 40.36. Similarly, on MM CelebA HQ, SPTI achieves an FID equal to 33.27 at epsilon equal to 1.0, compared to 57.01 from DP fine tuning baselines. Overall, our results demonstrate that Synthesis via Private Textual Intermediaries provides a resource efficient and proprietary model compatible framework for generating high resolution DP synthetic images, greatly expanding access to private visual datasets.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
38 of 56 references.
References · 38
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Deep Learning with Differential Privacycited by 2,728
- 2022Video Diffusion Modelscited by 2,305
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2020Extracting Training Data from Large Language Modelscited by 2,189
26 more
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2023Adversarial Diffusion Distillationcited by 759
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
- 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 412
- 2021Differentially Private Fine-tuning of Language Modelscited by 400
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
- 2018Differentially Private Generative Adversarial Networkcited by 235
- 2018Improving the Gaussian Mechanism for Differential Privacy: Analytical Calibration and Optimal Denoisingcited by 218
- 2022Differentially Private Diffusion Modelscited by 119
- 2022Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipecited by 108
- 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Textcited by 76
- 2022Differentially Private Language Models for Secure Data Sharingcited by 68
- 2023Differentially Private Synthetic Data via Foundation Model APIs 1: Imagescited by 65
- 2023Harnessing large-language models to generate private synthetic textcited by 65
- 2022Exploring the Limits of Differentially Private Deep Learning with Group-wise Clippingcited by 52
- 2022Differentially Private Bias-Term Fine-tuning of Foundation Modelscited by 48
- 2024AgentStudio: A Toolkit for Building General Virtual Agentscited by 45
- 2023DP-LDMs: Differentially Private Latent Diffusion Modelscited by 29
- 2021Towards Open-World Text-Guided Face Image Generation and Manipulationcited by 25
- 2024Distilled Decoding 1: One-step Sampling of Image Auto-regressive Models with Flow Matchingcited by 18
- 2025MMDT: Decoding the Trustworthiness and Safety of Multimodal Foundation Modelscited by 14
- 2025Differentially Private Synthetic Data via APIs 3: Using Simulators Instead of Foundation Modelcited by 13
- 2025DPImageBench: A Unified Benchmark for Differentially Private Image Synthesiscited by 11
- 2022DEArt: Dataset of European Artcited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2025Struct-Bench: A Benchmark for Differentially Private Structured Text Generationcited by 7
- 2026Differentially Private Synthetic Data via APIs 4: Tabular Datacited by 2
- 2025RL-MoE: An Image-Based Privacy Preserving Approach In Intelligent Transportation Systemcited by 0
- 2026From Easy to Hard++: Promoting Differentially Private Image Synthesis Through Spatial-Frequency Curriculumcited by 0
- 2026Decomposing Private Image Generation via Coarse-to-Fine Wavelet Modelingcited by 0
- 2026Privacy-Aware Synthetic Video Benchmarking and Relational Evaluation for Worker-Under-Suspended-Load Detectioncited by 0
- 2026Understanding Private Evolution as Learning-Augmented Clusteringcited by 0
- 2026ReCast: Contract-Preserving Protection for Fixed-Interface Multimodal Reasoningcited by 0
- 2026ReCast: Contract-Preserving Protection for Fixed-Interface Multimodal Reasoning1 Oct 2026
- 2026Understanding Private Evolution as Learning-Augmented Clustering29 Sep 2026
- 2026Privacy-Aware Synthetic Video Benchmarking and Relational Evaluation for Worker-Under-Suspended-Load Detection17 Jul 2026
- 2026Differentially Private Synthetic Data via APIs 4: Tabular Data6 Jun 2026
- 2026Decomposing Private Image Generation via Coarse-to-Fine Wavelet Modeling26 Feb 2026
- 2026From Easy to Hard++: Promoting Differentially Private Image Synthesis Through Spatial-Frequency Curriculum10 Jan 2026
- 2025Struct-Bench: A Benchmark for Differentially Private Structured Text Generation12 Sep 2025
- 2025RL-MoE: An Image-Based Privacy Preserving Approach In Intelligent Transportation System7 Aug 2025