Is Diffusion Model Safe? Severe Data Leakage via Gradient-Guided Diffusion Model
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are restricted to reconstructing low-resolution images where data leakage risks of image processing systems are not sufficiently explored. In this paper, by exploiting diffusion models, we propose an innovative gradient-guided fine-tuning method and introduce a new reconstruction attack that is capable of stealing private, high-resolution images from image processing systems through leaked gradients where severe data leakage encounters. Our attack method is easy to implement and requires little prior knowledge. The experimental results indicate that current reconstruction attacks can steal images only up to a resolution of 128 × 128 pixels, while our attack method can successfully recover and steal images with resolutions up to 512 × 512 pixels. Our attack method significantly outperforms the SOTA attack baselines in terms of both pixel-wise accuracy and time efficiency of image reconstruction. Furthermore, our attack can render differential privacy ineffective to some extent.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 24 of its 33 references that are in the map. First posted on arXiv 13 Jun 2024.
Builds on
24 of 33 references.
References · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
12 more
- 2019Deep Leakage from Gradientscited by 1,004
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 707
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 509
- 2020iDLG: Improved Deep Leakage from Gradientscited by 367
- 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 326
- 2021See through Gradients: Image Batch Recovery via GradInversioncited by 320
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
- 2021Gradient Inversion with Generative Image Priorcited by 101
- 2022Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakagecited by 72
- 2023GIFD: A Generative Gradient Inversion Method with Feature Domain Optimizationcited by 45
- 2015FireCaffe: near-linear acceleration of deep neural network training on compute clusterscited by 25
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Data Forensics in Diffusion Models: A Systematic Analysis of Membership Privacy
- 2024Visual Privacy Auditing with Diffusion Models
- 2024Gradient Inversion of Federated Diffusion Models
- 2025DRAG: Data Reconstruction Attack using Guided Diffusion
- 2023Unlearnable Examples for Diffusion Models: Protect Data from Unauthorized Exploitation
- 2026Public Diffusion Models, Private Images: Key-Controlled Inversion for Conditional Reconstruction
- 2023Black-box Membership Inference Attacks against Fine-tuned Diffusion Models
- 2026Protecting Sensitive Data in Image Synthesis via PAC-Private Adaptation for Diffusion Models