mlsanityData to 14 Oct 2026

Enhancing Facial Privacy Protection via Weakening Diffusion Purification

arXiv 2503.10350 ↗First posted 13 Mar 2025cs.CVcited by 7

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

The rapid growth of social media has led to the widespread sharing of individual portrait images, which pose serious privacy risks due to the capabilities of automatic face recognition (AFR) systems for mass surveillance. Hence, protecting facial privacy against unauthorized AFR systems is essential. Inspired by the generation capability of the emerging diffusion models, recent methods employ diffusion models to generate adversarial face images for privacy protection. However, they suffer from the diffusion purification effect, leading to a low protection success rate (PSR). In this paper, we first propose learning unconditional embeddings to increase the learning capacity for adversarial modifications and then use them to guide the modification of the adversarial latent code to weaken the diffusion purification effect. Moreover, we integrate an identity-preserving structure to maintain structural consistency between the original and generated images, allowing human observers to recognize the generated image as having the same identity as the original. Extensive experiments conducted on two public datasets, i.e., CelebA-HQ and LADN, demonstrate the superiority of our approach. The protected faces generated by our method outperform those produced by existing facial privacy protection approaches in terms of transferability and natural appearance.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 44 of its 55 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

44 of 55 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protection16 May
  2. 2023Purify++: Improving Diffusion-Purification with Advanced Diffusion Models and Control of Randomness28 Oct
  3. 2023DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protection23 May
  4. 2023Diffusion Models for Imperceptible and Transferable Adversarial Attack14 May
  5. 2022(Certified!!) Adversarial Robustness for Free!21 Jun
  6. 2022Diffusion Models for Adversarial Purification16 May

Other references · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  9. 2017Squeeze-and-Excitation Networkscited by 4,789
  10. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  12. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
26 more
  1. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  5. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  6. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  7. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  8. 2023Zero-shot Image-to-Image Translationcited by 505
  9. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
  10. 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
  11. 2018Deep Face Recognition: A Surveycited by 276
  12. 2021Improving Robustness using Generated Datacited by 234
  13. 2018MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devicescited by 182
  14. 2019AdvHat: Real-world adversarial attack on ArcFace Face ID systemcited by 163
  15. 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editingcited by 135
  16. 2021Adv-Makeup: A New Imperceptible and Transferable Attack on Face Recognitioncited by 97
  17. 2017A General Framework for Adversarial Examples with Objectivescited by 84
  18. 2021Improving Transferability of Adversarial Patches on Face Recognition with Generative Modelscited by 80
  19. 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 78
  20. 2023Robust Evaluation of Diffusion-Based Adversarial Purificationcited by 65
  21. 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 64
  22. 2020Towards Face Encryption by Generating Adversarial Identity Maskscited by 63
  23. 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 43
  24. 2018Attacks on State-of-the-Art Face Recognition using Attentional Adversarial Attack Generative Networkcited by 38
  25. 2022An Overview of Privacy-enhancing Technologies in Biometric Recognitioncited by 17
  26. 2024Exploring Frequencies via Feature Mixing and Meta-Learning for Improving Adversarial Transferabilitycited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection
  2. 2023Towards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Framework
  3. 2025Secure and reversible face anonymization with diffusion models
  4. 2024Privacy Protection in Personalized Diffusion Models via Targeted Cross-Attention Adversarial Attack
  5. 2026Realistic Face Reconstruction from Facial Embeddings via Diffusion Models
  6. 2023Diff-Privacy: Diffusion-based Face Privacy Protection
  7. 2024Enhancing User-Centric Privacy Protection: An Interactive Framework through Diffusion Models and Machine Unlearning
  8. 2025Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Models