Enhancing Facial Privacy Protection via Weakening Diffusion Purification
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
The rapid growth of social media has led to the widespread sharing of individual portrait images, which pose serious privacy risks due to the capabilities of automatic face recognition (AFR) systems for mass surveillance. Hence, protecting facial privacy against unauthorized AFR systems is essential. Inspired by the generation capability of the emerging diffusion models, recent methods employ diffusion models to generate adversarial face images for privacy protection. However, they suffer from the diffusion purification effect, leading to a low protection success rate (PSR). In this paper, we first propose learning unconditional embeddings to increase the learning capacity for adversarial modifications and then use them to guide the modification of the adversarial latent code to weaken the diffusion purification effect. Moreover, we integrate an identity-preserving structure to maintain structural consistency between the original and generated images, allowing human observers to recognize the generated image as having the same identity as the original. Extensive experiments conducted on two public datasets, i.e., CelebA-HQ and LADN, demonstrate the superiority of our approach. The protected faces generated by our method outperform those produced by existing facial privacy protection approaches in terms of transferability and natural appearance.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 44 of its 55 references that are in the map. First posted on arXiv 13 Mar 2025.
Builds on
44 of 55 references.
Closest ancestors · 6
Same direction, newest first
- 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protection16 May
- 2023Purify++: Improving Diffusion-Purification with Advanced Diffusion Models and Control of Randomness28 Oct
- 2023DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protection23 May
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attack14 May
- 2022(Certified!!) Adversarial Robustness for Free!21 Jun
- 2022Diffusion Models for Adversarial Purification16 May
Other references · 38
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
26 more
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
- 2018Deep Face Recognition: A Surveycited by 276
- 2021Improving Robustness using Generated Datacited by 234
- 2018MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devicescited by 182
- 2019AdvHat: Real-world adversarial attack on ArcFace Face ID systemcited by 163
- 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editingcited by 135
- 2021Adv-Makeup: A New Imperceptible and Transferable Attack on Face Recognitioncited by 97
- 2017A General Framework for Adversarial Examples with Objectivescited by 84
- 2021Improving Transferability of Adversarial Patches on Face Recognition with Generative Modelscited by 80
- 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 78
- 2023Robust Evaluation of Diffusion-Based Adversarial Purificationcited by 65
- 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 64
- 2020Towards Face Encryption by Generating Adversarial Identity Maskscited by 63
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 43
- 2018Attacks on State-of-the-Art Face Recognition using Attentional Adversarial Attack Generative Networkcited by 38
- 2022An Overview of Privacy-enhancing Technologies in Biometric Recognitioncited by 17
- 2024Exploring Frequencies via Feature Mixing and Meta-Learning for Improving Adversarial Transferabilitycited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025Non-Adaptive Adversarial Face Generationcited by 2
- 2026FDeID-Toolbox: Face De-Identification Toolboxcited by 1
- 2026Flux-Guard: Facial Identity Protection using diffusion modelscited by 1
- 2026FaceLinkGen: A Re-evaluation of Identity Leakage in Privacy-Preserving Face Recognition and Face Anonymization Systems Using Simple Distillationcited by 0
- 2026Face De-Identification: A Domain-Centric Survey from Capture to Processingcited by 0
- 2026Casting the Net! Revisiting MasterFace Impersonation Attackscited by 0
- 2026Anti-Persona: Disrupting Unauthorized Identity Binding and Recognition in Personalized Vision--Language Modelscited by 0
- 2026Anti-Persona: Disrupting Unauthorized Identity Binding and Recognition in Personalized Vision--Language Models1 Oct 2026
- 2026Casting the Net! Revisiting MasterFace Impersonation Attacks7 Aug 2026
- 2026Face De-Identification: A Domain-Centric Survey from Capture to Processing28 Jul 2026
- 2026Flux-Guard: Facial Identity Protection using diffusion models16 Jun 2026
- 2026FDeID-Toolbox: Face De-Identification Toolbox13 Mar 2026
- 2026FaceLinkGen: A Re-evaluation of Identity Leakage in Privacy-Preserving Face Recognition and Face Anonymization Systems Using Simple Distillation2 Feb 2026
- 2025Non-Adaptive Adversarial Face Generation16 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection
- 2023Towards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Framework
- 2025Secure and reversible face anonymization with diffusion models
- 2024Privacy Protection in Personalized Diffusion Models via Targeted Cross-Attention Adversarial Attack
- 2026Realistic Face Reconstruction from Facial Embeddings via Diffusion Models
- 2023Diff-Privacy: Diffusion-based Face Privacy Protection
- 2024Enhancing User-Centric Privacy Protection: An Interactive Framework through Diffusion Models and Machine Unlearning
- 2025Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Models