mlsanityData to 7 Oct 2026

Controllable Adversarial Makeup for Privacy via Text-Guided Diffusion

arXiv 2503.10549 ↗First posted 13 Mar 2025cs.CV cs.CRcited by 0

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

As face recognition becomes more widespread in government and commercial services, its potential misuse raises serious concerns about privacy and civil rights. To counteract this threat, various anti-facial recognition techniques have been proposed, which protect privacy by adversarially perturbing face images. Among these, generative makeup-based approaches are the most widely studied. However, these methods, designed primarily to impersonate specific target identities, can only achieve weak dodging success rates while increasing the risk of targeted abuse. In addition, they often introduce global visual artifacts or a lack of adaptability to accommodate diverse makeup prompts, compromising user satisfaction. To address the above limitations, we develop MASQUE, a novel diffusion-based framework that generates localized adversarial makeups guided by user-defined text prompts. Built upon precise null-text inversion, customized cross-attention fusion with masking, and a pairwise adversarial guidance mechanism using images of the same individual, MASQUE achieves robust dodging performance without requiring any external identity. Comprehensive evaluations on open-source facial recognition models and commercial APIs demonstrate that MASQUE significantly improves dodging success rates over all baselines, along with higher perceptual fidelity preservation, stronger adaptability to various makeup prompts, and robustness to image transformations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 33 of its 45 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

33 of 45 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protection16 May
  2. 2023Adv-Diffusion: Imperceptible Adversarial Face Identity Attack via Latent Diffusion Model18 Dec
  3. 2023DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protection23 May
  4. 2022Diffusion Models for Adversarial Purification16 May

Other references · 29

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2017Squeeze-and-Excitation Networkscited by 4,763
  7. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  10. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  11. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  12. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
17 more
  1. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  2. 2022Blended Latent Diffusioncited by 430
  3. 2018MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devicescited by 180
  4. 2019AdvHat: Real-world adversarial attack on ArcFace Face ID systemcited by 161
  5. 2021Adv-Makeup: A New Imperceptible and Transferable Attack on Face Recognitioncited by 95
  6. 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 92
  7. 2021Improving Transferability of Adversarial Patches on Face Recognition with Generative Modelscited by 80
  8. 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 77
  9. 2020Towards Face Encryption by Generating Adversarial Identity Maskscited by 62
  10. 2017Natural and Effective Obfuscation by Head Inpaintingcited by 60
  11. 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
  12. 2017Adversarial Image Perturbation for Privacy Protection -- A Game Theory Perspectivecited by 38
  13. 2022OPOM: Customized Invisible Cloak towards Face Privacy Protectioncited by 22
  14. 2023MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidancecited by 21
  15. 2021SoK: Anti-Facial Recognition Technologycited by 16
  16. 2024Rethinking Impersonation and Dodging Attacks on Face Recognition Systemscited by 7
  17. 2025DivTrackee versus DynTracker: Promoting Diversity in Anti-Facial Recognition against Dynamic FR Strategycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Towards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Framework
  2. 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection
  3. 2026Adv-TGD: Adversarial Text-Guided Diffusion for Face Recognition Impersonation Attacks
  4. 2023SimAC: A Simple Anti-Customization Method for Protecting Face Privacy against Text-to-Image Synthesis of Diffusion Models
  5. 2024Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation
  6. 2024Privacy Protection in Personalized Diffusion Models via Targeted Cross-Attention Adversarial Attack
  7. 2025Enhancing Facial Privacy Protection via Weakening Diffusion Purification
  8. 2025Facial Attribute Based Text Guided Face Anonymization