mlsanityData to 14 Oct 2026

Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editing

arXiv 2411.16832 ↗First posted 25 Nov 2024cs.CV cs.AI cs.LGcited by 21

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

Recent advancements in diffusion models have made generative image editing more accessible, enabling creative edits but raising ethical concerns, particularly regarding malicious edits to human portraits that threaten privacy and identity security. Existing protection methods primarily rely on adversarial perturbations to nullify edits but often fail against diverse editing requests. We propose FaceLock, a novel approach to portrait protection that optimizes adversarial perturbations to destroy or significantly alter biometric information, rendering edited outputs biometrically unrecognizable. FaceLock integrates facial recognition and visual perception into perturbation optimization to provide robust protection against various editing attempts. We also highlight flaws in commonly used evaluation metrics and reveal how they can be manipulated, emphasizing the need for reliable assessments of protection. Experiments show FaceLock outperforms baselines in defending against malicious edits and is robust against purification techniques. Ablation studies confirm its stability and broad applicability across diffusion-based editing algorithms. Our work advances biometric defense and sets the foundation for privacy-preserving practices in image editing. The code is available at: https://github.com/taco-group/FaceLock.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 48 of its 71 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

48 of 71 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May
  2. 2023EditShield: Protecting Unauthorized Image Editing by Instruction-guided Diffusion Models19 Nov
  3. 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
  4. 2023On the Robustness of Latent Diffusion Models14 Jun
  5. 2023A Pilot Study of Query-Free Adversarial Attack against Stable Diffusion29 Mar
  6. 2023Raising the Cost of Malicious AI-Powered Image Editing13 Feb
  7. 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples9 Feb
  8. 2022Diffusion Models for Adversarial Purification16 May

Other references · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
  8. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  11. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  12. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
28 more
  1. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
  2. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  3. 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
  4. 2021MagFace: A Universal Representation for Face Recognition and Quality Assessmentcited by 334
  5. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
  6. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
  7. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
  8. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
  9. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  10. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
  11. 2021ElasticFace: Elastic Margin Loss for Deep Face Recognitioncited by 144
  12. 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
  13. 2021SynFace: Face Recognition with Synthetic Datacited by 106
  14. 2021Revisiting and Advancing Fast Adversarial Training Through The Lens of Bi-Level Optimizationcited by 76
  15. 2022SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Datacited by 63
  16. 2023Custom-Edit: Text-Guided Image Editing with Customized Diffusion Modelscited by 54
  17. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  18. 2023Photoswap: Personalized Subject Swapping in Imagescited by 47
  19. 2023Highly Personalized Text Embedding for Image Manipulation by Stable Diffusioncited by 39
  20. 2024Light the Night: A Multi-Condition Diffusion Framework for Unpaired Low-Light Enhancement in Autonomous Drivingcited by 35
  21. 2022Fairness Reprogrammingcited by 33
  22. 2023Robust Mixture-of-Expert Training for Convolutional Neural Networkscited by 30
  23. 2022Unsupervised Face Recognition using Unlabeled Synthetic Datacited by 27
  24. 2023Identity-driven Three-Player Generative Adversarial Network for Synthetic-based Face Recognitioncited by 27
  25. 2023Diff-Privacy: Diffusion-based Face Privacy Protectioncited by 26
  26. 2021QMagFace: Simple and Accurate Quality-Aware Face Recognitioncited by 25
  27. 2023SPIRE: Semantic Prompt-Driven Image Restorationcited by 24
  28. 2022Distributed Adversarial Training to Robustify Deep Neural Networks at Scalecited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 12.

21 papers.

Sort:

By area:

  1. 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editingcited by 10
  2. 2025ClimateLLM: Efficient Weather Forecasting via Frequency-Aware Large Language Modelscited by 9
  3. 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
  4. 2025DeContext as Defense: Safe Image Editing in Diffusion Transformerscited by 7
  5. 2026Universal Image Immunization against Diffusion-based Image Editing via Semantic Injectioncited by 7
  6. 2025GuardDoor: Safeguarding Against Malicious Diffusion Editing via Protective Backdoorscited by 5
  7. 2025BlurGuard: A Simple Approach for Robustifying Image Protection Against AI-Powered Editingcited by 5
  8. 2026BadWorld: Adversarial Attacks on World Modelscited by 5
  9. 2025HFMF: Hierarchical Fusion Meets Multi-Stream Models for Deepfake Detectioncited by 4
  10. 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 2
  11. 2025Dual Attention Guided Defense Against Malicious Editscited by 1
  12. 2026Safeguarding Facial Identity against Diffusion-based Face Swapping via Cascading Pathway Disruptioncited by 1
9 more
  1. 2026CoEditor++: Instruction-based Visual Editing via Cognitive Reasoningcited by 1
  2. 2026Do Protective Perturbations Really Protect Portrait Privacy under Real-world Image Transformations?cited by 1
  3. 2025HeadsUp! High-Fidelity Portrait Image Super-Resolutioncited by 0
  4. 2026PRIVATEEDIT: A Privacy-Preserving Pipeline for Face-Centric Generative Image Editingcited by 0
  5. 2026NullEdit: Stealthy Image Protection via VLM Condition Redirectioncited by 0
  6. 2026Audio-Driven Adversarial Defense for 3D Talking Face Generation with totally Visual Fidelity Preservationcited by 0
  7. 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalitiescited by 0
  8. 2026No Way To Steal My Face: Proactive Defense Against Identity-Preserving Personalized Generationcited by 0
  9. 2026A Valid Watermark Is Not a Valid Identity: Spatial-Spectral Adversarial Face Evasion with Watermark Preservationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Flux-Guard: Facial Identity Protection using diffusion models
  2. 2026Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editing
  3. 2026Protective Perturbations Must Survive the Resize: Scale-Robust Image Immunization against Malicious Editing
  4. 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing
  5. 2024Attack as Defense: Run-time Backdoor Implantation for Image Content Protection ↗
  6. 2026Hierarchical Anti-Aesthetics: Protecting Facial Privacy against Customized Diffusion Models
  7. 2025Anti-Aesthetics: Protecting Facial Privacy against Customized Text-to-Image Synthesis
  8. 2026Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch