Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulations
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Recent advances in GAN and diffusion models have significantly improved the realism and controllability of facial deepfake manipulation, raising serious concerns regarding privacy, security, and identity misuse. Proactive defenses attempt to counter this threat by injecting adversarial perturbations into images before manipulation takes place. However, existing approaches remain limited in effectiveness due to suboptimal perturbation injection strategies and are typically designed under white-box assumptions, targeting only simple GAN-based attribute editing. These constraints hinder their applicability in practical real-world scenarios. In this paper, we propose AEGIS, the first diffusion-guided paradigm in which the AdvErsarial facial images are Generated for Identity Shielding. We observe that the limited defense capability of existing approaches stems from the peak-clipping constraint, where perturbations are forcibly truncated due to a fixed L_∞-bounded. To overcome this limitation, instead of directly modifying pixels, AEGIS injects adversarial perturbations into the latent space along the DDIM denoising trajectory, thereby decoupling the perturbation magnitude from pixel-level constraints and allowing perturbations to adaptively amplify where most effective. The extensible design of AEGIS allows the defense to be expanded from purely white-box use to also support black-box scenarios through a gradient-estimation strategy. Extensive experiments across GAN and diffusion-based deepfake generators show that AEGIS consistently delivers strong defense effectiveness while maintaining high perceptual quality. In white-box settings, it achieves robust manipulation disruption, whereas in black-box settings, it demonstrates strong cross-model transferability.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 29 of its 44 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
29 of 44 references.
References · 29
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 499
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
- 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
- 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
- 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
17 more
- 2019AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networkscited by 77
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2020Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examplescited by 66
- 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
- 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
- 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakescited by 54
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
- 2022Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbationscited by 39
- 2019Learning Fixed Points in Generative Adversarial Networks: From Image-to-Image Translation to Disease Detection and Localizationcited by 38
- 2021Initiative Defense against Facial Manipulationcited by 36
- 2022Restricted Black-box Adversarial Attack Against DeepFake Face Swappingcited by 25
- 2021Attack as the Best Defense: Nullifying Image-to-image Translation GANs via Limit-aware Adversarial Attackcited by 15
- 2022Towards Benchmarking and Evaluating Deepfake Detectioncited by 15
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detectioncited by 12
- 2021Detection of Deepfake Videos Using Long Distance Attentioncited by 9
- 2024Hiding Faces in Plain Sight: Defending DeepFakes by Disrupting Face Detectioncited by 4
- 2025Towards Imperceptible Adversarial Defense: A Gradient-Driven Shield against Facial Manipulationscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping
- 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection
- 2023Adv-Diffusion: Imperceptible Adversarial Face Identity Attack via Latent Diffusion Model
- 2026Adv-TGD: Adversarial Text-Guided Diffusion for Face Recognition Impersonation Attacks
- 2023DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protection
- 2024FaceShield: Defending Facial Image against Deepfake Threats
- 2025DLADiff: A Dual-Layer Defense Framework against Fine-Tuning and Zero-Shot Customization of Diffusion Models
- 2026Universal Image Immunization against Diffusion-based Image Editing via Semantic Injection