Making DeepFakes more spurious: evading deep face forgery detection via trace removal attack
Not on the map. Why?
Abstract (arXiv)
DeepFakes are raising significant social concerns. Although various DeepFake detectors have been developed as forensic countermeasures, these detectors are still vulnerable to attacks. Recently, a few attacks, principally adversarial attacks, have succeeded in cloaking DeepFake images to evade detection. However, these attacks have typical detector-specific designs, which require prior knowledge about the detector, leading to poor transferability. Moreover, these attacks only consider simple security scenarios. Less is known about how effective they are in high-level scenarios where either the detectors or the attacker's knowledge varies. In this paper, we solve the above challenges with presenting a novel detector-agnostic trace removal attack for DeepFake anti-forensics. Instead of investigating the detector side, our attack looks into the original DeepFake creation pipeline, attempting to remove all detectable natural DeepFake traces to render the fake images more "authentic". To implement this attack, first, we perform a DeepFake trace discovery, identifying three discernible traces. Then a trace removal network (TR-Net) is proposed based on an adversarial learning framework involving one generator and multiple discriminators. Each discriminator is responsible for one individual trace representation to avoid cross-trace interference. These discriminators are arranged in parallel, which prompts the generator to remove various traces simultaneously. To evaluate the attack efficacy, we crafted heterogeneous security scenarios where the detectors were embedded with different levels of defense and the attackers' background knowledge of data varies. The experimental results show that the proposed attack can significantly compromise the detection accuracy of six state-of-the-art DeepFake detectors while causing only a negligible loss in visual quality to the original DeepFake samples.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 47 of its 62 references that are in the map. First posted on arXiv 22 Mar 2022.
Builds on
47 of 62 references.
References · 47
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2016Adversarial examples in the physical worldcited by 1,769
35 more
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,318
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2016An overview of gradient descent optimization algorithmscited by 1,033
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
- 2018Do GANs leave artificial fingerprints?cited by 190
- 2019Fourier Spectrum Discrepancies in Deep Network Generated Imagescited by 139
- 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 120
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
- 2021A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detectioncited by 68
- 2020Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examplescited by 66
- 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
- 2020Adversarial Perturbations Fool Deepfake Detectorscited by 48
- 2020Adversarial Threats to DeepFake Detection: A Practical Perspectivecited by 48
- 2019GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detectioncited by 42
- 2020FakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstructioncited by 33
- 2021Towards Solving the DeepFake Problem : An Analysis on Improving DeepFake Detection using Dynamic Face Augmentationcited by 25
- 2021Learning to Disentangle GAN Fingerprint for Fake Image Attributioncited by 20
- 2018On the Transferability of Adversarial Examples Against CNN-Based Image Forensicscited by 12
- 2020Perception Matters: Exploring Imperceptible and Transferable Anti-forensics for GAN-generated Fake Face Imagery Detectioncited by 7
- 2021The Effect of Class Definitions on the Transferability of Adversarial Attacks Against Forensic CNNscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 5; 2024: 3; 2025: 4; 2026: 3.
16 papers.
Sort:
By area:
- 2022Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cuescited by 24
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 13
- 2024StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Modelcited by 12
- 2024Adversarial Robustness of AI-Generated Image Detectors in the Real Worldcited by 7
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Modelscited by 6
- 2023Towards Robust GAN-generated Image Detection: a Multi-view Completion Representationcited by 5
- 2023Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrogramscited by 4
- 2023Low-frequency Image Deep Steganography: Manipulate the Frequency Distribution to Hide Secrets with Tenacious Robustnesscited by 3
- 2025FA^{3}-CLIP: Frequency-Aware Cues Fusion and Attack-Agnostic Prompt Learning for Unified Face Attack Detectioncited by 3
- 2023Sequential training of GANs against GAN-classifiers reveals correlated "knowledge gaps" present among independently trained GAN instancescited by 1
- 2025Untraceable DeepFakes via Traceable Fingerprint Eliminationcited by 1
- 2025Causal Fingerprints of AI Generative Modelscited by 1
4 more
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detectioncited by 1
- 2026Attention to Neural Plagiarism: Diffusion Models Can Plagiarize Your Copyrighted Images!cited by 1
- 2026Hide&Seek: Remove Image Watermarks with Negligible Cost via Pixel-wise Reconstructioncited by 1
- 2026Semantic Manipulation Localizationcited by 1
- 2026Semantic Manipulation Localization11 Apr 2026
- 2026Hide&Seek: Remove Image Watermarks with Negligible Cost via Pixel-wise Reconstruction1 Mar 2026
- 2026Attention to Neural Plagiarism: Diffusion Models Can Plagiarize Your Copyrighted Images!25 Feb 2026
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detection25 Nov 2025
- 2025Causal Fingerprints of AI Generative Models18 Sep 2025
- 2025Untraceable DeepFakes via Traceable Fingerprint Elimination5 Aug 2025
- 2025FA^{3}-CLIP: Frequency-Aware Cues Fusion and Attack-Agnostic Prompt Learning for Unified Face Attack Detection1 Apr 2025
- 2024Adversarial Robustness of AI-Generated Image Detectors in the Real World2 Oct 2024
- 2024StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model11 Aug 2024
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authentication15 Jul 2024
- 2023Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms18 Aug 2023
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models11 Jul 2023
4 more
- 2023Towards Robust GAN-generated Image Detection: a Multi-view Completion Representation2 Jun 2023
- 2023Sequential training of GANs against GAN-classifiers reveals correlated "knowledge gaps" present among independently trained GAN instances27 Mar 2023
- 2023Low-frequency Image Deep Steganography: Manipulate the Frequency Distribution to Hide Secrets with Tenacious Robustness23 Mar 2023
- 2022Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues10 Aug 2022
- 2024StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Modelcited by 12
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Modelscited by 6
- 2026Attention to Neural Plagiarism: Diffusion Models Can Plagiarize Your Copyrighted Images!cited by 1
- 2026Attention to Neural Plagiarism: Diffusion Models Can Plagiarize Your Copyrighted Images!25 Feb 2026
- 2024StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model11 Aug 2024
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models11 Jul 2023
- 2022Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cuescited by 24
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 13
- 2024Adversarial Robustness of AI-Generated Image Detectors in the Real Worldcited by 7
- 2023Towards Robust GAN-generated Image Detection: a Multi-view Completion Representationcited by 5
- 2023Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrogramscited by 4
- 2023Low-frequency Image Deep Steganography: Manipulate the Frequency Distribution to Hide Secrets with Tenacious Robustnesscited by 3
- 2025FA^{3}-CLIP: Frequency-Aware Cues Fusion and Attack-Agnostic Prompt Learning for Unified Face Attack Detectioncited by 3
- 2023Sequential training of GANs against GAN-classifiers reveals correlated "knowledge gaps" present among independently trained GAN instancescited by 1
- 2025Untraceable DeepFakes via Traceable Fingerprint Eliminationcited by 1
- 2025Causal Fingerprints of AI Generative Modelscited by 1
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detectioncited by 1
- 2026Hide&Seek: Remove Image Watermarks with Negligible Cost via Pixel-wise Reconstructioncited by 1
12 most cited of 13 All 13 (JSON)
- 2026Semantic Manipulation Localization11 Apr 2026
- 2026Hide&Seek: Remove Image Watermarks with Negligible Cost via Pixel-wise Reconstruction1 Mar 2026
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detection25 Nov 2025
- 2025Causal Fingerprints of AI Generative Models18 Sep 2025
- 2025Untraceable DeepFakes via Traceable Fingerprint Elimination5 Aug 2025
- 2025FA^{3}-CLIP: Frequency-Aware Cues Fusion and Attack-Agnostic Prompt Learning for Unified Face Attack Detection1 Apr 2025
- 2024Adversarial Robustness of AI-Generated Image Detectors in the Real World2 Oct 2024
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authentication15 Jul 2024
- 2023Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms18 Aug 2023
- 2023Towards Robust GAN-generated Image Detection: a Multi-view Completion Representation2 Jun 2023
- 2023Sequential training of GANs against GAN-classifiers reveals correlated "knowledge gaps" present among independently trained GAN instances27 Mar 2023
- 2023Low-frequency Image Deep Steganography: Manipulate the Frequency Distribution to Hide Secrets with Tenacious Robustness23 Mar 2023
12 newest of 13 All 13 (JSON)