Adversarial Perturbations Fool Deepfake Detectors
Not on the map. Why?
Abstract (arXiv)
This work uses adversarial perturbations to enhance deepfake images and fool common deepfake detectors. We created adversarial perturbations using the Fast Gradient Sign Method and the Carlini and Wagner L2 norm attack in both blackbox and whitebox settings. Detectors achieved over 95% accuracy on unperturbed deepfakes, but less than 27% accuracy on perturbed deepfakes. We also explore two improvements to deepfake detectors: (i) Lipschitz regularization, and (ii) Deep Image Prior (DIP). Lipschitz regularization constrains the gradient of the detector with respect to the input in order to increase robustness to input perturbations. The DIP defense removes perturbations using generative convolutional neural networks in an unsupervised manner. Regularization improved the detection of perturbed deepfakes on average, including a 10% accuracy boost in the blackbox case. The DIP defense achieved 95% accuracy on perturbed deepfakes that fooled the original detector, while retaining 98% accuracy in other cases on a 100 image subsample.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 13; 2024: 9; 2025: 6; 2026: 3.
48 papers.
Sort:
By area:
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 65
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2022Deepfake Text Detection: Limitations and Opportunitiescited by 37
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Modelscited by 36
- 2022GAN-generated Faces Detection: A Survey and New Perspectivescited by 29
- 2022FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakescited by 18
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
36 more
- 2022Making DeepFakes more spurious: evading deep face forgery detection via trace removal attackcited by 16
- 2023AI-Generated Images as Data Source: The Dawn of Synthetic Eracited by 13
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detectioncited by 12
- 2021TANTRA: Timing-Based Adversarial Network Traffic Reshaping Attackcited by 11
- 2022D4: Detection of Adversarial Diffusion Deepfakes Using Disjoint Ensemblescited by 11
- 2024Towards Understanding Unsafe Video Generationcited by 10
- 2023Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Modelscited by 9
- 2025DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Modelscited by 7
- 2021Understanding the Security of Deepfake Detectioncited by 6
- 2022The MeVer DeepFake Detection Service: Lessons Learnt from Developing and Deploying in the Wildcited by 6
- 2022Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigationcited by 6
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Modelscited by 6
- 2024DeepFeatureX Net: Deep Features eXtractors based Network for discriminating synthetic from real imagescited by 6
- 2024Adversarial Robustness of AI-Generated Image Detectors in the Real Worldcited by 6
- 2022Deepfake Style Transfer Mixture: a First Forensic Ballistics Study on Synthetic Imagescited by 4
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectorscited by 4
- 2026SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detectioncited by 4
- 2023Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detectioncited by 3
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detectioncited by 3
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detectioncited by 2
- 2023ForensicsForest Family: A Series of Multi-scale Hierarchical Cascade Forests for Detecting GAN-generated Facescited by 2
- 20242D-Malafide: Adversarial Attacks Against Face Deepfake Detection Systemscited by 2
- 2026Do Transformations Reveal the Truth? Generative Residual Learning for Generalized AI-Generated Image Detectioncited by 2
- 2023Improving Video Deepfake Detection: A DCT-Based Approach with Patch-Level Analysiscited by 1
- 2024Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learningcited by 1
- 2025CAE-Net: Generalized Deepfake Image Detection using Convolution and Attention Mechanisms with Spatial and Frequency Domain Featurescited by 1
- 2025Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?cited by 1
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detectioncited by 1
- 2021Imperceptible Adversarial Examples for Fake Image Detectioncited by 0
- 2023Open-World Object Detection via Discriminative Class Prototype Learningcited by 0
- 2023Cross-domain Robust Deepfake Bias Expansion Network for Face Forgery Detectioncited by 0
- 2024Active Fake: DeepFake Camouflagecited by 0
- 2024Deep Learning Technology for Face Forgery Detection: A Surveycited by 0
- 2026ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectorscited by 0
- 2026ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectors16 Jul 2026
- 2026Do Transformations Reveal the Truth? Generative Residual Learning for Generalized AI-Generated Image Detection9 Jul 2026
- 2026SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detection9 Apr 2026
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detection25 Nov 2025
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection24 Nov 2025
- 2025Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?22 Sep 2025
- 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors4 Jun 2025
- 2025DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models3 Jun 2025
- 2025CAE-Net: Generalized Deepfake Image Detection using Convolution and Attention Mechanisms with Spatial and Frequency Domain Features15 Feb 2025
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024
- 2024Adversarial Robustness of AI-Generated Image Detectors in the Real World2 Oct 2024
- 2024Deep Learning Technology for Face Forgery Detection: A Survey22 Sep 2024
36 more
- 2024Active Fake: DeepFake Camouflage5 Sep 2024
- 20242D-Malafide: Adversarial Attacks Against Face Deepfake Detection Systems26 Aug 2024
- 2024Towards Understanding Unsafe Video Generation17 Jul 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
- 2024DeepFeatureX Net: Deep Features eXtractors based Network for discriminating synthetic from real images24 Apr 2024
- 2024Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learning6 Feb 2024
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detection14 Dec 2023
- 2023Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Models5 Dec 2023
- 2023Improving Video Deepfake Detection: A DCT-Based Approach with Patch-Level Analysis17 Oct 2023
- 2023Cross-domain Robust Deepfake Bias Expansion Network for Face Forgery Detection8 Oct 2023
- 2023AI-Generated Images as Data Source: The Dawn of Synthetic Era3 Oct 2023
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models5 Sep 2023
- 2023Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detection3 Sep 2023
- 2023ForensicsForest Family: A Series of Multi-scale Hierarchical Cascade Forests for Detecting GAN-generated Faces2 Aug 2023
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models11 Jul 2023
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Image14 Jun 2023
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images25 Apr 2023
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistency23 Apr 2023
- 2023Open-World Object Detection via Discriminative Class Prototype Learning23 Feb 2023
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection12 Dec 2022
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspective20 Nov 2022
- 2022Deepfake Text Detection: Limitations and Opportunities17 Oct 2022
- 2022Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigation12 Jun 2022
- 2022The MeVer DeepFake Detection Service: Lessons Learnt from Developing and Deploying in the Wild27 Apr 2022
- 2022FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes5 Apr 2022
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detection29 Mar 2022
- 2022Making DeepFakes more spurious: evading deep face forgery detection via trace removal attack22 Mar 2022
- 2022Deepfake Style Transfer Mixture: a First Forensic Ballistics Study on Synthetic Images18 Mar 2022
- 2022GAN-generated Faces Detection: A Survey and New Perspectives15 Feb 2022
- 2022D4: Detection of Adversarial Diffusion Deepfakes Using Disjoint Ensembles11 Feb 2022
- 2021Understanding the Security of Deepfake Detection5 Jul 2021
- 2021Imperceptible Adversarial Examples for Fake Image Detection3 Jun 2021
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakes26 Mar 2021
- 2021KoDF: A Large-scale Korean DeepFake Detection Dataset18 Mar 2021
- 2021TANTRA: Timing-Based Adversarial Network Traffic Reshaping Attack10 Mar 2021
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizon27 Feb 2021
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Modelscited by 36
- 2023Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Modelscited by 9
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Modelscited by 6
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
- 2025Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?cited by 1
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection24 Nov 2025
- 2025Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?22 Sep 2025
- 2023Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Models5 Dec 2023
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models5 Sep 2023
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models11 Jul 2023
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 65
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2022Deepfake Text Detection: Limitations and Opportunitiescited by 37
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2022GAN-generated Faces Detection: A Survey and New Perspectivescited by 29
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
- 2022Making DeepFakes more spurious: evading deep face forgery detection via trace removal attackcited by 16
- 2023AI-Generated Images as Data Source: The Dawn of Synthetic Eracited by 13
12 most cited of 40 All 40 (JSON)
- 2026Do Transformations Reveal the Truth? Generative Residual Learning for Generalized AI-Generated Image Detection9 Jul 2026
- 2026SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detection9 Apr 2026
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detection25 Nov 2025
- 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors4 Jun 2025
- 2025CAE-Net: Generalized Deepfake Image Detection using Convolution and Attention Mechanisms with Spatial and Frequency Domain Features15 Feb 2025
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024
- 2024Adversarial Robustness of AI-Generated Image Detectors in the Real World2 Oct 2024
- 2024Deep Learning Technology for Face Forgery Detection: A Survey22 Sep 2024
- 2024Active Fake: DeepFake Camouflage5 Sep 2024
- 20242D-Malafide: Adversarial Attacks Against Face Deepfake Detection Systems26 Aug 2024
- 2024Towards Understanding Unsafe Video Generation17 Jul 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
12 newest of 40 All 40 (JSON)