The Tug-of-War Between Deepfake Generation and Detection
Not on the map. Why?
Abstract (arXiv)
Multimodal generative models are rapidly evolving, leading to a surge in the generation of realistic video and audio that offers exciting possibilities but also serious risks. Deepfake videos, which can convincingly impersonate individuals, have particularly garnered attention due to their potential misuse in spreading misinformation and creating fraudulent content. This survey paper examines the dual landscape of deepfake video generation and detection, emphasizing the need for effective countermeasures against potential abuses. We provide a comprehensive overview of current deepfake generation techniques, including face swapping, reenactment, and audio-driven animation, which leverage cutting-edge technologies like GANs and diffusion models to produce highly realistic fake videos. Additionally, we analyze various detection approaches designed to differentiate authentic from altered videos, from detecting visual artifacts to deploying advanced algorithms that pinpoint inconsistencies across video and audio signals. The effectiveness of these detection methods heavily relies on the diversity and quality of datasets used for training and evaluation. We discuss the evolution of deepfake datasets, highlighting the importance of robust, diverse, and frequently updated collections to enhance the detection accuracy and generalizability. As deepfakes become increasingly indistinguishable from authentic content, developing advanced detection techniques that can keep pace with generation technologies is crucial. We advocate for a proactive approach in the "tug-of-war" between deepfake creators and detectors, emphasizing the need for continuous research collaboration, standardization of evaluation metrics, and the creation of comprehensive benchmarks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 91 of its 148 references that are in the map. First posted on arXiv 8 Jul 2024.
Builds on
91 of 148 references.
References · 91
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
38 more
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2023DIRE for Diffusion-Generated Image Detectioncited by 386
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 310
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2022On the detection of synthetic images generated by diffusion modelscited by 282
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
- 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 249
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 208
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2021MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglementcited by 189
50 most cited of 91 All 91 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Generating and Detecting Various Types of Fake Image and Audio Content: A Review of Modern Deep Learning Technologies and Tools
- 2023Undercover Deepfakes: Detecting Fake Segments in Videos
- 2024Deepfake Generation and Detection: A Benchmark and Survey
- 2026Deepfakes and Synthetic Media: Generation, Detection, and Governance
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges
- 2024Deepfake Media Forensics: State of the Art and Challenges Ahead
- 2025PIA: Deepfake Detection Using Phoneme-Temporal and Identity-Dynamic Analysis
- 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection