mlsanityData to 7 Oct 2026

The Tug-of-War Between Deepfake Generation and Detection

arXiv 2407.06174 ↗First posted 8 Jul 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Multimodal generative models are rapidly evolving, leading to a surge in the generation of realistic video and audio that offers exciting possibilities but also serious risks. Deepfake videos, which can convincingly impersonate individuals, have particularly garnered attention due to their potential misuse in spreading misinformation and creating fraudulent content. This survey paper examines the dual landscape of deepfake video generation and detection, emphasizing the need for effective countermeasures against potential abuses. We provide a comprehensive overview of current deepfake generation techniques, including face swapping, reenactment, and audio-driven animation, which leverage cutting-edge technologies like GANs and diffusion models to produce highly realistic fake videos. Additionally, we analyze various detection approaches designed to differentiate authentic from altered videos, from detecting visual artifacts to deploying advanced algorithms that pinpoint inconsistencies across video and audio signals. The effectiveness of these detection methods heavily relies on the diversity and quality of datasets used for training and evaluation. We discuss the evolution of deepfake datasets, highlighting the importance of robust, diverse, and frequently updated collections to enhance the detection accuracy and generalizability. As deepfakes become increasingly indistinguishable from authentic content, developing advanced detection techniques that can keep pace with generation technologies is crucial. We advocate for a proactive approach in the "tug-of-war" between deepfake creators and detectors, emphasizing the need for continuous research collaboration, standardization of evaluation metrics, and the creation of comprehensive benchmarks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 91 of its 148 references that are in the map. First posted on arXiv 8 Jul 2024.

Builds on

91 of 148 references.

References · 91

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  9. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  11. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  12. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
38 more
  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  2. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  3. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  4. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  5. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  7. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  8. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  9. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  10. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  11. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  12. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  13. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  14. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
  15. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  16. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  17. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
  18. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  19. 2023DIRE for Diffusion-Generated Image Detectioncited by 386
  20. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  21. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  22. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  23. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  24. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  25. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
  26. 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 310
  27. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
  28. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  29. 2022On the detection of synthetic images generated by diffusion modelscited by 282
  30. 2020What makes fake images detectable? Understanding properties that generalizecited by 272
  31. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  32. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
  33. 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 249
  34. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  35. 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 208
  36. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
  37. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  38. 2021MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglementcited by 189

50 most cited of 91 All 91 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Generating and Detecting Various Types of Fake Image and Audio Content: A Review of Modern Deep Learning Technologies and Tools
  2. 2023Undercover Deepfakes: Detecting Fake Segments in Videos
  3. 2024Deepfake Generation and Detection: A Benchmark and Survey
  4. 2026Deepfakes and Synthetic Media: Generation, Detection, and Governance
  5. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges
  6. 2024Deepfake Media Forensics: State of the Art and Challenges Ahead
  7. 2025PIA: Deepfake Detection Using Phoneme-Temporal and Identity-Dynamic Analysis
  8. 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection