mlsanityData to 7 Oct 2026

Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook

arXiv 2411.19537 ↗First posted 29 Nov 2024cs.CV cs.AI cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

We survey deepfake generation and detection techniques, covering all deepfake media types: image, video, audio and multimodal content. We identify various kinds of deepfakes and construct taxonomies of deepfake generation and detection methods, illustrating the important groups of methods. Next, we gather datasets used for deepfake detection and provide updated rankings of the best performing detectors on the most popular datasets. In addition, we develop a novel multimodal benchmark to evaluate deepfake detectors on out-of-distribution content. The results indicate that state-of-the-art detectors fail to generalize to deepfakes generated by unseen generators. Our project page and new benchmark are available at https://github.com/CroitoruAlin/biodeep.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 277 of its 391 references that are in the map. First posted on arXiv 29 Nov 2024.

Builds on

277 of 391 references.

References · 277

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  8. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  10. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  12. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
38 more
  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  11. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  12. 2022Video Diffusion Modelscited by 2,280
  13. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  14. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  15. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  16. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  17. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  18. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  19. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  20. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  21. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  22. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  23. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  24. 2022Diffusion Models in Vision: A Surveycited by 1,008
  25. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  26. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  27. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  28. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  29. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  30. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  31. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  32. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  33. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  34. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  35. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  36. 2021Score-based Generative Modeling in Latent Spacecited by 634
  37. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  38. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573

50 most cited of 277 All 277 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 5.

10 papers.

  1. 2025ExDDV: A New Dataset for Explainable Deepfake Detection in Videocited by 10
  2. 2025MAVOS-DD: Multilingual Audio-Video Open-Set Deepfake Detection Benchmarkcited by 9
  3. 2024Audios Don't Lie: Multi-Frequency Channel Attention Mechanism for Audio Deepfake Detectioncited by 1
  4. 2025XMAD-Bench: Cross-Domain Multilingual Audio Deepfake Benchmarkcited by 1
  5. 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detectioncited by 1
  6. 2026DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalitiescited by 1
  7. 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
  8. 2025Dataset of News Articles with Provenance Metadata for Media Relevance Assessmentcited by 0
  9. 2026Moir'e Video Authentication: A Physical Signature Against AI Video Generationcited by 0
  10. 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Expertscited by 0