mlsanityData to 14 Oct 2026

Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey

arXiv 2411.17911 ↗First posted 26 Nov 2024cs.CV cs.CRcited by 4

Not on the map. Why?

Abstract (arXiv)

In recent years, deepfakes (DFs) have been utilized for malicious purposes, such as individual impersonation, misinformation spreading, and artists style imitation, raising questions about ethical and security concerns. In this survey, we provide a comprehensive review and comparison of passive DF detection across multiple modalities, including image, video, audio, and multi-modal, to explore the inter-modality relationships between them. Beyond detection accuracy, we extend our analysis to encompass crucial performance dimensions essential for real-world deployment: generalization capabilities across novel generation techniques, robustness against adversarial manipulations and postprocessing techniques, attribution precision in identifying generation sources, and resilience under real-world operational conditions. Additionally, we analyze the advantages and limitations of existing datasets, benchmarks, and evaluation metrics for passive DF detection. Finally, we propose future research directions that address these unexplored and emerging issues in the field of passive DF detection. This survey offers researchers and practitioners a comprehensive resource for understanding the current landscape, methodological approaches, and promising future directions in this rapidly evolving field.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 188 of its 308 references that are in the map. First posted on arXiv 26 Nov 2024.

Builds on

188 of 308 references.

References · 188

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2020Knowledge Distillation: A Surveycited by 1,603
  4. 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
  5. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  6. 2021Transformers in Vision: A Surveycited by 1,013
  7. 2020Meta-Learning in Neural Networks: A Surveycited by 950
  8. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  9. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  10. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  11. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  12. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
38 more
  1. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  2. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  3. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  4. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  5. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
  6. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  7. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
  8. 2021Multi-attentional Deepfake Detectioncited by 341
  9. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  10. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
  11. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  12. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  13. 2022On the detection of synthetic images generated by diffusion modelscited by 283
  14. 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 279
  15. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
  16. 2019On the Detection of Digital Face Manipulationcited by 260
  17. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  18. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  19. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
  20. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
  21. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  22. 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
  23. 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
  24. 2020Media Forensics and DeepFakes: an overviewcited by 209
  25. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
  26. 2021Trustworthy AI: From Principles to Practicescited by 207
  27. 2018Do GANs leave artificial fingerprints?cited by 190
  28. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
  29. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
  30. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
  31. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
  32. 2018Disentangling Adversarial Robustness and Generalizationcited by 172
  33. 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
  34. 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 167
  35. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
  36. 2020End-to-end anti-spoofing with RawNet2cited by 164
  37. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  38. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159

50 most cited of 188 All 188 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.