Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey
Not on the map. Why?
Abstract (arXiv)
In recent years, deepfakes (DFs) have been utilized for malicious purposes, such as individual impersonation, misinformation spreading, and artists style imitation, raising questions about ethical and security concerns. In this survey, we provide a comprehensive review and comparison of passive DF detection across multiple modalities, including image, video, audio, and multi-modal, to explore the inter-modality relationships between them. Beyond detection accuracy, we extend our analysis to encompass crucial performance dimensions essential for real-world deployment: generalization capabilities across novel generation techniques, robustness against adversarial manipulations and postprocessing techniques, attribution precision in identifying generation sources, and resilience under real-world operational conditions. Additionally, we analyze the advantages and limitations of existing datasets, benchmarks, and evaluation metrics for passive DF detection. Finally, we propose future research directions that address these unexplored and emerging issues in the field of passive DF detection. This survey offers researchers and practitioners a comprehensive resource for understanding the current landscape, methodological approaches, and promising future directions in this rapidly evolving field.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 188 of its 308 references that are in the map. First posted on arXiv 26 Nov 2024.
Builds on
188 of 308 references.
References · 188
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2021Transformers in Vision: A Surveycited by 1,013
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
38 more
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 279
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2019On the Detection of Digital Face Manipulationcited by 260
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2020The Creation and Detection of Deepfakes: A Surveycited by 247
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2020Media Forensics and DeepFakes: an overviewcited by 209
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
- 2021Trustworthy AI: From Principles to Practicescited by 207
- 2018Do GANs leave artificial fingerprints?cited by 190
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
- 2018Disentangling Adversarial Robustness and Generalizationcited by 172
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 167
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
50 most cited of 188 All 188 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Modelcited by 2
- 2025Think Twice before Adaptation: Improving Adaptability of DeepFake Detection via Online Test-Time Adaptationcited by 1
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
- 2026A survey of AI-generated voices and their detectioncited by 0
- 2026A survey of AI-generated voices and their detection15 Aug 2026
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey12 Jul 2026
- 2026To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Model14 May 2026
- 2025Think Twice before Adaptation: Improving Adaptability of DeepFake Detection via Online Test-Time Adaptation24 May 2025