Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review
Not on the map. Why?
Abstract (arXiv)
Recent advancements in AI, especially deep learning, have contributed to a significant increase in the creation of new realistic-looking synthetic media (video, image, and audio) and manipulation of existing media, which has led to the creation of the new term ``deepfake''. Based on both the research literature and resources in English and in Chinese, this paper gives a comprehensive overview of deepfake, covering multiple important aspects of this emerging concept, including 1) different definitions, 2) commonly used performance metrics and standards, and 3) deepfake-related datasets, challenges, competitions and benchmarks. In addition, the paper also reports a meta-review of 12 selected deepfake-related survey papers published in 2020 and 2021, focusing not only on the mentioned aspects, but also on the analysis of key challenges and recommendations. We believe that this paper is the most comprehensive review of deepfake in terms of aspects covered, and the first one covering both the English and Chinese literature and sources.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 67 of its 143 references that are in the map. First posted on arXiv 21 Aug 2022.
Builds on
67 of 143 references.
References · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 320
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
38 more
- 2018Deep Video Portraitscited by 265
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2018Efficient Neural Audio Synthesiscited by 218
- 2020Media Forensics and DeepFakes: an overviewcited by 208
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 173
- 2020Adversarial Latent Autoencoderscited by 155
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 143
- 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 129
- 2022Does Audio Deepfake Detection Generalize?cited by 129
- 2019MOSNet: Deep Learning based Objective Assessment for Voice Conversioncited by 126
- 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 125
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 118
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 118
- 2020TweepFake: about Detecting Deepfake Tweetscited by 117
- 2020CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotationscited by 109
- 2019Deep Learning for Deepfakes Creation and Detection: A Surveycited by 102
- 2018Neural Voice Cloning with a Few Samplescited by 100
- 2022BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotationscited by 99
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
- 2019High Fidelity Speech Synthesis with Adversarial Networkscited by 90
- 2018Recycle-GAN: Unsupervised Video Retargetingcited by 89
- 2021Face Forensics in the Wildcited by 87
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2019Unmasking DeepFakes with simple Featurescited by 78
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2020Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversioncited by 75
- 2018The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methodscited by 68
- 2019Neural Style-Preserving Visual Dubbingcited by 47
- 2020DeepFake Detection: Current Challenges and Next Stepscited by 44
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 4.
6 papers.
- 2024Distinguish Any Fake Videos: Unleashing the Power of Large-scale Data and Motion Featurescited by 20
- 2025DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detectioncited by 3
- 2026The Deepfakes We Missed: We Built Detectors for a Threat That Didn't Arrivecited by 0
- 2026Ensemble Deep Learning Approaches for AI-Altered Video Detectioncited by 0
- 2026A Dual-Stream Challenge-Response Protocol for Ocular Liveness Verificationcited by 0
- 2026Deepfakes and Synthetic Media: Generation, Detection, and Governancecited by 0
- 2026Deepfakes and Synthetic Media: Generation, Detection, and Governance7 Aug 2026
- 2026A Dual-Stream Challenge-Response Protocol for Ocular Liveness Verification10 Jul 2026
- 2026Ensemble Deep Learning Approaches for AI-Altered Video Detection8 Jul 2026
- 2026The Deepfakes We Missed: We Built Detectors for a Threat That Didn't Arrive12 May 2026
- 2025DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detection26 Oct 2025
- 2024Distinguish Any Fake Videos: Unleashing the Power of Large-scale Data and Motion Features24 May 2024