Revisiting Deepfake Detection: Chronological Continual Learning and the Limits of Generalization
Not on the map. Why?
Abstract (arXiv)
The rapid evolution of deepfake generation technologies poses critical challenges for detection systems, as non-continual learning methods demand frequent and expensive retraining. We reframe deepfake detection (DFD) as a Continual Learning (CL) problem, proposing an efficient framework that incrementally adapts to emerging visual manipulation techniques while retaining knowledge of past generators. Our framework, unlike prior approaches that rely on unreal simulation sequences, simulates the real-world chronological evolution of deepfake technologies in extended periods across 7 years. Simultaneously, our framework builds upon lightweight visual backbones to allow for the real-time performance of DFD systems. Additionally, we contribute two novel metrics: Continual AUC (C-AUC) for historical performance and Forward Transfer AUC (FWT-AUC) for future generalization. Through extensive experimentation (over 600 simulations), we empirically demonstrate that while efficient adaptation (+155 times faster than full retraining) and robust retention of historical knowledge is possible, the generalization of current approaches to future generators without additional training remains near-random (FWT-AUC ≈ 0.5) due to the unique imprint characterizing each existing generator. Such observations are the foundation of our newly proposed Non-Universal Deepfake Distribution Hypothesis. Code will be released upon acceptance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 70 references that are in the map. First posted on arXiv 29 Aug 2025.
Builds on
56 of 70 references.
References · 56
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2018Experience Replay for Continual Learningcited by 1,095
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
38 more
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2019Three scenarios for continual learningcited by 614
- 2021ImageNet-21K Pretraining for the Massescited by 613
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2019On the Detection of Digital Face Manipulationcited by 260
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2022Learning Fast, Learning Slow: A General Continual Learning Method based on Complementary Learning Systemcited by 112
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 99
- 2023CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Imagescited by 84
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2020DeepFake Detection by Analyzing Convolutional Tracescited by 81
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2020Face Anti-Spoofing Via Disentangled Representation Learningcited by 65
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 59
- 2019Incremental learning for the detection and classification of GAN-generated imagescited by 58
- 2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentialscited by 45
- 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionalitycited by 44
- 2023Improving Fairness in Deepfake Detectioncited by 40
- 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
- 2021An Examination of Fairness of AI Models for Deepfake Detectioncited by 35
- 2020Detecting CNN-Generated Facial Images in Real-World Scenarioscited by 32
- 2022GBDF: Gender Balanced DeepFake Dataset Towards Fair DeepFake Detectioncited by 32
- 2023Parents and Children: Distinguishing Multimodal DeepFakes from Natural Imagescited by 29
- 2021Robust Attentive Deep Neural Network for Exposing GAN-generated Facescited by 28
- 2023Error Sensitivity Modulation based Experience Replay: Mitigating Abrupt Representation Drift in Continual Learningcited by 27
- 2024Faster Than Lies: Real-time Deepfake Detection using Binary Neural Networkscited by 27
- 2020Detection, Attribution and Localization of GAN Generated Imagescited by 24
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.