Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learning
Not on the map. Why?
Abstract (arXiv)
Deepfake has recently raised a plethora of societal concerns over its possible security threats and dissemination of fake information. Much research on deepfake detection has been undertaken. However, detecting low quality as well as simultaneously detecting different qualities of deepfakes still remains a grave challenge. Most SOTA approaches are limited by using a single specific model for detecting certain deepfake video quality type. When constructing multiple models with prior information about video quality, this kind of strategy incurs significant computational cost, as well as model and training data overhead. Further, it cannot be scalable and practical to deploy in real-world settings. In this work, we propose a universal intra-model collaborative learning framework to enable the effective and simultaneous detection of different quality of deepfakes. That is, our approach is the quality-agnostic deepfake detection method, dubbed QAD . In particular, by observing the upper bound of general error expectation, we maximize the dependency between intermediate representations of images from different quality levels via Hilbert-Schmidt Independence Criterion. In addition, an Adversarial Weight Perturbation module is carefully devised to enable the model to be more robust against image corruption while boosting the overall model's performance. Extensive experiments over seven popular deepfake datasets demonstrate the superiority of our QAD model over prior SOTA benchmarks.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 49 of its 71 references that are in the map. First posted on arXiv 12 Sep 2023.
Builds on
49 of 71 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2014Going Deeper with Convolutionscited by 4,231
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019Contrastive Representation Distillationcited by 734
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2018Albumentations: fast and flexible image augmentationscited by 558
37 more
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2019Fourier Spectrum Discrepancies in Deep Network Generated Imagescited by 138
- 2017On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learningcited by 136
- 2021Face Forensics in the Wildcited by 87
- 2019The HSIC Bottleneck: Deep Learning without Back-Propagationcited by 77
- 2021Self-Supervised Learning with Kernel Dependence Maximizationcited by 77
- 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
- 2020The Implicit and Explicit Regularization Effects of Dropoutcited by 71
- 2016Deep Multi-task Representation Learning: A Tensor Factorisation Approachcited by 69
- 2018Collaborative Learning for Deep Neural Networkscited by 69
- 2020Do We Need Zero Training Loss After Achieving Zero Training Error?cited by 61
- 2020Peer Collaborative Learning for Online Knowledge Distillationcited by 58
- 2021Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Facescited by 48
- 2021ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Imagescited by 48
- 2019Robust Learning with the Hilbert-Schmidt Independence Criterioncited by 36
- 2020Spatial Frequency Bias in Convolutional Generative Adversarial Networkscited by 35
- 2021Generalization bounds via distillationcited by 33
- 2020Deepfake Detection using Spatiotemporal Convolutional Networkscited by 32
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attackscited by 30
- 2020T-GD: Transferable GAN-generated Images Detection Frameworkcited by 28
- 2021Defending Against Image Corruptions Through Adversarial Augmentationscited by 28
- 2019FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Facescited by 12
- 2021MixACM: Mixup-Based Robustness Transfer via Distillation of Activated Channel Mapscited by 9
- 2021Exploring the Asynchronous of the Frequency Spectra of GAN-generated Facial Imagescited by 9
- 2021Intra-Model Collaborative Learning of Neural Networkscited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 16; 2025: 11; 2026: 4.
32 papers.
Sort:
By area:
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
- 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Modelscited by 33
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
- 2024Gradient Alignment for Cross-Domain Face Anti-Spoofingcited by 26
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2024XAI-Based Detection of Adversarial Attacks on Deepfake Detectorscited by 9
- 2024Disrupting Diffusion-based Inpainters with Semantic Digressioncited by 8
- 2025RAIDX: A Retrieval-Augmented Generation and GRPO Reinforcement Learning Framework for Explainable Deepfake Detectioncited by 8
- 2024Continuous fake media detection: adapting deepfake detectors to new generative techniquescited by 6
20 more
- 2024ODDN: Addressing Unpaired Data Challenges in Open-World Deepfake Detection on Online Social Networkscited by 6
- 2024FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detectioncited by 6
- 2024UGAD: Universal Generative AI Detector utilizing Frequency Fingerprintscited by 5
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attributioncited by 5
- 2025Pay Less Attention to Deceptive Artifacts: Robust Detection of Compressed Deepfakes on Online Social Networkscited by 5
- 2024Exploring the Impact of Moire Pattern on Deepfake Detectorscited by 4
- 2024A Quality-Centric Framework for Generic Deepfake Detectioncited by 4
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2025LLMs Are Not Yet Ready for Deepfake Image Detectioncited by 3
- 2025FakeChain: Exposing Shallow Cues in Multi-Step Deepfake Detectioncited by 3
- 2025Visual Language Models as Zero-Shot Deepfake Detectorscited by 2
- 2025Seeing Through the Blur: Unlocking Defocus Maps for Deepfake Detectioncited by 2
- 2024DPL: Cross-quality DeepFake Detection via Dual Progressive Learningcited by 1
- 2025End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detectioncited by 1
- 2025UMCL: Unimodal-generated Multimodal Contrastive Learning for Cross-compression-rate Deepfake Detectioncited by 1
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
- 2024Multiple Contexts and Frequencies Aggregation Network forDeepfake Detectioncited by 0
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detectioncited by 0
- 2026Cross-modal Affinity-aligned Multimodal Learning Analytics for Predicting Student Collaboration Satisfaction in Game-Based Learningcited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Expertscited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey12 Jul 2026
- 2026Cross-modal Affinity-aligned Multimodal Learning Analytics for Predicting Student Collaboration Satisfaction in Game-Based Learning16 May 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2025UMCL: Unimodal-generated Multimodal Contrastive Learning for Cross-compression-rate Deepfake Detection24 Nov 2025
- 2025Seeing Through the Blur: Unlocking Defocus Maps for Deepfake Detection27 Sep 2025
- 2025FakeChain: Exposing Shallow Cues in Multi-Step Deepfake Detection20 Sep 2025
- 2025End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection16 Sep 2025
- 2025RAIDX: A Retrieval-Augmented Generation and GRPO Reinforcement Learning Framework for Explainable Deepfake Detection6 Aug 2025
- 2025Visual Language Models as Zero-Shot Deepfake Detectors30 Jul 2025
- 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Models3 Jul 2025
- 2025Pay Less Attention to Deceptive Artifacts: Robust Detection of Compressed Deepfakes on Online Social Networks25 Jun 2025
20 more
- 2025LLMs Are Not Yet Ready for Deepfake Image Detection12 Jun 2025
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution7 May 2025
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes7 Apr 2025
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024
- 2024A Quality-Centric Framework for Generic Deepfake Detection8 Nov 2024
- 2024FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detection29 Oct 2024
- 2024ODDN: Addressing Unpaired Data Challenges in Open-World Deepfake Detection on Online Social Networks24 Oct 2024
- 2024DPL: Cross-quality DeepFake Detection via Dual Progressive Learning10 Oct 2024
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion6 Oct 2024
- 2024UGAD: Universal Generative AI Detector utilizing Frequency Fingerprints12 Sep 2024
- 2024Multiple Contexts and Frequencies Aggregation Network forDeepfake Detection3 Aug 2024
- 2024Exploring the Impact of Moire Pattern on Deepfake Detectors15 Jul 2024
- 2024Disrupting Diffusion-based Inpainters with Semantic Digression14 Jul 2024
- 2024Continuous fake media detection: adapting deepfake detectors to new generative techniques12 Jun 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024XAI-Based Detection of Adversarial Attacks on Deepfake Detectors5 Mar 2024
- 2024Gradient Alignment for Cross-Domain Face Anti-Spoofing29 Feb 2024
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Framework9 Jan 2024
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors26 Oct 2023
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
- 2024Disrupting Diffusion-based Inpainters with Semantic Digressioncited by 8
- 2025Pay Less Attention to Deceptive Artifacts: Robust Detection of Compressed Deepfakes on Online Social Networkscited by 5
- 2025End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detectioncited by 1
- 2025End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection16 Sep 2025
- 2025Pay Less Attention to Deceptive Artifacts: Robust Detection of Compressed Deepfakes on Online Social Networks25 Jun 2025
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion6 Oct 2024
- 2024Disrupting Diffusion-based Inpainters with Semantic Digression14 Jul 2024
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2024Gradient Alignment for Cross-Domain Face Anti-Spoofingcited by 26
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2024XAI-Based Detection of Adversarial Attacks on Deepfake Detectorscited by 9
- 2024Continuous fake media detection: adapting deepfake detectors to new generative techniquescited by 6
- 2024ODDN: Addressing Unpaired Data Challenges in Open-World Deepfake Detection on Online Social Networkscited by 6
- 2024FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detectioncited by 6
- 2024UGAD: Universal Generative AI Detector utilizing Frequency Fingerprintscited by 5
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attributioncited by 5
- 2024Exploring the Impact of Moire Pattern on Deepfake Detectorscited by 4
12 most cited of 23 All 23 (JSON)
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey12 Jul 2026
- 2026Cross-modal Affinity-aligned Multimodal Learning Analytics for Predicting Student Collaboration Satisfaction in Game-Based Learning16 May 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2025UMCL: Unimodal-generated Multimodal Contrastive Learning for Cross-compression-rate Deepfake Detection24 Nov 2025
- 2025Seeing Through the Blur: Unlocking Defocus Maps for Deepfake Detection27 Sep 2025
- 2025FakeChain: Exposing Shallow Cues in Multi-Step Deepfake Detection20 Sep 2025
- 2025LLMs Are Not Yet Ready for Deepfake Image Detection12 Jun 2025
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution7 May 2025
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes7 Apr 2025
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024
- 2024A Quality-Centric Framework for Generic Deepfake Detection8 Nov 2024
12 newest of 23 All 23 (JSON)