mlsanityData to 7 Oct 2026

Searching for the Fakes: Efficient Neural Architecture Search for General Face Forgery Detection

arXiv 2306.08830 ↗First posted 15 Jun 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

As the saying goes, "seeing is believing". However, with the development of digital face editing tools, we can no longer trust what we can see. Although face forgery detection has made promising progress, most current methods are designed manually by human experts, which is labor-consuming. In this paper, we develop an end-to-end framework based on neural architecture search (NAS) for deepfake detection, which can automatically design network architectures without human intervention. First, a forgery-oriented search space is created to choose appropriate operations for this task. Second, we propose a novel performance estimation metric, which guides the search process to select more general models. The cross-dataset search is also considered to develop more general architectures. Eventually, we connect the cells in a cascaded pyramid way for final forgery classification. Compared with state-of-the-art networks artificially designed, our method achieves competitive performance in both in-dataset and cross-dataset scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

31 of 45 references.

References · 31

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  4. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  5. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  7. 2016An overview of gradient descent optimization algorithmscited by 1,021
  8. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
  9. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
  10. 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 666
  11. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  12. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
19 more
  1. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  2. 2021Multi-attentional Deepfake Detectioncited by 339
  3. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
  4. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
  5. 2020The Creation and Detection of Deepfakes: A Surveycited by 246
  6. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
  7. 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 208
  8. 2020Media Forensics and DeepFakes: an overviewcited by 208
  9. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
  10. 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
  11. 2019Understanding and Robustifying Differentiable Architecture Searchcited by 176
  12. 2020Searching Central Difference Convolutional Networks for Face Anti-Spoofingcited by 173
  13. 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
  14. 2020NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofingcited by 104
  15. 2021Face Forensics in the Wildcited by 87
  16. 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
  17. 2021Initiative Defense against Facial Manipulationcited by 36
  18. 2019Exploiting Operation Importance for Differentiable Neural Architecture Searchcited by 11
  19. 2021Automated Deepfake Detectioncited by 2

Built on by

Not cited yet.