The MeVer DeepFake Detection Service: Lessons Learnt from Developing and Deploying in the Wild
Not on the map. Why?
Abstract (arXiv)
Enabled by recent improvements in generation methodologies, DeepFakes have become mainstream due to their increasingly better visual quality, the increase in easy-to-use generation tools and the rapid dissemination through social media. This fact poses a severe threat to our societies with the potential to erode social cohesion and influence our democracies. To mitigate the threat, numerous DeepFake detection schemes have been introduced in the literature but very few provide a web service that can be used in the wild. In this paper, we introduce the MeVer DeepFake detection service, a web service detecting deep learning manipulations in images and video. We present the design and implementation of the proposed processing pipeline that involves a model ensemble scheme, and we endow the service with a model card for transparency. Experimental results show that our service performs robustly on the three benchmark datasets while being vulnerable to Adversarial Attacks. Finally, we outline our experience and lessons learned when deploying a research system into production in the hopes that it will be useful to other academic and industry teams.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 54 of its 80 references that are in the map. First posted on arXiv 27 Apr 2022.
Builds on
54 of 80 references.
References · 54
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2018Model Cards for Model Reportingcited by 1,068
38 more
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2017Dynamic Routing Between Capsulescited by 689
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2021ImageNet-21K Pretraining for the Massescited by 607
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2020Label-Only Membership Inference Attackscited by 371
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 208
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 208
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2015Particular object retrieval with integral max-pooling of CNN activationscited by 160
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021Face Forensics in the Wildcited by 87
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2020Bullseye Polytope: A Scalable Clean-Label Poisoning Attack with Improved Transferabilitycited by 65
- 2020Video Face Manipulation Detection Through Ensemble of CNNscited by 63
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2020Adversarial Perturbations Fool Deepfake Detectorscited by 48
- 2021FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learningcited by 43
- 2019ViSiL: Fine-grained Spatio-Temporal Video Similarity Learningcited by 41
- 2021CoReD: Generalizing Fake Media Detection with Continual Representation using Distillationcited by 37
- 2021One Detector to Rule Them All: Towards a General Deepfake Attack Detection Frameworkcited by 33
- 2021Video Transformer for Deepfake Detection with Incremental Learningcited by 33
- 2021Towards Solving the DeepFake Problem : An Analysis on Improving DeepFake Detection using Dynamic Face Augmentationcited by 25
- 2021Deepfake Videos in the Wild: Analysis and Detectioncited by 23
- 2021DnS: Distill-and-Select for Efficient and Accurate Video Indexing and Retrievalcited by 17
- 2022A Review of Deep Learning-based Approaches for Deepfake Content Detectioncited by 12
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 3.
6 papers.
- 2022MINTIME: Multi-Identity Size-Invariant Video Deepfake Detectioncited by 23
- 2023Detecting Images Generated by Diffuserscited by 12
- 2024Adversarial Magnification to Deceive Deepfake Detection through Super Resolutioncited by 2
- 2022Shai-am: A Machine Learning Platform for Investment Strategiescited by 0
- 2024Deepfake Detection and the Impact of Limited Computing Capabilitiescited by 0
- 2024Exploring Strengths and Weaknesses of Super-Resolution Attack in Deepfake Detectioncited by 0
- 2024Exploring Strengths and Weaknesses of Super-Resolution Attack in Deepfake Detection5 Oct 2024
- 2024Adversarial Magnification to Deceive Deepfake Detection through Super Resolution2 Jul 2024
- 2024Deepfake Detection and the Impact of Limited Computing Capabilities8 Feb 2024
- 2023Detecting Images Generated by Diffusers9 Mar 2023
- 2022MINTIME: Multi-Identity Size-Invariant Video Deepfake Detection20 Nov 2022
- 2022Shai-am: A Machine Learning Platform for Investment Strategies1 Jul 2022