Towards Generalizable and Robust Face Manipulation Detection via Bag-of-local-feature
Not on the map. Why?
Abstract (arXiv)
Over the past several years, in order to solve the problem of malicious abuse of facial manipulation technology, face manipulation detection technology has obtained considerable attention and achieved remarkable progress. However, most existing methods have very impoverished generalization ability and robustness. In this paper, we propose a novel method for face manipulation detection, which can improve the generalization ability and robustness by bag-of-local-feature. Specifically, we extend Transformers using bag-of-feature approach to encode inter-patch relationships, allowing it to learn local forgery features without any explicit supervision. Extensive experiments demonstrate that our method can outperform competing state-of-the-art methods on FaceForensics++, Celeb-DF and DeeperForensics-1.0 datasets.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 14 Mar 2021.
Builds on
19 of 29 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Layer Normalizationcited by 5,579
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2020Quantifying Attention Flow in Transformerscited by 759
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
7 more
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2019Towards Generalizable Deepfake Detection with Locality-aware AutoEncodercited by 17
- 2019Extracting deep local features to detect manipulated images of human facescited by 8
- 2020Fake Generated Painting Detection via Frequency Analysiscited by 6
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 2.
5 papers.
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2023Exploiting Modality-Specific Features For Multi-Modal Manipulation Detection And Groundingcited by 7
- 2024Mixture-of-Noises Enhanced Forgery-Aware Predictor for Multi-Face Manipulation Detection and Localizationcited by 7
- 2023Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detectioncited by 2
- 2024Inclusion 2024 Global Multimedia Deepfake Detection Challenge: Towards Multi-dimensional Face Forgery Detectioncited by 1
- 2024Inclusion 2024 Global Multimedia Deepfake Detection Challenge: Towards Multi-dimensional Face Forgery Detection30 Dec 2024
- 2024Mixture-of-Noises Enhanced Forgery-Aware Predictor for Multi-Face Manipulation Detection and Localization5 Aug 2024
- 2023Exploiting Modality-Specific Features For Multi-Modal Manipulation Detection And Grounding22 Sep 2023
- 2023Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection21 Jul 2023
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detection23 Oct 2022