Metric Learning for Anti-Compression Facial Forgery Detection
Not on the map. Why?
Abstract (arXiv)
Detecting facial forgery images and videos is an increasingly important topic in multimedia forensics. As forgery images and videos are usually compressed into different formats such as JPEG and H264 when circulating on the Internet, existing forgery-detection methods trained on uncompressed data often suffer from significant performance degradation in identifying them. To solve this problem, we propose a novel anti-compression facial forgery detection framework, which learns a compression-insensitive embedding feature space utilizing both original and compressed forgeries. Specifically, our approach consists of three ideas: (i) extracting compression-insensitive features from both uncompressed and compressed forgeries using an adversarial learning strategy; (ii) learning a robust partition by constructing a metric loss that can reduce the distance of the paired original and compressed images in the embedding space; (iii) improving the accuracy of tampered localization with an attention-transfer module. Experimental results demonstrate that, the proposed method is highly effective in handling both compressed and uncompressed facial forgery images.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 39 of its 54 references that are in the map. First posted on arXiv 15 Mar 2021.
Builds on
39 of 54 references.
References · 39
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
27 more
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2018Deep Video Portraitscited by 265
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
- 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
- 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
- 2018ReenactGAN: Learning to Reenact Faces via Boundary Transfercited by 85
- 2018Detecting GAN-generated Imagery using Color Cuescited by 75
- 2017Image Splicing Localization Using A Multi-Task Fully Convolutional Network (MFCN)cited by 64
- 2019Use of a Capsule Network to Detect Fake Images and Videoscited by 63
- 2017Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detectioncited by 56
- 2018RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spacescited by 50
- 2019Learning Cross-Modal Embeddings with Adversarial Networks for Cooking Recipes and Food Imagescited by 38
- 2019On the generalization of GAN image forensicscited by 36
- 2018FSNet: An Identity-Aware Generative Model for Image-based Face Swappingcited by 29
- 2019One-shot Face Reenactmentcited by 21
- 2020Detecting Deepfakes with Metric Learningcited by 16
- 2018HeadOn: Real-time Reenactment of Human Portrait Videoscited by 11
- 2019Complement Face Forensic Detection and Localization with FacialLandmarkscited by 8
Built on by
Citing papers per year: 2022: 4; 2023: 2; 2024: 2; 2025: 0; 2026: 1.
9 papers.
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
- 2022Compression-Resistant Backdoor Attack against Deep Neural Networkscited by 14
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
- 2022Multimodal Graph Learning for Deepfake Detectioncited by 6
- 2024A Quality-Centric Framework for Generic Deepfake Detectioncited by 4
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detectioncited by 2
- 2023Anti-Compression Contrastive Facial Forgery Detectioncited by 2
- 2023DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detectioncited by 1
- 2026Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detectioncited by 0
- 2026Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detection26 Aug 2026
- 2024A Quality-Centric Framework for Generic Deepfake Detection8 Nov 2024
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Framework9 Jan 2024
- 2023DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection7 Dec 2023
- 2023Anti-Compression Contrastive Facial Forgery Detection13 Feb 2023
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection12 Dec 2022
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspective20 Nov 2022
- 2022Multimodal Graph Learning for Deepfake Detection12 Sep 2022
- 2022Compression-Resistant Backdoor Attack against Deep Neural Networks3 Jan 2022