On the Detection of Digital Face Manipulation
Not on the map. Why?
Abstract (arXiv)
Detecting manipulated facial images and videos is an increasingly important topic in digital media forensics. As advanced face synthesis and manipulation methods are made available, new types of fake face representations are being created which have raised significant concerns for their use in social media. Hence, it is crucial to detect manipulated face images and localize manipulated regions. Instead of simply using multi-task learning to simultaneously detect manipulated images and predict the manipulated mask (regions), we propose to utilize an attention mechanism to process and improve the feature maps for the classification task. The learned attention maps highlight the informative regions to further improve the binary classification (genuine face v. fake face), and also visualize the manipulated regions. To enable our study of manipulated face detection and localization, we collect a large-scale database that contains numerous types of facial forgeries. With this dataset, we perform a thorough analysis of data-driven fake face detection. We show that the use of an attention mechanism improves facial forgery detection and manipulated region localization.
Key facts. Cited by 259 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 45; 2023: 49; 2024: 42; 2025: 54; 2026: 26.
259 papers.
Sort:
By area:
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
38 more
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 111
- 2021Representative Forgery Mining for Fake Face Detectioncited by 108
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 65
- 2021BiHPF: Bilateral High-Pass Filters for Robust Deepfake Detectioncited by 60
- 2021Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learningcited by 60
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 59
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 57
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2021Deep Gait Recognition: A Surveycited by 54
- 2023Multimodal Automated Fact-Checking: A Surveycited by 51
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
- 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 48
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2022Audio-Visual Person-of-Interest DeepFake Detectioncited by 43
- 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 40
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
- 2022Multi-domain Learning for Updating Face Anti-spoofing Modelscited by 39
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 38
- 2021Initiative Defense against Facial Manipulationcited by 36
- 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
- 2022Learning Second Order Local Anomaly for General Face Forgery Detectioncited by 36
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Modelscited by 36
50 most cited of 259 All 259 (JSON)
- 2026Revisiting Cross-Reconstruction for Generalizable Deepfake Detection1 Oct 2026
- 2026Trustworthy synthetic visual media: Evidence across the media lifecycle28 Sep 2026
- 2026Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance25 Sep 2026
- 2026Deep-Fake CAPTCHA: Mitigating Next-Generation Social Engineering Attacks10 Sep 2026
- 2026Harnessing CLIP and DINO: An Uncertainty-Aware Cascaded Fusion Network for Generalizable Deepfake Image Detection7 Sep 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026AdaForensics: Learning A Characteristic-aware Adaptive Deepfake Detector3 Aug 2026
- 2026DINO-VPT: Hierarchical Visual Prompt Tuning for Joint Physical-Digital Face Anti-Spoofing23 Jul 2026
- 2026XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection3 Jul 2026
- 2026A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators12 Jun 2026
- 2026MFVLR: Multi-domain Fine-grained Vision-Language Reconstruction for Generalizable Diffusion Face Forgery Detection and Localization11 May 2026
38 more
- 2026Omni-Fake: Benchmarking Unified Multimodal Social Media Deepfake Detection2 May 2026
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Rendering30 Apr 2026
- 2026Rethinking Cross-Domain Evaluation for Face Forgery Detection with Semantic Fine-grained Alignment and Mixture-of-Experts23 Apr 2026
- 2026M3D-Net: Multi-Modal 3D Facial Feature Reconstruction Network for Deepfake Detection16 Apr 2026
- 2026SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detection9 Apr 2026
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection25 Mar 2026
- 2026Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detection25 Mar 2026
- 2026VISER: Visually-Informed System for Enhanced Robustness in Iris Presentation Attack Detection18 Mar 2026
- 2026Human-AI Ensembles Improve Deepfake Detection in Low-to-Medium Quality Videos15 Mar 2026
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection10 Mar 2026
- 2026Deepfake Synthesis vs. Detection: An Uneven Contest8 Feb 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2026Phase4DFD: Multi-Domain Phase-Aware Attention for Deepfake Detection9 Jan 2026
- 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detection2 Jan 2026
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
- 2025Spoofing-aware Prompt Learning for Unified Physical-Digital Facial Attack Detection6 Dec 2025
- 2025OmniFD: A Unified Model for Versatile Face Forgery Detection30 Nov 2025
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection24 Nov 2025
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation18 Nov 2025
- 2025Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentation10 Nov 2025
- 2025A Hybrid Deep Learning and Forensic Approach for Robust Deepfake Detection31 Oct 2025
- 2025Fake-in-Facext: Towards Fine-Grained Explainable DeepFake Analysis23 Oct 2025
- 2025Seeing Through the Blur: Unlocking Defocus Maps for Deepfake Detection27 Sep 2025
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasing26 Sep 2025
- 2025Morphology-optimized Multi-Scale Fusion: Combining Local Artifacts and Mesoscopic Semantics for Deepfake Detection and Localization17 Sep 2025
- 2025Detecting Text Manipulation in Images using Vision Language Models12 Sep 2025
- 2025Adversarial Attacks on Audio Deepfake Detection: A Benchmark and Comparative Study8 Sep 2025
- 2025Revisiting Deepfake Detection: Chronological Continual Learning and the Limits of Generalization29 Aug 2025
- 2025A Spatial-Frequency Aware Multi-Scale Fusion Network for Real-Time Deepfake Detection28 Aug 2025
- 2025SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detection13 Aug 2025
- 2025Leveraging Unlabeled Data from Unknown Sources via Dual-Path Guidance for Deepfake Face Detection12 Aug 2025
- 2025AutoSIGHT: Automatic Eye Tracking-based System for Immediate Grading of Human experTise1 Aug 2025
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics24 Jul 2025
- 2025BusterX++: Towards Unified Cross-Modal AI-Generated Content Detection and Explanation with MLLM19 Jul 2025
- 2025Ensemble-Based Deepfake Detection using State-of-the-Art Models with Robust Cross-Dataset Generalisation8 Jul 2025
- 2025De-Fake: Style based Anomaly Deepfake Detection4 Jul 2025
- 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarios29 Jun 2025
50 newest of 259 All 259 (JSON)
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Modelscited by 36
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detectioncited by 25
- 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
- 2024Moderator: Moderating Text-to-Image Diffusion Models through Fine-grained Context-based Policiescited by 15
- 2025Silence is Golden: Leveraging Adversarial Examples to Nullify Audio Control in LDM-based Talking-Head Generationcited by 7
- 2024Self-Adaptive Reality-Guided Diffusion for Artifact-Free Super-Resolutioncited by 6
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Modelscited by 1
- 2024Detection of Synthetic Face Images: Accuracy, Robustness, Generalizationcited by 0
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Modelscited by 0
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learningcited by 0
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection24 Nov 2025
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2025Silence is Golden: Leveraging Adversarial Examples to Nullify Audio Control in LDM-based Talking-Head Generation2 Jun 2025
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Models13 Nov 2024
- 2024Moderator: Moderating Text-to-Image Diffusion Models through Fine-grained Context-based Policies14 Aug 2024
- 2024Detection of Synthetic Face Images: Accuracy, Robustness, Generalization25 Jun 2024
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models19 Jun 2024
- 2024Self-Adaptive Reality-Guided Diffusion for Artifact-Free Super-Resolution25 Mar 2024
- 2023Weakly-supervised deepfake localization in diffusion-generated images8 Nov 2023
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models5 Sep 2023
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection16 Nov 2022
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 111
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 59
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 38
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
- 2025DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Modelscited by 7
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2025Fake-in-Facext: Towards Fine-Grained Explainable DeepFake Analysiscited by 2
- 2025Detecting Text Manipulation in Images using Vision Language Modelscited by 1
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detectioncited by 0
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection25 Mar 2026
- 2025Fake-in-Facext: Towards Fine-Grained Explainable DeepFake Analysis23 Oct 2025
- 2025Detecting Text Manipulation in Images using Vision Language Models12 Sep 2025
- 2025DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models3 Jun 2025
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector26 Mar 2025
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models19 Mar 2025
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models3 Oct 2024
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant19 Aug 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024
- 2024La-SoftMoE CLIP for Unified Physical-Digital Face Attack Detectioncited by 8
- 2025Mixture-of-Attack-Experts with Class Regularization for Unified Physical-Digital Face Attack Detectioncited by 5
- 2025SUEDE:Shared Unified Experts for Physical-Digital Face Attack Detection Enhancementcited by 2
- 2026Rethinking Cross-Domain Evaluation for Face Forgery Detection with Semantic Fine-grained Alignment and Mixture-of-Expertscited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Expertscited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Rethinking Cross-Domain Evaluation for Face Forgery Detection with Semantic Fine-grained Alignment and Mixture-of-Experts23 Apr 2026
- 2025SUEDE:Shared Unified Experts for Physical-Digital Face Attack Detection Enhancement7 Apr 2025
- 2025Mixture-of-Attack-Experts with Class Regularization for Unified Physical-Digital Face Attack Detection1 Apr 2025
- 2024La-SoftMoE CLIP for Unified Physical-Digital Face Attack Detection23 Aug 2024
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
12 most cited of 230 All 230 (JSON)
- 2026Revisiting Cross-Reconstruction for Generalizable Deepfake Detection1 Oct 2026
- 2026Trustworthy synthetic visual media: Evidence across the media lifecycle28 Sep 2026
- 2026Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance25 Sep 2026
- 2026Deep-Fake CAPTCHA: Mitigating Next-Generation Social Engineering Attacks10 Sep 2026
- 2026Harnessing CLIP and DINO: An Uncertainty-Aware Cascaded Fusion Network for Generalizable Deepfake Image Detection7 Sep 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026AdaForensics: Learning A Characteristic-aware Adaptive Deepfake Detector3 Aug 2026
- 2026DINO-VPT: Hierarchical Visual Prompt Tuning for Joint Physical-Digital Face Anti-Spoofing23 Jul 2026
- 2026XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection3 Jul 2026
- 2026A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators12 Jun 2026
- 2026MFVLR: Multi-domain Fine-grained Vision-Language Reconstruction for Generalizable Diffusion Face Forgery Detection and Localization11 May 2026
- 2026Omni-Fake: Benchmarking Unified Multimodal Social Media Deepfake Detection2 May 2026
12 newest of 230 All 230 (JSON)