FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
The challenge of fair deepfake detection (FDD) has attracted increasing attention. Existing fairness-enhanced detectors often suffer from suboptimal generalization to unseen manipulations and fairness across demographic groups. They are typically developed and evaluated on demographically imbalanced distributions, resulting in biased predictions toward minority groups. In this paper, we construct a novel demographically balanced FDD benchmark to train and evaluate the fairness of detectors under both balanced and imbalanced population scenarios. Additionally, we introduce a novel expression and demographic perceptual vision-language model, termed FairForensics, for generalizable fair deepfake detection. FairForensics conducts face forgery generalization enhancement and demographic-aware fairness regularization. During face forgery generalization enhancement, built upon the novel observation of significant distribution differences between pristine and forged expression vectors, we design an expression encoder to capture high-level expression-guided forgery patterns, and an expression-perceptual visual encoder that integrates global appearance and expression forgery features while mitigating identity bias using an identity-aware patch perturbation module. Under demographic-aware fairness regularization, we propose a demographic-guided language encoder to extract population-aware global language embeddings, which boosts the decoupling of forgery features from demographic information via vision-language alignment. We devise a population-aware prototype fairness objective to enforce both inter-class separability and intra-class alignment across demographic subgroups. Extensive experiments on our balanced demographic benchmark show that our method achieves the state-of-the-art in terms of generalization and fairness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
32 of 38 references.
References · 32
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
- 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
20 more
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2022POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognitioncited by 49
- 2022Deepfake Network Architecture Attributioncited by 47
- 2024Diffusion Facial Forgery Detectioncited by 41
- 2023Improving Fairness in Deepfake Detectioncited by 40
- 2022GBDF: Gender Balanced DeepFake Dataset Towards Fair DeepFake Detectioncited by 32
- 2024Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detectioncited by 30
- 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28
- 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learningcited by 12
- 2024MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detectioncited by 11
- 2023CrossDF: Improving Cross-Domain Deepfake Detection with Deep Information Decompositioncited by 6
- 2024FairAdapter: Detecting AI-generated Images with Improved Fairnesscited by 6
- 2025Learning Counterfactually Decoupled Attention for Open-World Model Attributioncited by 5
- 2024Redundant Semantic Environment Filling via Misleading-Learning for Fair Deepfake Detectioncited by 2
- 2025Decoupling Bias, Aligning Distributions: Synergistic Fairness Optimization for Deepfake Detectioncited by 2
- 2024Bridging the Gaps: Utilizing Unlabeled Face Recognition Datasets to Boost Semi-Supervised Facial Expression Recognitioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion
- 2024Deepfake Generation and Detection: A Benchmark and Survey
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Model
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection
- 2025AuthGuard: Generalizable Deepfake Detection via Language Guidance
- 2025MLLM-Enhanced Face Forgery Detection: A Vision-Language Fusion Solution
- 2025LLMs Are Not Yet Ready for Deepfake Image Detection