ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Detecting unknown deepfake manipulations remains one of the most challenging problems in face forgery detection. Current state-of-the-art approaches fail to generalize to unseen manipulations, as they primarily rely on supervised training with existing deepfakes or pseudo-fakes, which leads to overfitting to specific forgery patterns. In contrast, self-supervised methods offer greater potential for generalization, but existing work struggles to learn discriminative representations only from self-supervision. In this paper, we propose ExposeAnyone, a fully self-supervised approach based on a diffusion model that generates expression sequences from audio. The key idea is, once the model is personalized to specific subjects using reference sets, it can compute the identity distances between suspected videos and personalized subjects via diffusion reconstruction errors, enabling person-of-interest face forgery detection. Extensive experiments demonstrate that 1) our method outperforms the previous state-of-the-art method by 4.22 percentage points in the average AUC on DF-TIMIT, DFDCP, KoDF, and IDForge datasets, 2) our model is also capable of detecting Sora2-generated videos, where the previous approaches perform poorly, and 3) our method is highly robust to corruptions such as blur and compression, highlighting the applicability in real-world face forgery detection.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 85 of its 112 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
85 of 112 references.
Closest ancestors · 5
Same direction, newest first
- 2024A Bias-Free Training Paradigm for More General AI-generated Image Detection23 Dec
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error31 Jan
- 2023Your Diffusion Model is Secretly a Zero-Shot Classifier28 Mar
- 2023DIRE for Diffusion-Generated Image Detection16 Mar
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
Other references · 80
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2016Layer Normalizationcited by 5,669
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2017Neural Discrete Representation Learningcited by 4,712
38 more
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
- 2020First Order Motion Model for Image Animationcited by 704
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
- 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2022Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelscited by 174
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2018Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separationcited by 162
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
- 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 131
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization
- 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion
- 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysis
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detection
- 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning
- 2026IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector