mlsanityData to 14 Oct 2026

ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors

arXiv 2601.02359 ↗First posted 5 Jan 2026cs.CVcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Detecting unknown deepfake manipulations remains one of the most challenging problems in face forgery detection. Current state-of-the-art approaches fail to generalize to unseen manipulations, as they primarily rely on supervised training with existing deepfakes or pseudo-fakes, which leads to overfitting to specific forgery patterns. In contrast, self-supervised methods offer greater potential for generalization, but existing work struggles to learn discriminative representations only from self-supervision. In this paper, we propose ExposeAnyone, a fully self-supervised approach based on a diffusion model that generates expression sequences from audio. The key idea is, once the model is personalized to specific subjects using reference sets, it can compute the identity distances between suspected videos and personalized subjects via diffusion reconstruction errors, enabling person-of-interest face forgery detection. Extensive experiments demonstrate that 1) our method outperforms the previous state-of-the-art method by 4.22 percentage points in the average AUC on DF-TIMIT, DFDCP, KoDF, and IDForge datasets, 2) our model is also capable of detecting Sora2-generated videos, where the previous approaches perform poorly, and 3) our method is highly robust to corruptions such as blur and compression, highlighting the applicability in real-world face forgery detection.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 85 of its 112 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

85 of 112 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024A Bias-Free Training Paradigm for More General AI-generated Image Detection23 Dec
  2. 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error31 Jan
  3. 2023Your Diffusion Model is Secretly a Zero-Shot Classifier28 Mar
  4. 2023DIRE for Diffusion-Generated Image Detection16 Mar
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 80

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2016Layer Normalizationcited by 5,669
  11. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  12. 2017Neural Discrete Representation Learningcited by 4,712
38 more
  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  5. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  7. 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
  8. 2020First Order Motion Model for Image Animationcited by 704
  9. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  10. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  11. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  12. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
  13. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  14. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  15. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
  16. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
  17. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  18. 2022EDGE: Editable Dance Generation From Musiccited by 287
  19. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  20. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
  21. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  22. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  23. 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
  24. 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
  25. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
  26. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
  27. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
  28. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  29. 2022Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelscited by 174
  30. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
  31. 2018Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separationcited by 162
  32. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
  33. 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
  34. 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 131
  35. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  36. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
  37. 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
  38. 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization
  2. 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
  3. 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion
  4. 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysis
  5. 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detection
  6. 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning
  7. 2026IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models
  8. 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector