mlsanityData to 7 Oct 2026

Referee: Reference-aware Audiovisual Deepfake Detection

arXiv 2510.27475 ↗First posted 31 Oct 2025cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Deepfakes generated by advanced generative models have rapidly posed serious threats, yet existing audiovisual deepfake detection approaches struggle to generalize to unseen manipulation methods. To address this, we propose a novel reference-aware audiovisual deepfake detection method, called Referee to capture fine-grained identity discrepancies. Unlike existing methods that overfit to transient spatiotemporal artifacts, Referee employs identity bottleneck and matching modules to model the relational consistency of speaker-specific cues captured by a single one-shot example as a biometric anchor. Extensive experiments on FakeAVCeleb, FaceForensics++, and KoDF demonstrate that Referee achieves state-of-the-art results on cross-dataset and cross-language evaluation protocols, including a 99.4% AUC on KoDF. These results highlight that explicitly correlating reference-based biometric priors is a key frontier for achieving generalized and reliable audiovisual forensics. The code is available at https://github.com/ewha-mmai/referee.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

36 of 49 references.

References · 36

  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  2. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  3. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  4. 2020First Order Motion Model for Image Animationcited by 698
  5. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  6. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  7. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
  8. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  9. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  10. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
  11. 2018LRS3-TED: a large-scale dataset for visual speech recognitioncited by 301
  12. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
24 more
  1. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 280
  2. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
  3. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
  4. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
  5. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
  6. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
  7. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  8. 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 129
  9. 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
  10. 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
  11. 2024Synchformer: Efficient Synchronization from Sparse Cuescited by 94
  12. 2020Audio-driven Talking Face Video Generation with Learning-based Personalized Head Posecited by 92
  13. 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 84
  14. 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
  15. 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
  16. 2018Seeing Voices and Hearing Faces: Cross-modal biometric matchingcited by 60
  17. 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
  18. 2021Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Facescited by 48
  19. 2022Voice-Face Homogeneity Tells Deepfakecited by 44
  20. 2022Audio-Visual Person-of-Interest DeepFake Detectioncited by 43
  21. 2024Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakescited by 32
  22. 2023Imaginary Voice: Face-styled Diffusion Model for Text-to-Speechcited by 27
  23. 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillationcited by 6
  24. 2025SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detectioncited by 6

Built on by

Not cited yet.