mlsanityData to 14 Oct 2026

Complementary rPPG-Derived and Lip-Region Frequency Cues for Talking-Face Deepfake Detection

arXiv 2609.22284 ↗First posted 13 Sep 2026cs.CV cs.AI cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Talking-face (TF) deepfakes are detected unevenly by rPPG-based methods across generators. We study two lightweight visual-only cues, rPPG-derived waveforms extracted by RhythmFormer and lip-region discrete cosine transform (DCT) coefficients, on the seven TF methods of Celeb-DF++ under a subject-independent protocol. In-domain, lip-region DCT matches or exceeds the rPPG-derived 1D ResNet on every method except SadTalker, and Concat fusion reaches AUC 0.891 against 0.824 and 0.827 for the unimodal baselines. Under leave-one-generator-out evaluation the cues split: each transfers clearly better to three held-out methods, and IP-LAP is near chance for both. Concat averages 0.798 but falls below rPPG alone where DCT transfers poorly, so static fusion only partly exploits this complementarity. Lip-region DCT outperforms full-face DCT on six of seven methods. We treat the rPPG-derived signal as an empirical cue and do not claim it is cardiac in origin.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

19 of 24 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  3. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  4. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  5. 2017Gated Multimodal Units for Information Fusioncited by 248
  6. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  7. 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
  8. 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 98
  9. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  10. 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
  11. 2019BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUscited by 74
  12. 2024AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encodingcited by 67
7 more
  1. 2020DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythmscited by 65
  2. 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
  3. 2024Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakescited by 32
  4. 2020Attention Mesh: High-fidelity Face Mesh Prediction in Real-timecited by 30
  5. 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 30
  6. 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 21
  7. 2025Detecting Lip-Syncing Deepfakes: Vision Temporal Transformer for Analyzing Mouth Inconsistenciescited by 7

Built on by

Not cited yet.