mlsanityData to 14 Oct 2026

Exposing Lip-syncing Deepfakes from Mouth Inconsistencies

arXiv 2401.10113 ↗First posted 18 Jan 2024cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

A lip-syncing deepfake is a digitally manipulated video in which a person's lip movements are created convincingly using AI models to match altered or entirely new audio. Lip-syncing deepfakes are a dangerous type of deepfakes as the artifacts are limited to the lip region and more difficult to discern. In this paper, we describe a novel approach, LIP-syncing detection based on mouth INConsistency (LIPINC), for lip-syncing deepfake detection by identifying temporal inconsistencies in the mouth region. These inconsistencies are seen in the adjacent frames and throughout the video. Our model can successfully capture these irregularities and outperforms the state-of-the-art methods on several benchmark deepfake datasets. Code is available at https://github.com/skrantidatta/LIPINC

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 26 of its 36 references that are in the map. First posted on arXiv 18 Jan 2024.

Builds on

26 of 36 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  4. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  5. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  6. 2018Deep Audio-Visual Speech Recognitioncited by 322
  7. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
  8. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
  9. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  10. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 282
  11. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
  12. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
14 more
  1. 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 131
  2. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  3. 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
  4. 2019Deep Learning for Deepfakes Creation and Detection: A Surveycited by 102
  5. 2020Audio-driven Talking Face Video Generation with Learning-based Personalized Head Posecited by 92
  6. 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 85
  7. 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
  8. 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
  9. 2019GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detectioncited by 42
  10. 2020DeepFakes Evolution: Analysis of Facial Regions and Fake Detection Performancecited by 22
  11. 2022FNeVR: Neural Volume Rendering for Face Animationcited by 22
  12. 2021Watch Those Words: Video Falsification Detection Using Word-Conditioned Facial Motioncited by 15
  13. 2023Integrating Audio-Visual Features for Multimodal Deepfake Detectioncited by 9
  14. 2023Unsupervised Multimodal Deepfake Detection Using Intra- and Cross-Modal Inconsistenciescited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 9; 2026: 3.

15 papers.

Sort:

By area:

  1. 2025Detecting Lip-Syncing Deepfakes: Vision Temporal Transformer for Analyzing Mouth Inconsistenciescited by 7
  2. 2025KLASSify to Verify: Audio-Visual Deepfake Detection Using SSL-based Audio and Handcrafted Visual Featurescited by 5
  3. 2025PIA: Deepfake Detection Using Phoneme-Temporal and Identity-Dynamic Analysiscited by 5
  4. 2024Human Action CLIPs: Detecting AI-generated Human Motioncited by 4
  5. 2024DeepFake-O-Meter v2.0: An Open Platform for DeepFake Detectioncited by 3
  6. 2025Pindrop it! Audio and Visual Deepfake Countermeasures for Robust Detection and Fine Grained-Localizationcited by 3
  7. 2026Omni-Fake: Benchmarking Unified Multimodal Social Media Deepfake Detectioncited by 3
  8. 2025GC-ConsFlow: Leveraging Optical Flow Residuals and Global Context for Robust Deepfake Detectioncited by 2
  9. 2025Deepfake Forensic Analysis: Source Dataset Attribution and Legal Implications of Synthetic Media Manipulationcited by 1
  10. 2025Video Forgery Detection with Optical Flow Residuals and Spatial-Temporal Consistencycited by 1
  11. 2025Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?cited by 1
  12. 2024Improving Lip-synchrony in Direct Audio-Visual Speech-to-Speech Translationcited by 0
3 more
  1. 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
  2. 2026BioLip: Language-Generalizable Lip-Sync Deepfake Detection via Biomechanical Constraint Violation Modelingcited by 0
  3. 2026CAM-VFD: Cross-Attention Multimodal Video Forgery Detectioncited by 0