mlsanityData to 7 Oct 2026

ObamaNet: Photo-realistic lip-sync from text

arXiv 1801.01442 ↗First posted 6 Dec 2017cs.CVcited by 42

Not on the map. Why?

Abstract (arXiv)

We present ObamaNet, the first architecture that generates both audio and synchronized photo-realistic lip-sync videos from any new text. Contrary to other published lip-sync approaches, ours is only composed of fully trainable neural modules and does not rely on any traditional computer graphics methods. More precisely, we use three main modules: a text-to-speech network based on Char2Wav, a time-delayed LSTM to generate mouth-keypoints synced to the audio, and a network based on Pix2Pix to generate the video frames conditioned on the keypoints.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Dec 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 6; 2022: 12; 2023: 10; 2024: 4; 2025: 6; 2026: 4.

42 papers.

Sort:

By area:

  1. 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
  2. 2023FT2TF: First-Person Statement Text-To-Talking Face Generationcited by 26
  3. 2022Deep Learning for Visual Speech Analysis: A Surveycited by 21
  4. 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Textcited by 21
  5. 2022Face-Dubbing++: Lip-Synchronous, Voice Preserving Translation of Videoscited by 18
  6. 2021AnyoneNet: Synchronized Speech and Talking Head Generation for Arbitrary Personcited by 17
  7. 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
  8. 2021More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speechcited by 12
  9. 2023Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Videocited by 11
  10. 2024MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generationcited by 10
  11. 2025AV-Flow: Transforming Text to Audio-Visual Human-like Interactionscited by 9
  12. 2025OmniTalker: One-shot Real-time Text-Driven Talking Audio-Video Generation With Multimodal Style Mimickingcited by 9
30 more
  1. 2022Lip-to-Speech Synthesis for Arbitrary Speakers in the Wildcited by 8
  2. 2023UniFLG: Unified Facial Landmark Generator from Text or Speechcited by 8
  3. 2023Text-to-Video: a Two-stage Framework for Zero-shot Identity-agnostic Talking-head Generationcited by 8
  4. 2021Parallel and High-Fidelity Text-to-Lip Generationcited by 7
  5. 2022Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wildcited by 7
  6. 2023VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfercited by 7
  7. 2023Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realismcited by 3
  8. 2024The Lost Melody: Empirical Observations on Text-to-Video Generation From A Storytelling Perspectivecited by 3
  9. 2022An Audio-Visual Attention Based Multimodal Network for Fake Talking Face Videos Detectioncited by 2
  10. 2022End to End Lip Synchronization with a Temporal AutoEncodercited by 2
  11. 2022Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scalecited by 2
  12. 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detectioncited by 2
  13. 2023HDTR-Net: A Real-Time High-Definition Teeth Restoration Network for Arbitrary Talking Face Generation Methodscited by 2
  14. 2025Controllable and Expressive One-Shot Video Head Swappingcited by 2
  15. 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splattingcited by 2
  16. 2021Fake Visual Content Detection Using Two-Stream Convolutional Neural Networkscited by 1
  17. 2021Fine-grained Identity Preserving Landmark Synthesis for Face Reenactmentcited by 1
  18. 2022FlexLip: A Controllable Text-to-Lip Systemcited by 1
  19. 2022AutoLV: Automatic Lecture Video Generatorcited by 1
  20. 2023FTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interactioncited by 1
  21. 2024LokiTalk: Learning Fine-Grained and Generalizable Correspondences to Enhance NeRF-based Talking Head Synthesiscited by 1
  22. 2025MMGT: Motion Mask Guided Two-Stage Network for Co-Speech Gesture Video Generationcited by 1
  23. 2022Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video Podcastscited by 0
  24. 2022All's well that FID's well? Result quality and metric scores in GAN models for lip-sychronization taskscited by 0
  25. 2023CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generationcited by 0
  26. 2025FluentLip: A Phonemes-Based Two-stage Approach for Audio-Driven Lip Synthesis with Optical Flow Consistencycited by 0
  27. 2025Taming Transformer for Emotion-Controllable Talking Face Generationcited by 0
  28. 2026LPIPS-AttnWav2Lip: Generic Audio-Driven lip synchronization for Talking Head Generation in the Wildcited by 0
  29. 2026PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactmentcited by 0
  30. 2026Test-Time Self-Adaptive Conditioning for Stable Audio-Driven Talking-Head Generationcited by 0