mlsanityData to 14 Oct 2026

Livatar-1: Real-Time Talking Heads Generation with Tailored Flow Matching

arXiv 2507.18649 ↗First posted 22 Jul 2025cs.CVcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

We present Livatar, a real-time audio-driven talking heads videos generation framework. Existing baselines suffer from limited lip-sync accuracy and long-term pose drift. We address these limitations with a flow matching based framework. Coupled with system optimizations, Livatar achieves competitive lip-sync quality with a 8.50 LipSync Confidence on the HDTF dataset, and reaches a throughput of 141 FPS with an end-to-end latency of 0.17s on a single A10 GPU. This makes high-fidelity avatars accessible to broader applications. Our project is available at https://www.hedra.com/ with with examples at https://h-liu1997.github.io/Livatar-1/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 13 of its 15 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

13 of 15 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer1 Dec

Other references · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2023PaLM 2 Technical Reportcited by 1,162
  7. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
  8. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
  9. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  10. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  11. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  12. 2024Sonic: Shifting Focus to Global Audio Perception in Portrait Animationcited by 72

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking Head Video Generation
  2. 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Models
  3. 2025Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
  4. 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation
  5. 2026AVTR-1: Open Stack for Real-Time Interactive Avatars
  6. 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Models
  7. 2026EmbodiedHead: Real-Time Listening and Speaking Avatar for Conversational Agents
  8. 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications