mlsanityData to 7 Oct 2026

TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation

arXiv 2604.14580 ↗First posted 16 Apr 2026cs.CV cs.MM cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Existing audio-driven video digital human generation models rely on multi-step denoising, resulting in substantial computational overhead that severely limits their deployment in real-world settings. While one-step distillation approaches can significantly accelerate inference, they often suffer from training instability. To address this challenge, we propose TurboTalk, a two-stage progressive distillation framework that effectively compresses a multi-step audio-driven video diffusion model into a single-step generator. We first adopt Distribution Matching Distillation to obtain a strong and stable 4-step student, and then progressively reduce the denoising steps from 4 to 1 through adversarial distillation. To ensure stable training under extreme step reduction, we introduce a progressive timestep sampling strategy and a self-compare adversarial objective that provides an intermediate adversarial reference that stabilizes progressive distillation. Our method achieve single-step generation of video talking avatar, boosting inference speed by 120 times while maintaining high generation quality.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 37 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

32 of 37 references.

References · 32

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  4. 2023Adversarial Diffusion Distillationcited by 741
  5. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  6. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  7. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  8. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  10. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  11. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  12. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
20 more
  1. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  2. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
  3. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  4. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  5. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  6. 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
  7. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
  8. 2018Nonlinear 3D Face Morphable Modelcited by 157
  9. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
  10. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
  11. 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
  12. 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 69
  13. 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
  14. 2025The GAN is dead; long live the GAN! A Modern GAN Baselinecited by 57
  15. 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 49
  16. 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 40
  17. 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
  18. 2023Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesiscited by 10
  19. 2025SoulX-FlashTalk: Real-Time Infinite Streaming of Audio-Driven Avatars via Self-Correcting Bidirectional Distillationcited by 10
  20. 2025Phased One-Step Adversarial Equilibrium for Video Diffusion Modelscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising
  2. 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Models
  3. 2024FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation
  4. 2026TempoSyncDiff: Distilled Temporally-Consistent Diffusion for Low-Latency Audio-Driven Talking Head Generation
  5. 2026Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling
  6. 2026Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Video Avatar Generation
  7. 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation
  8. 2024MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation