TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation
Not on the map. Why?
Abstract (arXiv)
Existing audio-driven video digital human generation models rely on multi-step denoising, resulting in substantial computational overhead that severely limits their deployment in real-world settings. While one-step distillation approaches can significantly accelerate inference, they often suffer from training instability. To address this challenge, we propose TurboTalk, a two-stage progressive distillation framework that effectively compresses a multi-step audio-driven video diffusion model into a single-step generator. We first adopt Distribution Matching Distillation to obtain a strong and stable 4-step student, and then progressively reduce the denoising steps from 4 to 1 through adversarial distillation. To ensure stable training under extreme step reduction, we introduce a progressive timestep sampling strategy and a self-compare adversarial objective that provides an intermediate adversarial reference that stabilizes progressive distillation. Our method achieve single-step generation of video talking avatar, boosting inference speed by 120 times while maintaining high generation quality.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 37 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
32 of 37 references.
References · 32
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2023Adversarial Diffusion Distillationcited by 741
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
20 more
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
- 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2018Nonlinear 3D Face Morphable Modelcited by 157
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
- 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 69
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
- 2025The GAN is dead; long live the GAN! A Modern GAN Baselinecited by 57
- 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 49
- 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 40
- 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
- 2023Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesiscited by 10
- 2025SoulX-FlashTalk: Real-Time Infinite Streaming of Audio-Driven Avatars via Self-Correcting Bidirectional Distillationcited by 10
- 2025Phased One-Step Adversarial Equilibrium for Video Diffusion Modelscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising
- 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Models
- 2024FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation
- 2026TempoSyncDiff: Distilled Temporally-Consistent Diffusion for Low-Latency Audio-Driven Talking Head Generation
- 2026Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling
- 2026Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Video Avatar Generation
- 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation
- 2024MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation