AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising
Not on the map. Why?
Abstract (arXiv)
Real-time talking avatar generation requires low latency and minute-level temporal stability. Autoregressive (AR) forcing enables streaming inference but suffers from exposure bias, which causes errors to accumulate and become irreversible over long rollouts. In contrast, full-sequence diffusion transformers mitigate drift but remain computationally prohibitive for real-time long-form synthesis. We present AvatarForcing, a one-step streaming diffusion framework that denoises a fixed local-future window with heterogeneous noise levels and emits one clean block per step under constant per-step cost. To stabilize unbounded streams, the method introduces dual-anchor temporal forcing: a style anchor that re-indexes RoPE to maintain a fixed relative position with respect to the active window and applies anchor-audio zero-padding, and a temporal anchor that reuses recently emitted clean blocks to ensure smooth transitions. Real-time one-step inference is enabled by two-stage streaming distillation with offline ODE backfill and distribution matching. Experiments on standard benchmarks and a new 400-video long-form benchmark show strong visual quality and lip synchronization at 34 ms/frame using a 1.3B-parameter student model for realtime streaming. Our page is available at: https://cuiliyuan121.github.io/AvatarForcing/
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 49 of its 54 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
49 of 54 references.
References · 49
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
37 more
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2024Autoregressive Video Generation without Vector Quantizationcited by 180
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2018Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separationcited by 160
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
- 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 121
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
- 2025Long Context Tuning for Video Generationcited by 110
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
- 2024Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharingcited by 70
- 2024AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encodingcited by 67
- 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 64
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
- 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusioncited by 53
- 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
- 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 47
- 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
- 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
- 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generationcited by 41
- 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
- 2025EMO2: End-Effector Guided Audio-Driven Avatar Video Generationcited by 32
- 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 30
- 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Modelscited by 26
- 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
- 2025Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesiscited by 20
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusioncited by 18
- 2025MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generationcited by 18
- 2024Streaming Video Diffusion: Online Video Editing with Diffusion Modelscited by 13
- 2025X-Actor: Emotional and Expressive Long-Range Portrait Acting from Audiocited by 3
- 2024MSC: Multi-Scale Spatio-Temporal Causal Attention for Autoregressive Video Diffusioncited by 2
- 2017A Convex Similarity Index for Sparse Recovery of Missing Image Samplescited by 1
- 2025SyncDiff: Diffusion-based Talking Head Synthesis with Bottlenecked Temporal Visual Prior for Improved Synchronizationcited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2026Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Modelscited by 7
- 2026Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generationcited by 4
- 2026Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectificationcited by 1
- 2026Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatarscited by 1
- 2026TaoMate: Anchor-Guided Memory Bridging Evolving and Reference States for Real-Time Audio-Video Digital Human Generationcited by 0
- 2026Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation10 Sep 2026
- 2026Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatars12 Aug 2026
- 2026Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectification6 Aug 2026
- 2026TaoMate: Anchor-Guided Memory Bridging Evolving and Reference States for Real-Time Audio-Video Digital Human Generation27 Jul 2026
- 2026Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models23 Jun 2026
- 2026LPM 1.0: Video-based Character Performance Model9 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
- 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation
- 2025SoulX-FlashTalk: Real-Time Infinite Streaming of Audio-Driven Avatars via Self-Correcting Bidirectional Distillation
- 2024DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking Head Video Generation
- 2026Decoupled Self-Forcing Distillation for Streaming Talking Head Generation
- 2024FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation
- 2026Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Video Avatar Generation
- 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation