mlsanityData to 7 Oct 2026

AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising

arXiv 2603.14331 ↗First posted 15 Mar 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Real-time talking avatar generation requires low latency and minute-level temporal stability. Autoregressive (AR) forcing enables streaming inference but suffers from exposure bias, which causes errors to accumulate and become irreversible over long rollouts. In contrast, full-sequence diffusion transformers mitigate drift but remain computationally prohibitive for real-time long-form synthesis. We present AvatarForcing, a one-step streaming diffusion framework that denoises a fixed local-future window with heterogeneous noise levels and emits one clean block per step under constant per-step cost. To stabilize unbounded streams, the method introduces dual-anchor temporal forcing: a style anchor that re-indexes RoPE to maintain a fixed relative position with respect to the active window and applies anchor-audio zero-padding, and a temporal anchor that reuses recently emitted clean blocks to ensure smooth transitions. Real-time one-step inference is enabled by two-stage streaming distillation with offline ODE backfill and distribution matching. Experiments on standard benchmarks and a new 400-video long-form benchmark show strong visual quality and lip synchronization at 34 ms/frame using a 1.3B-parameter student model for realtime streaming. Our page is available at: https://cuiliyuan121.github.io/AvatarForcing/

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 49 of its 54 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

49 of 54 references.

References · 49

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  4. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  5. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  6. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  7. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  8. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  9. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
  10. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
  11. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  12. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
37 more
  1. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  2. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  3. 2024Autoregressive Video Generation without Vector Quantizationcited by 180
  4. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
  5. 2018Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separationcited by 160
  6. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  7. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
  8. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
  9. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 121
  10. 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
  11. 2025Long Context Tuning for Video Generationcited by 110
  12. 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
  13. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
  14. 2024Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharingcited by 70
  15. 2024AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encodingcited by 67
  16. 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 64
  17. 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
  18. 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
  19. 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusioncited by 53
  20. 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
  21. 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 47
  22. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
  23. 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
  24. 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generationcited by 41
  25. 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
  26. 2025EMO2: End-Effector Guided Audio-Driven Avatar Video Generationcited by 32
  27. 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 30
  28. 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Modelscited by 26
  29. 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
  30. 2025Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesiscited by 20
  31. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusioncited by 18
  32. 2025MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generationcited by 18
  33. 2024Streaming Video Diffusion: Online Video Editing with Diffusion Modelscited by 13
  34. 2025X-Actor: Emotional and Expressive Long-Range Portrait Acting from Audiocited by 3
  35. 2024MSC: Multi-Scale Spatio-Temporal Causal Attention for Autoregressive Video Diffusioncited by 2
  36. 2017A Convex Similarity Index for Sparse Recovery of Missing Image Samplescited by 1
  37. 2025SyncDiff: Diffusion-based Talking Head Synthesis with Bottlenecked Temporal Visual Prior for Improved Synchronizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
  2. 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation
  3. 2025SoulX-FlashTalk: Real-Time Infinite Streaming of Audio-Driven Avatars via Self-Correcting Bidirectional Distillation
  4. 2024DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking Head Video Generation
  5. 2026Decoupled Self-Forcing Distillation for Streaming Talking Head Generation
  6. 2024FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation
  7. 2026Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Video Avatar Generation
  8. 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation