JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusion
Not on the map. Why?
Abstract (arXiv)
Existing DiT-based audio-driven avatar generation methods have achieved considerable progress, yet their broader application is constrained by limitations such as high computational overhead and the inability to synthesize long-duration videos. Autoregressive methods address this problem by applying block-wise autoregressive diffusion methods. However, these methods suffer from the problem of error accumulation and quality degradation. To address this, we propose JoyStreamer-Flash, an audio-driven autoregressive model capable of real-time inference and infinite-length video generation with the following contributions: (1) Progressive Step Bootstrapping (PSB), which allocates more denoising steps to initial frames to stabilize generation and reduce error accumulation; (2) Motion Condition Injection (MCI), enhancing temporal coherence by injecting noise-corrupted previous frames as motion condition; and (3) Unbounded RoPE via Cache-Resetting (URCR), enabling infinite-length generation through dynamic positional encoding. Our 1.3B-parameter causal model achieves 16 FPS on a single GPU and achieves competitive results in visual quality, temporal consistency, and lip synchronization.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 31 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
26 of 31 references.
References · 26
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
14 more
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 83
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 61
- 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generationcited by 44
- 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 41
- 2025EchoMimicV3: 1.3B Parameters are All You Need for Unified Multi-Modal and Multi-Task Human Animationcited by 29
- 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Modelscited by 26
- 2025Hallo4: High-Fidelity Dynamic Portrait Animation via Direct Preference Optimizationcited by 16
- 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2026LongCat-Video-Avatar 1.5 Technical Reportcited by 6
- 2026EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generationcited by 0
- 2026LongCat-Video-Avatar 1.5 Technical Report26 May 2026
- 2026LPM 1.0: Video-based Character Performance Model9 Apr 2026
- 2026EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generation14 Feb 2026