Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatars
Not on the map. Why?
Abstract (arXiv)
Existing streaming video systems often rely on sequential, distillation-centered training pipelines to enable few-step long-video generation. However, this paradigm suffers from two limitations. First, failures or distribution shifts introduced in earlier stages affect later optimization, complicating the training process to converge. Second, the distillation-centric objective favours short-term generation but is prone to quality degradation when autoregressive errors accumulate over long rollouts. We propose Avatar-Forever, a decoupled parallel training framework for high-quality real-time infinite interactive avatars. Instead of coupling generation efficiency and long-horizon robustness under a sequential distillation pipeline, we treat them as two independent capabilities that can be trained in parallel. One branch performs full-parameter distillation to train an efficient generator with high visual quality, while another trains a lightweight long-horizon adapter via Recovery-oriented Rollout Training (RRT), which improves generation robustness under long-horizon inference conditions. Our decoupled parallel training design simplifies the overall training process and avoids unnecessary objective conflicts between few-step generation and long-horizon adaptation. We further introduce ForeverCache, a chunk-wise feature caching mechanism to substantially reduce redundant history computation during streaming inference. Built upon a 22B video foundation model, Avatar-Forever supports unbounded audio-driven avatar generation while maintaining identity consistency, motion coherence, and visual fidelity, enabling an end-to-end throughput of high-resolution 768x512 videos at 27.2 FPS on a single H100 GPU and providing a practical path toward stable digital humans.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 54 of its 64 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
54 of 64 references.
References · 54
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2023Adversarial Diffusion Distillationcited by 759
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
38 more
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 235
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 220
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 202
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 194
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animationcited by 136
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2024Phased Consistency Modelscited by 85
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 83
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 73
- 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 72
- 2025Kling-Omni Technical Reportcited by 71
- 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 69
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
- 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 41
- 2015Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systemscited by 34
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
- 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Modelscited by 26
- 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 25
- 2026Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Modelcited by 25
- 2026Diversity-Preserved Distribution Matching Distillation for Fast Visual Synthesiscited by 20
- 2025TalkVid: A Large-Scale Diversified Dataset for Audio-Driven Talking Head Synthesiscited by 18
- 2025ARIG: Autoregressive Interactive Head Generation for Real-time Conversationscited by 16
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.