EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent multi-modal video generation models have achieved high visual quality, but their prohibitive latency and limited temporal stability hinder real-time deployment. Streaming inference exacerbates these issues, leading to pronounced multimodal degradation, such as spatial blurring, temporal drift, and lip desynchronization, which creates an unresolved efficiency-performance trade-off. To this end, we propose EchoTorrent, a novel schema with a fourfold design: (1) Multi-Teacher Training fine-tunes a pre-trained model on distinct preference domains to obtain specialized domain experts, which sequentially transfer domain-specific knowledge to a student model; (2) Adaptive CFG Calibration (ACC-DMD), which calibrates the audio CFG augmentation errors in DMD via a phased spatiotemporal schedule, eliminating redundant CFG computations and enabling single-pass inference per step; (3) Hybrid Long Tail Forcing, which enforces alignment exclusively on tail frames during long-horizon self-rollout training via a causal-bidirectional hybrid architecture, effectively mitigates spatiotemporal degradation in streaming mode while enhancing fidelity to reference frames; and (4) VAE Decoder Refiner through pixel-domain optimization of the VAE decoder to recover high-frequency details while circumventing latent-space ambiguities. Extensive experiments and analysis demonstrate that EchoTorrent achieves few-pass autoregressive generation with substantially extended temporal consistency, identity preservation, and audio-lip synchronization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 84 of its 91 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
84 of 91 references.
References · 84
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2023ModelScope Text-to-Video Technical Reportcited by 651
38 more
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
- 2024Autoregressive Video Generation without Vector Quantizationcited by 180
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2025History-Guided Video Diffusioncited by 165
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 159
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2025Controllable Video Generation: A Surveycited by 93
- 2023VideoLCM: Video Latent Consistency Modelcited by 90
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 75
50 most cited of 84 All 84 (JSON)
Built on by
Not cited yet.