mlsanityData to 7 Oct 2026

EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generation

arXiv 2602.13669 ↗First posted 14 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent multi-modal video generation models have achieved high visual quality, but their prohibitive latency and limited temporal stability hinder real-time deployment. Streaming inference exacerbates these issues, leading to pronounced multimodal degradation, such as spatial blurring, temporal drift, and lip desynchronization, which creates an unresolved efficiency-performance trade-off. To this end, we propose EchoTorrent, a novel schema with a fourfold design: (1) Multi-Teacher Training fine-tunes a pre-trained model on distinct preference domains to obtain specialized domain experts, which sequentially transfer domain-specific knowledge to a student model; (2) Adaptive CFG Calibration (ACC-DMD), which calibrates the audio CFG augmentation errors in DMD via a phased spatiotemporal schedule, eliminating redundant CFG computations and enabling single-pass inference per step; (3) Hybrid Long Tail Forcing, which enforces alignment exclusively on tail frames during long-horizon self-rollout training via a causal-bidirectional hybrid architecture, effectively mitigates spatiotemporal degradation in streaming mode while enhancing fidelity to reference frames; and (4) VAE Decoder Refiner through pixel-domain optimization of the VAE decoder to recover high-frequency details while circumventing latent-space ambiguities. Extensive experiments and analysis demonstrate that EchoTorrent achieves few-pass autoregressive generation with substantially extended temporal consistency, identity preservation, and audio-lip synchronization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 84 of its 91 references that are in the map. First posted on arXiv 14 Feb 2026.

Builds on

84 of 91 references.

References · 84

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  3. 2022Video Diffusion Modelscited by 2,280
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  6. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  7. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  9. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  10. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  11. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  12. 2023ModelScope Text-to-Video Technical Reportcited by 651
38 more
  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  2. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  3. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  4. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  5. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  6. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  7. 2025VACE: All-in-One Video Creation and Editingcited by 467
  8. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  9. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  10. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  11. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  12. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  13. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  14. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  15. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  16. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  17. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  18. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
  19. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  20. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  21. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  22. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  23. 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
  24. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  25. 2024Autoregressive Video Generation without Vector Quantizationcited by 180
  26. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
  27. 2025History-Guided Video Diffusioncited by 165
  28. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  29. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 159
  30. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  31. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
  32. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  33. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
  34. 2025Controllable Video Generation: A Surveycited by 93
  35. 2023VideoLCM: Video Latent Consistency Modelcited by 90
  36. 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
  37. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
  38. 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 75

50 most cited of 84 All 84 (JSON)

Built on by

Not cited yet.