EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics
Not on the map. Why?
Abstract (arXiv)
DiT video generation is latency-intensive due to iterative full-frame denoising, while prior cloud-edge methods largely rely on static inter-step decoupling and cannot leverage inter-frame similarity or adapt to system dynamics. We propose EcoVideo, an entropy-orchestrated framework for dynamic inter-frame decoupling: early-stage self-attention entropy provides a training-free estimate of frame-wise information density for frame selection; a cloud large model denoises sparse high-entropy keyframes; and an edge lightweight model reconstructs the remaining frames via motion-aware interpolation with refinement for temporal stability. EcoVideo further adapts the keyframe budget and edge refinement depth to real-time bandwidth and compute availability, optimizing end-to-end latency under constraints. Experiments on representative DiT video generators show improved quality--efficiency trade-offs and up to 2.9x end-to-end speedup in low-bandwidth, compute-limited edge settings. Code is available at https://github.com/IF-LAB-PKU/EcoVideo.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 38 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
35 of 38 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2017Generative Adversarial Networks: An Overviewcited by 590
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
23 more
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 217
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 171
- 2024Accelerating Diffusion Transformers with Token-wise Feature Cachingcited by 156
- 2025Fast Video Generation with Sliding Tile Attentioncited by 128
- 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Modelscited by 98
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
- 2024T-Stitch: Accelerating Sampling in Pre-Trained Diffusion Models with Trajectory Stitchingcited by 33
- 2025FlashVideo: Flowing Fidelity to Detail for Efficient High-Resolution Video Generationcited by 32
- 2024PipeFusion: Patch-level Pipeline Parallelism for Diffusion Transformers Inferencecited by 28
- 2024Hierarchical Patch Diffusion Models for High-Resolution Video Generationcited by 24
- 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generationcited by 21
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
- 2025Towards Better & Faster Autoregressive Image Generation: From the Perspective of Entropycited by 12
- 2023Cloud-Device Collaborative Learning for Multimodal Large Language Modelscited by 11
- 2024Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Modelscited by 11
- 2026Attention Sparsity is Input-Stable: Training-Free Sparse Attention for Video Generation via Offline Sparsity Profiling and Online QK Co-Clusteringcited by 10
- 2025KeyVID: Keyframe-Aware Video Diffusion for Audio-Synchronized Visual Animationcited by 8
- 2025SRDiffusion: Accelerate Video Diffusion Inference via Sketching-Rendering Cooperationcited by 7
- 2026ToProVAR: Efficient Visual Autoregressive Modeling via Tri-Dimensional Entropy-Aware Semantic Analysis and Sparsity Optimizationcited by 5
- 2025TempoMaster: Efficient Long Video Generation via Next-Frame-Rate Predictioncited by 4
- 2025EC-Diff: Fast and High-Quality Edge-Cloud Collaborative Inference for Diffusion Modelscited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.