mlsanityData to 14 Oct 2026

Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis

arXiv 2504.14470 ↗First posted 20 Apr 2025cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Demand for 2K video synthesis is rising with increasing consumer expectations for ultra-clear visuals. While diffusion transformers (DiTs) have demonstrated remarkable capabilities in high-quality video generation, scaling them to 2K resolution remains computationally prohibitive due to quadratic growth in memory and processing costs. In this work, we propose Turbo2K, an efficient and practical framework for generating detail-rich 2K videos while significantly improving training and inference efficiency. First, Turbo2K operates in a highly compressed latent space, reducing computational complexity and memory footprint, making high-resolution video synthesis feasible. However, the high compression ratio of the VAE and limited model size impose constraints on generative quality. To mitigate this, we introduce a knowledge distillation strategy that enables a smaller student model to inherit the generative capacity of a larger, more powerful teacher model. Our analysis reveals that, despite differences in latent spaces and architectures, DiTs exhibit structural similarities in their internal representations, facilitating effective knowledge transfer. Second, we design a hierarchical two-stage synthesis framework that first generates multi-level feature at lower resolutions before guiding high-resolution video generation. This approach ensures structural coherence and fine-grained detail refinement while eliminating redundant encoding-decoding overhead, further enhancing computational efficiency.Turbo2K achieves state-of-the-art efficiency, generating 5-second, 24fps, 2K videos with significantly reduced computational cost. Compared to existing methods, Turbo2K is up to 20× faster for inference, making high-resolution video generation more scalable and practical for real-world applications.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 53 of its 68 references that are in the map. First posted on arXiv 20 Apr 2025.

Builds on

53 of 68 references.

References · 53

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2016Density estimation using Real NVPcited by 2,042
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  9. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  10. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  11. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  12. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
38 more
  1. 2016Pixel Recurrent Neural Networkscited by 816
  2. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  3. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  4. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  5. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
  6. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  7. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 329
  8. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  9. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
  10. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  11. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  12. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  13. 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
  14. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
  15. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
  16. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 128
  17. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 114
  18. 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 107
  19. 2024FlowAR: Scale-wise Autoregressive Image Generation Meets Flow Matchingcited by 80
  20. 2025Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generationcited by 71
  21. 2024UltraPixel: Advancing Ultra-High-Resolution Image Synthesis to New Peakscited by 65
  22. 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
  23. 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
  24. 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 60
  25. 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
  26. 2024Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesiscited by 56
  27. 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
  28. 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptationcited by 51
  29. 2025Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modelingcited by 48
  30. 2024LinFusion: 1 GPU, 1 Minute, 16K Imagecited by 43
  31. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  32. 2024CLEAR: Conv-Like Linearization Revs Pre-Trained Diffusion Transformers Upcited by 28
  33. 2021From Continuity to Editability: Inverting GANs with Consecutive Imagescited by 25
  34. 2024ResAdapter: Domain Consistent Resolution Adapter for Diffusion Modelscited by 23
  35. 2023Video Dehazing via a Multi-Range Temporal Alignment Network with Physical Priorcited by 22
  36. 2024Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learningcited by 19
  37. 2024Beyond Pixels: Text Enhances Generalization in Real-World Image Restorationcited by 17
  38. 2025MagicInfinite: Generating Infinite Talking Videos with Your Words and Voicecited by 16

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 6.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models
  2. 2025TurboVSR: Fantastic Video Upscalers and Where to Find Them
  3. 2024Towards Precise Scaling Laws for Video Diffusion Transformers
  4. 2023Photorealistic Video Generation with Diffusion Models
  5. 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation
  6. 2025CineScale: Tuning-Free High-Resolution Video Generation
  7. 2025CascadeV: An Implementation of Wurstchen Architecture for Video Generation
  8. 2026Efficient Video Diffusion Models: Advancements and Challenges