DC-VideoGen: Efficient Video Generation with Deep Compression Video Autoencoder
Not on the map. Why?
Abstract (arXiv)
We introduce DC-VideoGen, a post-training acceleration framework for efficient video generation. DC-VideoGen can be applied to any pre-trained video diffusion model, improving efficiency by adapting it to a deep compression latent space with lightweight fine-tuning. The framework builds on two key innovations: (i) a Deep Compression Video Autoencoder with a novel chunk-causal temporal design that achieves 32x/64x spatial and 4x temporal compression while preserving reconstruction quality and generalization to longer videos; and (ii) AE-Adapt-V, a robust adaptation strategy that enables rapid and stable transfer of pre-trained models into the new latent space. Adapting the pre-trained Wan-2.1-14B model with DC-VideoGen requires only 10 GPU days on the NVIDIA H100 GPU. The accelerated models achieve up to 14.8x lower inference latency than their base counterparts without compromising quality, and further enable 2160x3840 video generation on a single GPU. Code: https://github.com/dc-ai-projects/DC-VideoGen.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 63 of its 74 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
63 of 74 references.
References · 63
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
38 more
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2021ImageNet-21K Pretraining for the Massescited by 607
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2018A Short Note about Kinetics-600cited by 331
- 2015WIDER FACE: A Face Detection Benchmarkcited by 297
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 204
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelscited by 161
- 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2025Fast Video Generation with Sliding Tile Attentioncited by 123
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
- 2024OmniTokenizer: A Joint Image-Video Tokenizer for Visual Generationcited by 117
- 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
- 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationcited by 110
- 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutationcited by 100
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 91
- 2023VideoLCM: Video Latent Consistency Modelcited by 90
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 84
- 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagationcited by 76
- 2024CV-VAE: A Compatible Video VAE for Latent Generative Video Modelscited by 68
- 2025Training-free and Adaptive Sparse Attention for Efficient Long Video Generationcited by 65
- 2025Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generationcited by 64
- 2024AnimateDiff-Lightning: Cross-Model Diffusion Distillationcited by 47
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 13.
15 papers.
Sort:
By area:
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
- 2025Neodragon: Mobile Video Generation using Diffusion Transformercited by 10
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
- 2026FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Spacecited by 5
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026Ultra-Fast Neural Video Compressioncited by 3
- 2025Low-Resolution Editing is All You Need for High-Resolution Editingcited by 1
- 2026Latent-Compressed Variational Autoencoder for Video Diffusion Modelscited by 1
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolutioncited by 1
- 2026VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attentioncited by 1
- 2026JetViT: Efficient High-Resolution Vision Transformer with Post-Training Attention Searchcited by 0
- 2026Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEscited by 0
- 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher8 Oct 2026
- 2026GRACE: Generation-aware latent compression for efficient video generation7 Oct 2026
- 2026VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention14 Sep 2026
- 2026KVAE: Family of Tokenizers for Multimodal Generative Models6 Aug 2026
- 2026Ultra-Fast Neural Video Compression3 Jun 2026
- 2026Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs1 Jun 2026
- 2026JetViT: Efficient High-Resolution Vision Transformer with Post-Training Attention Search26 May 2026
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution25 May 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026Latent-Compressed Variational Autoencoder for Video Diffusion Models12 Apr 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2025Neodragon: Mobile Video Generation using Diffusion Transformercited by 10
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
- 2026FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Spacecited by 5
- 2026Latent-Compressed Variational Autoencoder for Video Diffusion Modelscited by 1
- 2026VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attentioncited by 1
- 2026Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEscited by 0
- 2026KVAE: Family of Tokenizers for Multimodal Generative Modelscited by 0
- 2026GRACE: Generation-aware latent compression for efficient video generationcited by 0
- 2026GRACE: Generation-aware latent compression for efficient video generation7 Oct 2026
- 2026VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention14 Sep 2026
- 2026KVAE: Family of Tokenizers for Multimodal Generative Models6 Aug 2026
- 2026Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs1 Jun 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026Latent-Compressed Variational Autoencoder for Video Diffusion Models12 Apr 2026
- 2026FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Space2 Feb 2026
- 2025Neodragon: Mobile Video Generation using Diffusion Transformer8 Nov 2025
- 2026Ultra-Fast Neural Video Compressioncited by 3
- 2025Low-Resolution Editing is All You Need for High-Resolution Editingcited by 1
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolutioncited by 1
- 2026JetViT: Efficient High-Resolution Vision Transformer with Post-Training Attention Searchcited by 0
- 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teachercited by 0
- 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher8 Oct 2026
- 2026Ultra-Fast Neural Video Compression3 Jun 2026
- 2026JetViT: Efficient High-Resolution Vision Transformer with Post-Training Attention Search26 May 2026
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution25 May 2026
- 2025Low-Resolution Editing is All You Need for High-Resolution Editing25 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Latent Inter-Frame Pruning: A Training-Free Method Bridging Traditional Video Compression and Modern Diffusion Transformers for Efficient Generation
- 2024ZeroSmooth: Training-free Diffuser Adaptation for High Frame Rate Video Generation
- 2025PipeDiT: Accelerating Diffusion Transformers in Video Generation with Task Pipelining and Model Decoupling
- 2026Generative Video Compression with Adaptive Score Distillation
- 2025GigaVideo-1: Advancing Video Generation via Automatic Feedback with 4 GPU-Hours Fine-Tuning
- 2026Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache Quantization
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Models
- 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching