Pusa V1.0: Unlocking Temporal Control in Pretrained Video Diffusion Models via Vectorized Timestep Adaptation
On the map: Diffusion models → Video generation
Abstract (arXiv)
The rapid advancement of video diffusion models has been hindered by fundamental limitations in temporal modeling, particularly the rigid synchronization of frame evolution imposed by conventional scalar timestep variables. While task-specific adaptations and autoregressive models have sought to address these challenges, they remain constrained by computational inefficiency, catastrophic forgetting, or narrow applicability. In this work, we present Pusa V1.0, a versatile model that leverages vectorized timestep adaptation (VTA) to enable fine-grained temporal control within a unified video diffusion framework. Note that VTA is a non-destructive adaptation, which means that it fully preserves the capabilities of the base model. Unlike conventional methods like Wan-I2V, which finetune a base text-to-video (T2V) model with abundant resources to do image-to-video (I2V), we achieve comparable results in a zero-shot manner after an ultra-efficient finetuning process based on VTA. Moreover, this method also unlocks many other zero-shot capabilities simultaneously, such as start-end frames and video extension -- all without task-specific training. Meanwhile, it keeps the T2V capability from the base model. Mechanistic analyses also reveal that our approach preserves the foundation model's generative priors while surgically injecting temporal dynamics, avoiding the combinatorial explosion inherent to the vectorized timestep. This work establishes a scalable, efficient, and versatile paradigm for next-generation video synthesis, democratizing high-fidelity video generation for research and industry alike.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 37 of its 46 references that are in the map. First posted on arXiv 22 Jul 2025.
Builds on
37 of 46 references.
Closest ancestors · 22
Same direction, newest first
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr
- 2025Error Analyses of Auto-Regressive Video Diffusion Models: A Unified Framework12 Mar
- 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion10 Mar
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers21 Feb
- 2024Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approach4 Oct
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation27 Aug
- 2024EasyControl: Transfer ControlNet to Video Diffusion for Controllable Generation and Interpolation23 Aug
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention29 Jul
- 2024ExVideo: Extending Video Diffusion Models via Parameter-Efficient Post-Tuning20 Jun
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Training19 May
- 2024TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models25 Apr
10 more
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
- 2024Tuning-Free Noise Rectification for High Fidelity Image-to-Video Generation5 Mar
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models7 Nov
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
- 2023A Survey on Video Diffusion Models16 Oct
- 2023ModelScope Text-to-Video Technical Report12 Aug
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov
- 2022Video Diffusion Models7 Apr
Other references · 15
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2024LoRA Learns Less and Forgets Lesscited by 328
3 more
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025One-Minute Video Generation with Test-Time Trainingcited by 101
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Uniform Discrete Diffusion with Metric Path for Video Generationcited by 12
- 2026FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Spacecited by 5
- 2026Enhancing Train-Free Infinite-Frame Generation for Consistent Long Videoscited by 1
- 2026Beyond Text Prompts: Visual-to-Visual Generation as A Unified Paradigmcited by 0
- 2026Enhancing Train-Free Infinite-Frame Generation for Consistent Long Videos18 May 2026
- 2026Beyond Text Prompts: Visual-to-Visual Generation as A Unified Paradigm12 May 2026
- 2026FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Space2 Feb 2026
- 2025Uniform Discrete Diffusion with Metric Path for Video Generation28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Temporal In-Context Fine-Tuning with Temporal Reasoning for Versatile Control of Video Diffusion Models
- 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model
- 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
- 2026Adapting VACE for Real-Time Autoregressive Video Diffusion
- 2025Efficient Temporal Consistency in Diffusion-Based Video Editing with Adaptor Modules: A Theoretical Framework
- 2025Enabling Versatile Controls for Video Diffusion Models
- 2026Making Time Editable in Video Diffusion Transformers
- 2025LiftVSR: Lifting Image Diffusion to Video Super-Resolution via Hybrid Temporal Modeling with Only 4×RTX 4090s