On Equivariance and Fast Sampling in Video Diffusion Models Trained with Warped Noise
On the map: Diffusion models → Video generation
Abstract (arXiv)
Temporally consistent video-to-video generation is critical for applications such as style transfer and upsampling. In this paper, we provide a theoretical analysis of warped noise - a recently proposed technique for training video diffusion models - and show that pairing it with the standard denoising objective implicitly trains models to be equivariant to spatial transformations of the input noise, which we term EquiVDM. This equivariance enables motion in the input noise to align naturally with motion in the generated video, yielding coherent, high-fidelity outputs without the need for specialized modules or auxiliary losses. A further advantage is sampling efficiency: EquiVDM achieves comparable or superior quality in far fewer sampling steps. When distilled into one-step student models, EquiVDM preserves equivariance and delivers stronger motion controllability and fidelity than distilled nonequivariant baselines. Across benchmarks, EquiVDM consistently outperforms prior methods in motion alignment, temporal consistency, and perceptual quality, while substantially lowering sampling cost.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 53 of its 69 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
53 of 69 references.
Closest ancestors · 15
Same direction, newest first
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
- 2025BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations13 Jan
- 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model15 Apr
- 2024TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Models25 Mar
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation27 Sep
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models17 May
- 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesis27 Apr
3 more
Other references · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024Depth Anything V2cited by 1,422
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
26 more
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2015Holistically-Nested Edge Detectioncited by 592
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2019Video Instance Segmentationcited by 393
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 278
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 168
- 2022Generative Modelling With Inverse Heat Dissipationcited by 167
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 89
- 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
- 2024Image Conductor: Precision Control for Interactive Video Synthesiscited by 63
- 2024VidGen-1M: A Large-Scale Dataset for Text-to-video Generationcited by 62
- 2025How I Warped Your Noise: a Temporally-Correlated Noise Prior for Diffusion Modelscited by 32
- 2024Blue noise for diffusion modelscited by 29
- 2024Warped Diffusion: Solving Video Inverse Problems with Image Diffusion Modelscited by 21
- 2025Consistent Flow Distillation for Text-to-3D Generationcited by 17
- 2024Infinite-Resolution Integral Noise Warping for Diffusion Modelscited by 5
- 2021Scalar Spatiotemporal Blue Noise Maskscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 7
- 2025Time-Correlated Video Bridge Matchingcited by 2
- 2025Score Augmentation for Diffusion Modelscited by 1
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generationcited by 0
- 2026SymRegFlow: Symmetry-Regularized Flow Matching for Video World Modelscited by 0
- 2026SymRegFlow: Symmetry-Regularized Flow Matching for Video World Models2 Oct 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation7 Apr 2026
- 2025Time-Correlated Video Bridge Matching14 Oct 2025
- 2025Score Augmentation for Diffusion Models11 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026Latent Temporal Discrepancy as Motion Prior: A Loss-Weighting Strategy for Dynamic Fidelity in T2V
- 2024Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approach
- 2024Video Interpolation with Diffusion Models
- 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers
- 2024Noise Crystallization and Liquid Noise: Zero-shot Video Generation using Image Diffusion Models
- 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
- 2023SmoothVideo: Smooth Video Synthesis with Noise Constraints on Diffusion Models for One-shot Video Tuning