mlsanityData to 14 Oct 2026

On Equivariance and Fast Sampling in Video Diffusion Models Trained with Warped Noise

arXiv 2504.09789 ↗First posted 14 Apr 2025cs.CV cs.AIcited by 5

On the map: Diffusion models → Video generation

Abstract (arXiv)

Temporally consistent video-to-video generation is critical for applications such as style transfer and upsampling. In this paper, we provide a theoretical analysis of warped noise - a recently proposed technique for training video diffusion models - and show that pairing it with the standard denoising objective implicitly trains models to be equivariant to spatial transformations of the input noise, which we term EquiVDM. This equivariance enables motion in the input noise to align naturally with motion in the generated video, yielding coherent, high-fidelity outputs without the need for specialized modules or auxiliary losses. A further advantage is sampling efficiency: EquiVDM achieves comparable or superior quality in far fewer sampling steps. When distilled into one-step student models, EquiVDM preserves equivariance and delivers stronger motion controllability and fidelity than distilled nonequivariant baselines. Across benchmarks, EquiVDM consistently outperforms prior methods in motion alignment, temporal consistency, and perceptual quality, while substantially lowering sampling cost.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 53 of its 69 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

53 of 69 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025VACE: All-in-One Video Creation and Editing10 Mar
  2. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
  3. 2025BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations13 Jan
  4. 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  6. 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model15 Apr
  7. 2024TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Models25 Mar
  8. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  10. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation27 Sep
  11. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models17 May
  12. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesis27 Apr
3 more
  1. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  2. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  3. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  9. 2024Depth Anything V2cited by 1,422
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  11. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  12. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
26 more
  1. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  2. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  3. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  4. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  5. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  6. 2015Holistically-Nested Edge Detectioncited by 592
  7. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  8. 2019Video Instance Segmentationcited by 393
  9. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  10. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  11. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  12. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 278
  13. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  14. 2021Pixel Difference Networks for Efficient Edge Detectioncited by 168
  15. 2022Generative Modelling With Inverse Heat Dissipationcited by 167
  16. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  17. 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 89
  18. 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
  19. 2024Image Conductor: Precision Control for Interactive Video Synthesiscited by 63
  20. 2024VidGen-1M: A Large-Scale Dataset for Text-to-video Generationcited by 62
  21. 2025How I Warped Your Noise: a Temporally-Correlated Noise Prior for Diffusion Modelscited by 32
  22. 2024Blue noise for diffusion modelscited by 29
  23. 2024Warped Diffusion: Solving Video Inverse Problems with Image Diffusion Modelscited by 21
  24. 2025Consistent Flow Distillation for Text-to-3D Generationcited by 17
  25. 2024Infinite-Resolution Integral Noise Warping for Diffusion Modelscited by 5
  26. 2021Scalar Spatiotemporal Blue Noise Maskscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Latent Temporal Discrepancy as Motion Prior: A Loss-Weighting Strategy for Dynamic Fidelity in T2V
  2. 2024Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approach
  3. 2024Video Interpolation with Diffusion Models
  4. 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation
  5. 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers
  6. 2024Noise Crystallization and Liquid Noise: Zero-shot Video Generation using Image Diffusion Models
  7. 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
  8. 2023SmoothVideo: Smooth Video Synthesis with Noise Constraints on Diffusion Models for One-shot Video Tuning