Physics-Guided Motion Loss for Video Generation Model
On the map: Diffusion models → Video generation
Abstract (arXiv)
Current video diffusion models generate visually compelling content but often violate basic laws of physics, producing subtle artifacts like rubber-sheet deformations and inconsistent object motion. We introduce a frequency-domain physics prior that improves motion plausibility without modifying model architectures. Our method decomposes common rigid motions (translation, rotation, scaling) into lightweight spectral losses, requiring only 2.7% of frequency coefficients while preserving 97%+ of spectral energy. Applied to Open-Sora, MVDIT, and Hunyuan, our approach improves both motion accuracy and action recognition by ~11% on average on OpenVID-1M (relative), while maintaining visual quality. User studies show 74--83% preference for our physics-enhanced videos. It also reduces warping error by 22--37% (depending on the backbone) and improves temporal consistency scores. These results indicate that simple, global spectral cues are an effective drop-in regularizer for physically plausible motion in video diffusion.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 28 of its 51 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
28 of 51 references.
Closest ancestors · 5
Same direction, newest first
- 2024MotionCraft: Physics-based Zero-Shot Video Generation22 May
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation22 Mar
- 2022Flexible Diffusion Modeling of Long Videos23 May
Other references · 23
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2017Video Enhancement with Task-Oriented Flowcited by 619
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
- 2016Generating Videos with Scene Dynamicscited by 376
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
11 more
- 2016Temporal Generative Adversarial Nets with Singular Value Clippingcited by 198
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 195
- 2019Scaling Autoregressive Video Modelscited by 190
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2019High Fidelity Video Prediction with Large Stochastic Recurrent Neural Networkscited by 88
- 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
- 2020Would Mega-scale Datasets Further Enhance Spatiotemporal 3D CNNs?cited by 31
- 2016Optical Flow with Semantic Segmentation and Localized Layerscited by 21
- 2017Two-Stream Convolutional Networks for Dynamic Texture Synthesiscited by 15
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation
- 2026Latent Temporal Discrepancy as Motion Prior: A Loss-Weighting Strategy for Dynamic Fidelity in T2V
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models
- 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusion
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 2025Training-Free Motion-Guided Video Generation with Enhanced Temporal Consistency Using Motion Consistency Loss
- 2026Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanisms