Physics in 2-Steps: Locking Motion Priors Before Visual Refinement Erases Them
On the map: Diffusion models → Video generation
Abstract (arXiv)
Image-to-Video diffusion models leverage input images to generate visually stunning content, yet frequently produce motion that violates physical laws. We reveal a surprising finding: a 2-step generation often exhibits better physical consistency than a 50-step output from the same model. Through spectral analysis, we trace this to phase erosion during denoising; the phase degrades significantly (dropping by ≈ 18% from step 2 to step 50), whereas the magnitude remains relatively stable. Building on this insight, we propose PhaseLock, a training-free framework that preserves the valid motion priors from few-step inference throughout the denoising trajectory. Rather than relying on full-step inference for physical consistency, PhaseLock extracts a motion prior from just 2 steps and enforces it onto high-fidelity generation via Latent Delta Guidance. Our approach effectively mitigates phase degradation, improving physical consistency by an average of 6.2 points across diverse models while largely maintaining visual fidelity, with negligible overhead (1.06× time, 1.02× memory) and reduced reliance on expensive external guidance methods (~5× time). Project Page: https://dnwjddl.github.io/phaselock
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 46 of its 48 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
46 of 48 references.
Closest ancestors · 13
Same direction, newest first
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May
- 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusion27 May
- 2025FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise5 Feb
- 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation30 Nov
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
- 2023FreeInit: Bridging Initialization Gap in Video Diffusion Models12 Dec
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
1 more
- 2022Video Diffusion Models7 Apr
Other references · 33
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
21 more
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2022Perception Prioritized Training of Diffusion Modelscited by 303
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 276
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2025Do generative video models understand physical principles?cited by 161
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
- 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 154
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
- 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluationcited by 24
- 2025Spatial Transport Optimization by Repositioning Attention Map for Training-Free Text-to-Image Synthesiscited by 10
- 2025Rare Text Semantics Were Always There in Your Diffusion Transformercited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026The Seriality Gap in Video Diffusion Modelscited by 2
- 2026SAGA: Stable Acceleration Guidance for Autoregressive Video Generationcited by 0
- 2026How Does Geometry Enter Generated Motion?cited by 0
- 2026How Does Geometry Enter Generated Motion?4 Oct 2026
- 2026The Seriality Gap in Video Diffusion Models14 Jul 2026
- 2026SAGA: Stable Acceleration Guidance for Autoregressive Video Generation9 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanisms
- 2026Seeking Physics in Diffusion Noise
- 2026The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show
- 2026Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models
- 2025Training-free Diffusion Acceleration with Bottleneck Sampling
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models
- 2025Physics-Guided Motion Loss for Video Generation Model