PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment
On the map: Diffusion models → Video generation
Abstract (arXiv)
Video Diffusion Models (VDMs) offer a promising approach for simulating dynamic scenes and environments, with broad applications in robotics and media generation. However, existing models often generate temporally incoherent content that violates basic physical intuition, significantly limiting their practical applicability. We propose PhysAlign, an efficient framework for physics-coherent image-to-video (I2V) generation that explicitly addresses this limitation. To overcome the critical scarcity of physics-annotated videos, we first construct a fully controllable synthetic data generation pipeline based on rigid-body simulation, yielding a highly-curated dataset with accurate, fine-grained physics and 3D annotations. Leveraging this data, PhysAlign constructs a unified physical latent space by coupling explicit 3D geometry constraints with a Gram-based spatio-temporal relational alignment that extracts kinematic priors from video foundation models. Extensive experiments demonstrate that PhysAlign significantly outperforms existing VDMs on tasks requiring complex physical reasoning and temporal stability, without compromising zero-shot visual quality. PhysAlign shows the potential to bridge the gap between raw visual synthesis and rigid-body kinematics, establishing a practical paradigm for genuinely physics-grounded video generation. The project page is available at https://physalign.github.io/PhysAlign.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 48 of its 52 references that are in the map. First posted on arXiv 14 Mar 2026.
Builds on
48 of 52 references.
Closest ancestors · 12
Same direction, newest first
- 2025LikePhys: Evaluating Intuitive Physics Understanding in Video Diffusion Models via Likelihood Preference13 Oct
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior30 Mar
- 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation30 Nov
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planning21 Nov
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
Other references · 36
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2023Generating Images with Multimodal Language Modelscited by 260
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
24 more
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2025Do generative video models understand physical principles?cited by 161
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
- 2024GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Controlcited by 78
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 53
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 48
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 42
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
- 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 36
- 2025U-REPA: Aligning Diffusion U-Nets to ViTscited by 32
- 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
- 2025PhysiX: A Foundation Model for Physics Simulationscited by 22
- 2024Motion Modes: What Could Happen Next?cited by 12
- 2025IDCNet: Guided Video Diffusion for Metric-Consistent RGBD Scene Generation with Precise Camera Controlcited by 7
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generationcited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 14
- 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interactioncited by 4
- 2026PhiZero: A World Model Built Around Physical Languagecited by 2
- 2026Structure-Token Evidence-Anchored Reasoning for Scientific Chart Understandingcited by 0
- 2026Structure-Token Evidence-Anchored Reasoning for Scientific Chart Understanding7 Sep 2026
- 2026PhiZero: A World Model Built Around Physical Language30 Jul 2026
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory16 Jun 2026
- 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interaction19 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models
- 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generation
- 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization
- 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulation