mlsanityData to 14 Oct 2026

PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment

arXiv 2603.13770 ↗First posted 14 Mar 2026cs.CVcited by 4

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video Diffusion Models (VDMs) offer a promising approach for simulating dynamic scenes and environments, with broad applications in robotics and media generation. However, existing models often generate temporally incoherent content that violates basic physical intuition, significantly limiting their practical applicability. We propose PhysAlign, an efficient framework for physics-coherent image-to-video (I2V) generation that explicitly addresses this limitation. To overcome the critical scarcity of physics-annotated videos, we first construct a fully controllable synthetic data generation pipeline based on rigid-body simulation, yielding a highly-curated dataset with accurate, fine-grained physics and 3D annotations. Leveraging this data, PhysAlign constructs a unified physical latent space by coupling explicit 3D geometry constraints with a Gram-based spatio-temporal relational alignment that extracts kinematic priors from video foundation models. Extensive experiments demonstrate that PhysAlign significantly outperforms existing VDMs on tasks requiring complex physical reasoning and temporal stability, without compromising zero-shot visual quality. PhysAlign shows the potential to bridge the gap between raw visual synthesis and rigid-body kinematics, establishing a practical paradigm for genuinely physics-grounded video generation. The project page is available at https://physalign.github.io/PhysAlign.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 48 of its 52 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

48 of 52 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025LikePhys: Evaluating Intuitive Physics Understanding in Video Diffusion Models via Likelihood Preference13 Oct
  2. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep
  3. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May
  4. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior30 Mar
  5. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  6. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation30 Nov
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  8. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
  9. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planning21 Nov
  10. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  12. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec

Other references · 36

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  6. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  7. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  8. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  9. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  10. 2023Generating Images with Multimodal Language Modelscited by 260
  11. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  12. 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
24 more
  1. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  2. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  3. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  4. 2025Do generative video models understand physical principles?cited by 161
  5. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
  6. 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
  7. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
  8. 2024GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Controlcited by 78
  9. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
  10. 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 53
  11. 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 48
  12. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  13. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
  14. 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 42
  15. 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
  16. 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
  17. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
  18. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 36
  19. 2025U-REPA: Aligning Diffusion U-Nets to ViTscited by 32
  20. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  21. 2025PhysiX: A Foundation Model for Physics Simulationscited by 22
  22. 2024Motion Modes: What Could Happen Next?cited by 12
  23. 2025IDCNet: Guided Video Diffusion for Metric-Consistent RGBD Scene Generation with Precise Camera Controlcited by 7
  24. 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM
  2. 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
  3. 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite
  4. 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models
  5. 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation
  6. 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generation
  7. 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization
  8. 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulation