mlsanityData to 7 Oct 2026

HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation

arXiv 2610.02197 ↗First posted 1 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video generation models have achieved remarkable visual fidelity and have strong potential to become general-purpose world simulators. Despite this progress, they still fail to generate videos which adhere to laws of physics. The problem becomes even more apparent in realistic settings where multiple physical principles must work together within the same video; for example, "a balloon floating upward while steam rises from a pot" requires buoyancy and fluid dynamics to unfold coherently and simultaneously. Yet existing methods largely ignore multi-principle interactions, focusing on a single principle per video. We propose HiPhy (Hierarchical Physical Alignment), a reinforcement learning framework that grounds video generation in physical laws through a dual-level objective: locally enforcing the temporal dynamics of individual physical principles, and globally ensuring the physical and semantic coherence of the entire scene. To support multi-principle generation, we construct a 50K-prompt dataset and introduce a prompt benchmark MultiPhyBench, spanning a diverse range of co-occurring physical events. Our experiments show that HiPhy significantly outperforms prior methods and baselines, improving physical commonsense and semantic alignment significantly across various benchmarks, with the largest gains on scenes involving multiple concurrent physical principles where competing methods degrade most sharply.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 53 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

46 of 53 references.

References · 46

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2023Qwen Technical Reportcited by 3,273
  8. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  10. 2022Video Diffusion Modelscited by 2,280
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  12. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
34 more
  1. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2025OpenAI GPT-5 System Cardcited by 910
  4. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  5. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  6. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  7. 2023Photorealistic Video Generation with Diffusion Modelscited by 304
  8. 2025Improving Video Generation with Human Feedbackcited by 267
  9. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
  10. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  11. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
  12. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
  13. 2025Do generative video models understand physical principles?cited by 151
  14. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  15. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 102
  16. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
  17. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 87
  18. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  19. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 77
  20. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
  21. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
  22. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 49
  23. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 34
  24. 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Modelscited by 32
  25. 2025Epipolar Geometry Improves Video Generation Modelscited by 22
  26. 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 22
  27. 2025FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generationcited by 21
  28. 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 20
  29. 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 19
  30. 2026Self-Refining Video Samplingcited by 14
  31. 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulationcited by 11
  32. 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generationcited by 6
  33. 2026PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generationcited by 4
  34. 2024Game Engines for Immersive Visualization: Using Unreal Engine Beyond Entertainmentcited by 3

Built on by

Not cited yet.