HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation
Not on the map. Why?
Abstract (arXiv)
Video generation models have achieved remarkable visual fidelity and have strong potential to become general-purpose world simulators. Despite this progress, they still fail to generate videos which adhere to laws of physics. The problem becomes even more apparent in realistic settings where multiple physical principles must work together within the same video; for example, "a balloon floating upward while steam rises from a pot" requires buoyancy and fluid dynamics to unfold coherently and simultaneously. Yet existing methods largely ignore multi-principle interactions, focusing on a single principle per video. We propose HiPhy (Hierarchical Physical Alignment), a reinforcement learning framework that grounds video generation in physical laws through a dual-level objective: locally enforcing the temporal dynamics of individual physical principles, and globally ensuring the physical and semantic coherence of the entire scene. To support multi-principle generation, we construct a 50K-prompt dataset and introduce a prompt benchmark MultiPhyBench, spanning a diverse range of co-occurring physical events. Our experiments show that HiPhy significantly outperforms prior methods and baselines, improving physical commonsense and semantic alignment significantly across various benchmarks, with the largest gains on scenes involving multiple concurrent physical principles where competing methods degrade most sharply.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 53 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
46 of 53 references.
References · 46
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023Qwen Technical Reportcited by 3,273
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
34 more
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2025OpenAI GPT-5 System Cardcited by 910
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2023Photorealistic Video Generation with Diffusion Modelscited by 304
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2025Do generative video models understand physical principles?cited by 151
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 102
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 87
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 77
- 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 49
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 34
- 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Modelscited by 32
- 2025Epipolar Geometry Improves Video Generation Modelscited by 22
- 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 22
- 2025FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generationcited by 21
- 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 20
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 19
- 2026Self-Refining Video Samplingcited by 14
- 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulationcited by 11
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generationcited by 6
- 2026PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generationcited by 4
- 2024Game Engines for Immersive Visualization: Using Unreal Engine Beyond Entertainmentcited by 3
Built on by
Not cited yet.