Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning
Not on the map. Why?
Abstract (arXiv)
Physically Plausible Video Generation (PPVG) seeks to synthesize videos consistent with physical principles, yet remains challenging due to underspecified natural language conditioning. Advanced chain-of-thought (CoT) frameworks augment prompts with physical knowledge. However, such prompts describe physical phenomena holistically, overlooking intermediate states and transition dynamics. In this paper, we reformulate PPVG as event-centric generation by representing physical evolution as a chain of causally connected and physically constrained events. Our framework comprises three key modules: (1) Physics-driven Event Chain Reasoning. This module decomposes physical phenomena into causally connected events represented by evolving scene graphs. Formula-derived physical quantities are bound to relevant objects and interactions, characterizing the direction and magnitude of each event transition. (2) Transition-aware Routed Keyframe Conditioning. This module routes each event to a specialized keyframe synthesis operator for appearance variation or object transformation. Consecutive keyframes are injected as residual guidance during denoising, enabling smooth visual transitions between event-boundary states. (3) Physics-injected Contrastive Semantic Guidance. This module constructs physics-informed positive and counterfactual negative prompts for classifier-free guidance, steering generation toward plausible dynamics and away from physics-violating counterparts. Experiments on PhyGenBench, VideoPhy, PhyWorldBench, and Physics-IQ demonstrate that our framework generates videos with superior physical plausibility across diverse domains.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 78 of its 90 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
78 of 90 references.
References · 78
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Segment Anythingcited by 8,234
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2025Qwen-Image Technical Reportcited by 1,044
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
38 more
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2025Do generative video models understand physical principles?cited by 161
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 80
- 2023VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generationcited by 74
- 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
- 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 60
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 41
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 41
- 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusioncited by 39
- 2024TrackGo: A Flexible and Efficient Method for Controllable Video Generationcited by 39
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 36
- 2023Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMscited by 35
- 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 32
50 most cited of 78 All 78 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation
- 2026VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation
- 2026From Priors to Perception: Grounding Video-LLMs in Physical Reality
- 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulation
- 2026PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model