Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Video world models are expected to predict how the physical world evolves, yet they often produce visually plausible videos that violate basic physical principles. Existing approaches commonly assume that natural language is insufficient to represent the physical knowledge required for reliable generation, and therefore introduce additional visual, latent, numerical, or planning-based signals. We revisit this assumption and introduce Physis-Lang, a self-evolving framework that treats physical language as a shared and optimizable representation across data curation, model training, and video generation. Physis-Lang represents physical processes through language that describes their relevant entities, causes, interactions, governing principles, temporal evolution, and effects. To improve this representation, we construct PhysCapBench, which decomposes physical processes into atomic assertions and evaluates captions using recall and precision. An agentic loop iteratively analyzes assertion-level errors and refines the instruction used to produce physical captions. Physis-Lang further converts model deficiencies into textual descriptions and uses language-guided retrieval to identify visually diverse videos that cover missing physical processes. Experiments on four widely used physical video benchmarks with Wan and Cosmos backbones demonstrate consistent improvements in physical plausibility. Notably, starting from open-source Cosmos3-Nano backbones, our Physis-Lang-enhanced models surpass the leading proprietary Veo 3.1 model.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 36 of its 83 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
36 of 83 references.
Closest ancestors · 3
Same direction, newest first
- 2026PhiZero: A World Model Built Around Physical Language30 Jul
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
Other references · 33
- 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
- 2024TextGrad: Automatic "Differentiation" via Textcited by 250
- 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agentscited by 201
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agentcited by 78
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 77
- 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusioncited by 14
- 2025PhysCorr: Dual-Reward DPO for Physics-Constrained Text-to-Video Generation with Automated Preference Selectioncited by 14
- 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibilitycited by 13
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 10
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generationcited by 10
- 2026SEAL: Synergistic Co-Evolution of Agents and Learning Environmentscited by 9
21 more
- 2026EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learningcited by 9
- 2026Diffusion-DRF: Free, Rich, and Differentiable Reward for Video Diffusion Fine-Tuningcited by 8
- 2025Learning Plug-and-play Memory for Guiding Video Diffusion Modelscited by 7
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine Systemcited by 7
- 2026Physics-IQ Verifiedcited by 6
- 2025STANCE: Motion Coherent Video Generation Via Sparse-to-Dense Anchored Encodingcited by 5
- 2026PhysVideoGenerator: Towards Physically Aware Video Generation via Latent Physics Guidancecited by 5
- 2026PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generationcited by 4
- 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generationcited by 4
- 2025Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinementcited by 3
- 2026Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamicscited by 3
- 2026Training LLM Agents for Spontaneous, Reward-Free Self-Evolution via World Knowledge Explorationcited by 3
- 2026PhyWorld: Physics-Faithful World Model for Video Generationcited by 3
- 2026When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generationcited by 3
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generationcited by 3
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modelingcited by 2
- 2026PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamicscited by 2
- 2026PACE: Two-Timescale Self-Evolution for Small Language Model Agentscited by 2
- 2026Seeking Physics in Diffusion Noisecited by 1
- 2026DiReCT: Disentangled Regularization of Contrastive Trajectories for Physics-Refined Video Generationcited by 1
- 2026Diffusion-APO: Trajectory-Aware Direct Preference Alignment for Video Diffusion Transformerscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction
- 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulation
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding
- 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
- 2026PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning