RoboScape: Physics-informed Embodied World Model
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World models have become indispensable tools for embodied intelligence, serving as powerful simulators capable of generating realistic robotic videos while addressing critical data scarcity challenges. However, current embodied world models exhibit limited physical awareness, particularly in modeling 3D geometry and motion dynamics, resulting in unrealistic video generation for contact-rich robotic scenarios. In this paper, we present RoboScape, a unified physics-informed world model that jointly learns RGB video generation and physics knowledge within an integrated framework. We introduce two key physics-informed joint training tasks: temporal depth prediction that enhances 3D geometric consistency in video rendering, and keypoint dynamics learning that implicitly encodes physical properties (e.g., object shape and material characteristics) while improving complex motion modeling. Extensive experiments demonstrate that RoboScape generates videos with superior visual fidelity and physical plausibility across diverse robotic scenarios. We further validate its practical utility through downstream applications including robotic policy training with generated data and policy evaluation. Our work provides new insights for building efficient physics-informed world models to advance embodied intelligence research. The code is available at: https://github.com/tsinghua-fib-lab/RoboScape.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 52 of its 57 references that are in the map. First posted on arXiv 29 Jun 2025.
Builds on
52 of 57 references.
Closest ancestors · 5
Same direction, newest first
- 2025TesserAct: Learning 4D Embodied World Models29 Apr
- 2025Aether: Geometric-Aware Unified World Modeling24 Mar
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 47
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2018World Modelscited by 1,513
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
35 more
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2025Do generative video models understand physical principles?cited by 161
- 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 128
- 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
- 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2025Pre-Trained Video Generative Models as World Simulatorscited by 44
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 42
- 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 39
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025MaskGWM: A Generalizable Driving World Model with Video Mask Reconstructioncited by 29
- 2025Learning Real-World Action-Video Dynamics with Heterogeneous Masked Autoregressioncited by 23
- 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 22
- 2025Towards Physical Understanding in Video Generation: A 3D Point Regularization Approachcited by 8
- 2024Enhancing Sketch Animation: Text-to-Video Diffusion Models with Temporal Consistency and Rigidity Constraintscited by 7
Built on by
Citing papers per year: 2025: 11; 2026: 29.
40 papers.
Sort:
By area:
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 36
- 2026When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAscited by 30
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generationcited by 14
- 2026World Action Models: A Surveycited by 12
- 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Modelscited by 11
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Modelscited by 11
- 2026GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluationcited by 11
28 more
- 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligencecited by 10
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 10
- 2026World2Act: Latent Action Post-Training from World Model Dynamicscited by 8
- 2025KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Modelscited by 7
- 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoEcited by 7
- 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videoscited by 6
- 2026RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulationcited by 6
- 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulationcited by 5
- 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RLcited by 5
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
- 2025Real2Edit2Real: Generating Robotic Demonstrations via a 3D Control Interfacecited by 4
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Modelscited by 4
- 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimizationcited by 3
- 2026PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamicscited by 3
- 2026HaM-World: Soft-Hamiltonian World Models with Selective Memory for Planningcited by 2
- 2026World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Taskscited by 2
- 2025Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platformcited by 1
- 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamicscited by 1
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observationscited by 1
- 20263D Point World Models: Point Completion Enables More Accurate Dynamics Learningcited by 1
- 2026Generative Bayesian Filtering for State Estimationcited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinementcited by 0
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
- 2026HappyWorld-Benchcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Modelscited by 0
- 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models5 Oct 2026
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement2 Sep 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
- 2026GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation2 Jul 2026
- 20263D Point World Models: Point Completion Enables More Accurate Dynamics Learning30 Jun 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation15 Jun 2026
28 more
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models10 Jun 2026
- 2026RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation1 Jun 2026
- 2026World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks19 May 2026
- 2026PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics18 May 2026
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform18 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations8 May 2026
- 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Models8 May 2026
- 2026HaM-World: Soft-Hamiltonian World Models with Selective Memory for Planning7 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar 2026
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Study23 Mar 2026
- 2026World2Act: Latent Action Post-Training from World Model Dynamics11 Mar 2026
- 2026When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAs19 Feb 2026
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models9 Feb 2026
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models21 Jan 2026
- 2025Real2Edit2Real: Generating Robotic Demonstrations via a 3D Control Interface22 Dec 2025
- 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamics19 Dec 2025
- 2025Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform9 Dec 2025
- 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RL3 Dec 2025
- 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization20 Nov 2025
- 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos17 Nov 2025
- 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligence30 Oct 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
- 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulation26 Sep 2025
- 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE26 Sep 2025
- 2025KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Models25 Sep 2025
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 36
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generationcited by 14
- 2026World Action Models: A Surveycited by 12
- 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Modelscited by 11
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Modelscited by 11
- 2026GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluationcited by 11
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 10
12 most cited of 33 All 33 (JSON)
- 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models5 Oct 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement2 Sep 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation2 Jul 2026
- 20263D Point World Models: Point Completion Enables More Accurate Dynamics Learning30 Jun 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation15 Jun 2026
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models10 Jun 2026
- 2026RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation1 Jun 2026
12 newest of 33 All 33 (JSON)
- 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligencecited by 10
- 2025Real2Edit2Real: Generating Robotic Demonstrations via a 3D Control Interfacecited by 4
- 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimizationcited by 3
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026Generative Bayesian Filtering for State Estimationcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2025Real2Edit2Real: Generating Robotic Demonstrations via a 3D Control Interface22 Dec 2025
- 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization20 Nov 2025
- 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligence30 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions
- 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
- 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignment
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction
- 2026RoboBrain 2.5: Depth in Sight, Time in Mind
- 2025Robot Learning from a Physical World Model
- 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulation