mlsanityData to 14 Oct 2026

RoboScape: Physics-informed Embodied World Model

arXiv 2506.23135 ↗First posted 29 Jun 2025cs.CV cs.ROcited by 40

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World models have become indispensable tools for embodied intelligence, serving as powerful simulators capable of generating realistic robotic videos while addressing critical data scarcity challenges. However, current embodied world models exhibit limited physical awareness, particularly in modeling 3D geometry and motion dynamics, resulting in unrealistic video generation for contact-rich robotic scenarios. In this paper, we present RoboScape, a unified physics-informed world model that jointly learns RGB video generation and physics knowledge within an integrated framework. We introduce two key physics-informed joint training tasks: temporal depth prediction that enhances 3D geometric consistency in video rendering, and keypoint dynamics learning that implicitly encodes physical properties (e.g., object shape and material characteristics) while improving complex motion modeling. Extensive experiments demonstrate that RoboScape generates videos with superior visual fidelity and physical plausibility across diverse robotic scenarios. We further validate its practical utility through downstream applications including robotic policy training with generated data and policy evaluation. Our work provides new insights for building efficient physics-informed world models to advance embodied intelligence research. The code is available at: https://github.com/tsinghua-fib-lab/RoboScape.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 52 of its 57 references that are in the map. First posted on arXiv 29 Jun 2025.

Builds on

52 of 57 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025TesserAct: Learning 4D Embodied World Models29 Apr
  2. 2025Aether: Geometric-Aware Unified World Modeling24 Mar
  3. 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
  4. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 47

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2018World Modelscited by 1,513
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  8. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  10. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  11. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  12. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
35 more
  1. 2024Genie: Generative Interactive Environmentscited by 747
  2. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  3. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  4. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  5. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  6. 2023Learning Interactive Real-World Simulatorscited by 458
  7. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  8. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  9. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  10. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  11. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  12. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  13. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  14. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
  15. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
  16. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  17. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  18. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  19. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
  20. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
  21. 2025Do generative video models understand physical principles?cited by 161
  22. 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
  23. 2024GameGen-X: Interactive Open-world Game Video Generationcited by 128
  24. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
  25. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
  26. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  27. 2025Pre-Trained Video Generative Models as World Simulatorscited by 44
  28. 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 42
  29. 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 39
  30. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  31. 2025MaskGWM: A Generalizable Driving World Model with Video Mask Reconstructioncited by 29
  32. 2025Learning Real-World Action-Video Dynamics with Heterogeneous Masked Autoregressioncited by 23
  33. 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 22
  34. 2025Towards Physical Understanding in Video Generation: A 3D Point Regularization Approachcited by 8
  35. 2024Enhancing Sketch Animation: Text-to-Video Diffusion Models with Temporal Consistency and Rigidity Constraintscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 11; 2026: 29.

40 papers.

Sort:

By area:

  1. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  2. 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
  3. 2026World Action Models: The Next Frontier in Embodied AIcited by 50
  4. 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 36
  5. 2026When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAscited by 30
  6. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
  7. 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
  8. 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generationcited by 14
  9. 2026World Action Models: A Surveycited by 12
  10. 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Modelscited by 11
  11. 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Modelscited by 11
  12. 2026GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluationcited by 11
28 more
  1. 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligencecited by 10
  2. 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 10
  3. 2026World2Act: Latent Action Post-Training from World Model Dynamicscited by 8
  4. 2025KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Modelscited by 7
  5. 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoEcited by 7
  6. 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videoscited by 6
  7. 2026RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulationcited by 6
  8. 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulationcited by 5
  9. 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RLcited by 5
  10. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
  11. 2025Real2Edit2Real: Generating Robotic Demonstrations via a 3D Control Interfacecited by 4
  12. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Modelscited by 4
  13. 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimizationcited by 3
  14. 2026PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamicscited by 3
  15. 2026HaM-World: Soft-Hamiltonian World Models with Selective Memory for Planningcited by 2
  16. 2026World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Taskscited by 2
  17. 2025Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platformcited by 1
  18. 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamicscited by 1
  19. 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
  20. 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observationscited by 1
  21. 20263D Point World Models: Point Completion Enables More Accurate Dynamics Learningcited by 1
  22. 2026Generative Bayesian Filtering for State Estimationcited by 0
  23. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  24. 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinementcited by 0
  25. 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
  26. 2026HappyWorld-Benchcited by 0
  27. 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
  28. 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions
  2. 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
  3. 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignment
  4. 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis
  5. 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction
  6. 2026RoboBrain 2.5: Depth in Sight, Time in Mind
  7. 2025Robot Learning from a Physical World Model
  8. 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulation