OrbiSim: World Models as Differentiable Physics Engines for Embodied Intelligence
On the map: World models → Embodied and robot world models
Abstract (arXiv)
We present OrbiSim, a novel robotic simulation paradigm that redefines world models as a fully differentiable physics engine for embodied intelligence. Unlike prior world models that focus on unconstrained imagination in latent or visual domains, OrbiSim establishes a unified, physically-grounded pathway that bridges structured scene assets, neural dynamics, and downstream reinforcement learning. By enabling end-to-end differentiability throughout the entire simulation loop -- spanning from explicit state transitions to visual observation generation -- OrbiSim supports tasks traditionally intractable for classical simulators, such as differentiable contact modeling, gradient-based policy optimization under sparse rewards, and intuitive physical inference. Empirical results demonstrate that OrbiSim significantly outperforms state-of-the-art world models in both predictive fidelity and control performance. Furthermore, its consistent responsiveness to asset configurations and physical parameters suggests its potential as a differentiable tool for enhancing robot simulation and policy training.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 36 of its 44 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
36 of 44 references.
Closest ancestors · 7
Same direction, newest first
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025Latent Action Pretraining Through World Modeling22 Sep
- 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulation23 Apr
- 2025AdaWorld: Learning Adaptable World Models with Latent Actions24 Mar
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
Other references · 29
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2018World Modelscited by 1,513
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2018Exploration by Random Network Distillationcited by 993
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
17 more
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2026Advancing Open-source World Modelscited by 154
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 110
- 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
- 2018GPU-Accelerated Robotic Simulation for Distributed Reinforcement Learningcited by 90
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 76
- 2024InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Modelscited by 56
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2024AVID: Adapting Video Diffusion Models to World Modelscited by 37
- 2024Learning Latent Dynamic Robust Representations for World Modelscited by 21
- 2025Learning Transformer-based World Models with Contrastive Predictive Codingcited by 20
- 2024Open-World Reinforcement Learning over Long Short-Term Imaginationcited by 13
- 2025AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learningcited by 12
- 2024Improving Token-Based World Models with Parallel Observation Predictioncited by 11
- 2023Model-Based Reinforcement Learning with Isolated Imaginationscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2026WEAVER, Better, Faster, Longer: An Effective World Model for Robotic Manipulation
- 2025Neural Motion Simulator: Pushing the Limit of World Models in Reinforcement Learning
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
- 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
- 2026RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimization
- 2026InternW0: A Foundational Physical World Model for Efficient Real-World Interactions
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence