Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligence
On the map: World models → World models for navigation
also in 1 more
Abstract (arXiv)
In this technical report, we propose Pelican-Sim 1.0, a general world model simulator for embodied intelligence that predicts future observations from visual context and robot actions to support downstream learning and decision making. The model incorporates four key design features: (1) Unified action representation: a 28-dimensional action value space covering most mainstream embodiments, keeping one model valid across heterogeneous devices. (2) Action-visual injection: URDF- and camera-rendered action videos bridge actions and pixels, giving markedly better controllability across embodiments, scenes, and tasks (PSNR +0.904 over alternative fusion baselines). (3) Sparse mixture-of-experts (MoE): sparse MoE layers add capacity for heterogeneous dynamics and absorb the action modality while reducing inter-modality conflict (FVD -6.530 vs. the dense backbone). (4) Efficient rollout generation: causal adaptation and few-step distillation yield a four-step autoregressive simulator, achieving a 5.67-fold speedup over the 35-step model. Benefiting from these designs, we train on approximately one million real-world and simulated trajectories and obtain large gains in action controllability and video quality: PSNR improves over the strongest evaluated baselines by 4.636 on AgiBotWorld Beta, 2.080 on RoboMIND, and 10.343 on RoboTwin, with the adapted EWMBench DYN score up 0.426 on RoboTwin. Relying on this, four downstream applications on RoboTwin succeed: 500 generated trajectories added to 50 demonstrations per task raise policy success from 70% to 93%; policy evaluation reaches a Pearson correlation of 0.994 across five checkpoints; and relative success gains reach 47.7% for action selection and 20.3% for policy improvement. Qualitative generalization across trajectory, scene, object, embodiment, and viewpoint shifts highlights its potential as a general-purpose world model simulator.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 28 of its 61 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
28 of 61 references.
References · 28
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 167
16 more
- 2024RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins (early version)cited by 69
- 2024Scaling Diffusion Transformers to 16 Billion Parameterscited by 66
- 2025WorldGym: World Model as An Environment for Policy Evaluationcited by 64
- 2026World-Gymnast: Training Robots with Reinforcement Learning in a World Modelcited by 27
- 2025Scalable Policy Evaluation with Video World Modelscited by 24
- 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Maskscited by 20
- 2026Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligencecited by 15
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulationcited by 9
- 2026Masked Visual Actions for Unified World Modelingcited by 9
- 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Actioncited by 8
- 2026OSCAR: Omni-Embodiment Action-Conditioned World Model for Roboticscited by 7
- 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluationcited by 4
- 2026GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actionscited by 3
- 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streamingcited by 2
- 2026V-Dreamer: Automating Robotic Simulation and Trajectory Synthesis via Video Generation Priorscited by 1
- 2026ViPSim: Collaborating Visual and Parameter Spaces for Consistent Long-Horizon Embodied World Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026HappyWorld-Benchcited by 0
- 2026HappyWorld-Bench21 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2026Riemann-1.0: An Embodied World Action Model for Physical AI
- 2026XPACE: Joint World and Action Modeling from Heterogeneous Experience
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulation
- 2024WorldSimBench: Towards Video Generation Models as World Simulators