MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation
Not on the map. Why?
Abstract (arXiv)
A prevailing view in robot learning is that simulation alone is not enough; effective sim-to-real transfer is widely believed to require at least some real-world data collection or task-specific fine-tuning to bridge the gap between simulated and physical environments. We challenge that assumption. With sufficiently large-scale and diverse simulated synthetic training data, we show that zero-shot transfer to the real world is not only possible, but effective for both static and mobile manipulation. We introduce MolmoBot-Engine, a fully open-source pipeline for procedural data generation across robots, tasks, and diverse simulated environments in MolmoSpaces. With it, we release MolmoBot-Data, a dataset of 1.8 million expert trajectories for articulated object manipulation and pick-and-place tasks. We train three policy classes: MolmoBot, a Molmo2-based multi-frame vision-language model with a flow-matching action head; MolmoBot-Pi0, which replicates the π0 architecture to enable direct comparison; and MolmoBot-SPOC, a lightweight policy suitable for edge deployment and amenable to RL fine-tuning. We evaluate on two robotic platforms: the Franka FR3 for tabletop manipulation tasks and the Rainbow Robotics RB-Y1 mobile manipulator for door opening, drawer manipulation, cabinet interaction, and mobile pick-and-place. Without any real-world fine-tuning, our policies achieve zero-shot transfer to unseen objects and environments. On tabletop pick-and-place, MolmoBot achieves a success rate of 79.2% in real world evaluations across 4 settings, outperforming π0.5 at 39.2%. Our results demonstrate that procedural environment generation combined with diverse articulated assets can produce robust manipulation policies that generalize broadly to the real world. Technical website: https://allenai.github.io/MolmoBot
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026MolmoMotion: Forecasting Point Trajectories in 3D with Language Instructioncited by 3
- 2026What if AI systems weren't chatbots?cited by 2
- 2026Grounded World Model for Semantically Generalizable Planningcited by 1
- 2026MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignmentcited by 1
- 2026Topology-Informed Visual Prompting For Vision Language Action Policiescited by 0
- 2026Intelligence Across Embodimentscited by 0
- 2026TANDEM: Task and Motion Planning with As-Needed Demonstrations for Efficient Vision-Language-Action Model Fine-tuningcited by 0
- 2026An Empirical Study on What Matters for Viewpoint-Generalizable Policies in Visual Imitation Learningcited by 0
- 2026SkillWeaver: Agentic Exploration over Neural Interaction Skills for Scalable Robot Data Generationcited by 0
- 2026SkillWeaver: Agentic Exploration over Neural Interaction Skills for Scalable Robot Data Generation28 Sep 2026
- 2026An Empirical Study on What Matters for Viewpoint-Generalizable Policies in Visual Imitation Learning26 Sep 2026
- 2026TANDEM: Task and Motion Planning with As-Needed Demonstrations for Efficient Vision-Language-Action Model Fine-tuning23 Sep 2026
- 2026Intelligence Across Embodiments22 Sep 2026
- 2026Topology-Informed Visual Prompting For Vision Language Action Policies20 Sep 2026
- 2026MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignment10 Sep 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction17 Jun 2026
- 2026What if AI systems weren't chatbots?8 May 2026
- 2026MolmoAct2: Action Reasoning Models for Real-world Deployment4 May 2026
- 2026Grounded World Model for Semantically Generalizable Planning13 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Models
- 2026SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretraining
- 2026Efficient Sim-to-Real Transfer of World-Action Models from Synthetic Priors
- 2025BLAZER: Bootstrapping LLM-based Manipulation Agents with Zero-Shot Data Generation
- 2026Grounding Sim-to-Real Generalization in Robotic Manipulation: An Empirical Study with Vision-Language-Action Models
- 2025RoboPearls: Editable Video Simulation for Robot Manipulation
- 2026MobileManiBench: Simplifying Model Verification for Mobile Manipulation
- 2025ArticuBot: Learning Universal Articulated Object Manipulation Policy via Large Scale Simulation