mlsanityData to 7 Oct 2026

RoboDream: Compositional World Models for Scalable Robot Data Synthesis

arXiv 2606.02577 ↗First posted 1 Jun 2026cs.RO cs.CVcited by 1

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Scaling robot learning requires large-scale, diverse demonstrations, yet real-world data collection via teleoperation remains prohibitively expensive and time-consuming. While video diffusion models offer a promising avenue for data scaling, existing generative approaches are often limited to superficial visual augmentation, or suffer from embodiment hallucinations that yield physically infeasible motions. We present a generalizable embodiment-centric world model that achieves scalable data generation by synthesizing photorealistic demonstrations with novel objects, in novel scenes, and from novel viewpoints. Our approach anchors generation to rendered robot motion while conditioning on explicit scene and object priors, effectively decoupling trajectory execution from environment synthesis. This formulation has the potential to unlock two powerful data scaling capabilities: (1) retrieval and rebirth, which repurposes existing trajectories into entirely new contexts without new motion data; and (2) prop-free teleoperation, where operators manipulate empty air and the model hallucinates the target objects and scene afterwards, eliminating reset time. We demonstrate with real-world experiments that our generated data consistently improves downstream policy performance and significantly reduces real-world data requirements across diverse manipulation tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 32 of its 32 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

32 of 32 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026World Action Models are Zero-shot Policies17 Feb
  2. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  3. 2025AnchorDream: Repurposing Video Diffusion for Embodiment-Aware Robot Data Synthesis12 Dec
  4. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 27

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  7. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  10. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  11. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  12. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
15 more
  1. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  2. 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 175
  3. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
  4. 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationcited by 125
  5. 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 64
  6. 2024RoVi-Aug: Robot and Viewpoint Augmentation for Cross-Embodiment Robot Learningcited by 46
  7. 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 45
  8. 2025Real2Render2Real: Scaling Robot Data Without Dynamics Simulation or Robot Hardwarecited by 41
  9. 2025RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generationcited by 40
  10. 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpaintingcited by 38
  11. 2025ReBot: Scaling Robot Learning with Real-to-Sim-to-Real Robotic Video Synthesiscited by 22
  12. 2026AnyView: Synthesizing Any Novel View in Dynamic Scenescited by 12
  13. 2025OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learningcited by 10
  14. 2025RoboTransfer: Controllable Geometry-Consistent Video Diffusion for Manipulation Policy Transfercited by 7
  15. 2026RoboVIP: Multi-View Video Generation with Visual Identity Prompting Augments Robot Manipulationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026RynnWorld-Teleop: An Action-Conditioned World Model for Digital Teleoperation
  2. 2025RoboEnvision: A Long-Horizon Video Generation Model for Multi-Task Robot Manipulation
  3. 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Models
  4. 2026AXIS: A Growable Community-Driven Data Engine for Scalable Robot Manipulation
  5. 2026Data Analogies Enable Efficient Cross-Embodiment Transfer
  6. 2026RoboEvolve: Co-Evolving Planner-Simulator for Robotic Manipulation with Limited Data
  7. 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulation
  8. 2026CRAFT: Video Diffusion for Bimanual Robot Data Generation