AnchorDream: Repurposing Video Diffusion for Embodiment-Aware Robot Data Synthesis
On the map: World models → Embodied and robot world models
also in 2 more
Abstract (arXiv)
The collection of large-scale and diverse robot demonstrations remains a major bottleneck for imitation learning, as real-world data acquisition is costly and simulators offer limited diversity and fidelity with pronounced sim-to-real gaps. While generative models present an attractive solution, existing methods often alter only visual appearances without creating new behaviors, or suffer from embodiment inconsistencies that yield implausible motions. To address these limitations, we introduce AnchorDream, an embodiment-aware world model that repurposes pretrained video diffusion models for robot data synthesis. AnchorDream conditions the diffusion process on robot motion renderings, anchoring the embodiment to prevent hallucination while synthesizing objects and environments consistent with the robot's kinematics. Starting from only a handful of human teleoperation demonstrations, our method scales them into large, diverse, high-quality datasets without requiring explicit environment modeling. Experiments show that the generated data leads to consistent improvements in downstream policy learning, with relative gains of 36.4% in simulator benchmarks and nearly double performance in real-world studies. These results suggest that grounding generative world models in robot motion provides a practical path toward scaling imitation learning.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 29 of its 30 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
29 of 30 references.
Closest ancestors · 3
Same direction, newest first
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 26
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Video Diffusion Modelscited by 2,305
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 585
14 more
- 2020Reinforcement Learning with Augmented Datacited by 468
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2020ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulationcited by 250
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 145
- 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationcited by 129
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
- 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
- 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 69
- 2025Real2Render2Real: Scaling Robot Data Without Dynamics Simulation or Robot Hardwarecited by 44
- 2025RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generationcited by 40
- 2025ReBot: Scaling Robot Learning with Real-to-Sim-to-Real Robotic Video Synthesiscited by 22
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulationcited by 12
- 2026Learning Actionable Manipulation Recovery via Counterfactual Failure Synthesiscited by 10
- 2026DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Modelscited by 5
- 2026CRAFT: Video Diffusion for Bimanual Robot Data Generationcited by 4
- 2026RoboDream: Compositional World Models for Scalable Robot Data Synthesiscited by 3
- 2026GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actionscited by 3
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026Rolling-WAM: World Action Models with Rolling Imaginationcited by 1
- 2026TSD: A Physics-Inspired Trajectory Saliency Detector for Efficient Imitation Learningcited by 0
- 2026VPTwin: Real-Sim-Real Video Prediction for Robotic Manipulation Planningcited by 0
- 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Modelscited by 0
- 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models5 Oct 2026
- 2026VPTwin: Real-Sim-Real Video Prediction for Robotic Manipulation Planning27 Sep 2026
- 2026Rolling-WAM: World Action Models with Rolling Imagination24 Sep 2026
- 2026GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions6 Aug 2026
- 2026TSD: A Physics-Inspired Trajectory Saliency Detector for Efficient Imitation Learning22 Jun 2026
- 2026RoboDream: Compositional World Models for Scalable Robot Data Synthesis1 Jun 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026CRAFT: Video Diffusion for Bimanual Robot Data Generation4 Apr 2026
- 2026DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models17 Mar 2026
- 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar 2026
- 2026Learning Actionable Manipulation Recovery via Counterfactual Failure Synthesis13 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrations
- 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulation
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generation
- 2026CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators
- 2026Latent Policy Steering: An Efficient and Flexible Framework for Cross-Embodiment Transfer ↗
- 2025X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real
- 2026Bridging the Embodiment Gap: Disentangled Cross-Embodiment Video Editing ↗
- 2026Data Analogies Enable Efficient Cross-Embodiment Transfer