mlsanityData to 14 Oct 2026

Learning Primitive Embodied World Models: Towards Scalable Robotic Learning

arXiv 2508.20840 ↗First posted 28 Aug 2025cs.RO cs.AI cs.MMcited by 6

On the map: World models → Embodied and robot world models

Abstract (arXiv)

While video-generation-based embodied world models have gained increasing attention, their reliance on large-scale embodied interaction data remains a key bottleneck. The scarcity, difficulty of collection, and high dimensionality of embodied data fundamentally limit the alignment granularity between language and actions and exacerbate the challenge of long-horizon video generation--hindering generative models from achieving a "GPT moment" in the embodied domain. There is a naive observation: the diversity of embodied data far exceeds the relatively small space of possible primitive motions. Based on this insight, we propose a novel paradigm for world modeling--Primitive Embodied World Models (PEWM). By restricting video generation to fixed short horizons, our approach 1) enables fine-grained alignment between linguistic concepts and visual representations of robotic actions, 2) reduces learning complexity, 3) improves data efficiency in embodied data collection, and 4) decreases inference latency. By equipping with a modular Vision-Language Model (VLM) planner and a Start-Goal heatmap Guidance mechanism (SGG), PEWM further enables flexible closed-loop control and supports compositional generalization of primitive-level policies over extended, complex tasks. Our framework leverages the spatiotemporal vision priors in video models and the semantic awareness of VLMs to bridge the gap between fine-grained physical interaction and high-level reasoning, paving the way toward scalable, interpretable, and general-purpose embodied intelligence.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 94 of its 107 references that are in the map. First posted on arXiv 28 Aug 2025.

Builds on

94 of 107 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025TesserAct: Learning 4D Embodied World Models29 Apr
  2. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  3. 2025Aether: Geometric-Aware Unified World Modeling24 Mar
  4. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
  5. 2022Masked World Models for Visual Control28 Jun
  6. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning4 Feb

Other references · 88

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  10. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
  1. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  3. 2022Video Diffusion Modelscited by 2,305
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2023Consistency Modelscited by 1,822
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  10. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  11. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  13. 2020Mastering Atari with Discrete World Modelscited by 1,007
  14. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  15. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  16. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  17. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  18. 2024Genie: Generative Interactive Environmentscited by 747
  19. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  20. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  21. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  22. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  23. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  24. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  25. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  26. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  27. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  28. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  29. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  30. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  31. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  32. 2023Learning Interactive Real-World Simulatorscited by 458
  33. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  34. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
  35. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  36. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  37. 2022Transformers are Sample-Efficient World Modelscited by 328
  38. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327

50 most cited of 88 All 88 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Any4D: Open-Prompt 4D Generation from Natural Language and Images
  2. 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation
  3. 2026ViPSim: Collaborating Visual and Parameter Spaces for Consistent Long-Horizon Embodied World Models
  4. 2026World Action Models: The Next Frontier in Embodied AI
  5. 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos
  6. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
  7. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  8. 2026Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions