Learning Primitive Embodied World Models: Towards Scalable Robotic Learning
On the map: World models → Embodied and robot world models
Abstract (arXiv)
While video-generation-based embodied world models have gained increasing attention, their reliance on large-scale embodied interaction data remains a key bottleneck. The scarcity, difficulty of collection, and high dimensionality of embodied data fundamentally limit the alignment granularity between language and actions and exacerbate the challenge of long-horizon video generation--hindering generative models from achieving a "GPT moment" in the embodied domain. There is a naive observation: the diversity of embodied data far exceeds the relatively small space of possible primitive motions. Based on this insight, we propose a novel paradigm for world modeling--Primitive Embodied World Models (PEWM). By restricting video generation to fixed short horizons, our approach 1) enables fine-grained alignment between linguistic concepts and visual representations of robotic actions, 2) reduces learning complexity, 3) improves data efficiency in embodied data collection, and 4) decreases inference latency. By equipping with a modular Vision-Language Model (VLM) planner and a Start-Goal heatmap Guidance mechanism (SGG), PEWM further enables flexible closed-loop control and supports compositional generalization of primitive-level policies over extended, complex tasks. Our framework leverages the spatiotemporal vision priors in video models and the semantic awareness of VLMs to bridge the gap between fine-grained physical interaction and high-level reasoning, paving the way toward scalable, interpretable, and general-purpose embodied intelligence.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 94 of its 107 references that are in the map. First posted on arXiv 28 Aug 2025.
Builds on
94 of 107 references.
Closest ancestors · 6
Same direction, newest first
- 2025TesserAct: Learning 4D Embodied World Models29 Apr
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2025Aether: Geometric-Aware Unified World Modeling24 Mar
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
- 2022Masked World Models for Visual Control28 Jun
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning4 Feb
Other references · 88
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Consistency Modelscited by 1,822
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2022Transformers are Sample-Efficient World Modelscited by 328
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
50 most cited of 88 All 88 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026VideoWorld 2: Learning Transferable Knowledge from Real-world Videoscited by 12
- 2026Action Images: End-to-End Policy Learning via Multiview Video Generationcited by 12
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2025NoTVLA: Semantics-Preserving Robot Adaptation via Narrative Action Interfacescited by 4
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026Action Images: End-to-End Policy Learning via Multiview Video Generation7 Apr 2026
- 2026VideoWorld 2: Learning Transferable Knowledge from Real-world Videos10 Feb 2026
- 2025NoTVLA: Semantics-Preserving Robot Adaptation via Narrative Action Interfaces4 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Any4D: Open-Prompt 4D Generation from Natural Language and Images
- 2026Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation
- 2026ViPSim: Collaborating Visual and Parameter Spaces for Consistent Long-Horizon Embodied World Models
- 2026World Action Models: The Next Frontier in Embodied AI
- 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions