From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
On the map: World models → World models for navigation
Abstract (arXiv)
Artificial general intelligence ultimately requires agents that can reason and act in the physical world. Action models, vision-language-action policies, and world models have advanced this goal, while World Action Models (WAMs) are particularly promising because they connect candidate interventions with predicted consequences. However, progress remains fragmented: models use incompatible action spaces and prediction targets, datasets and tasks follow different conventions, and runtime systems expose limited interfaces for reuse and evaluation. We review the evolution toward WAMs and organize these limitations into three coupled gaps: model roles and representations, objectives and standardization, and system composition. Building on this analysis, we propose a co-evolution roadmap for physical intelligence centered on the embodied brain, a long-term model target for integrating multimodal context, comparing candidate interventions, and issuing state-transition or capability requests rather than direct actuator commands. WAMs provide promising prototypes for its predictive functions, while a physical harness grounds model outputs through tools, controllers, verification, and trace logging. Shared contracts align heterogeneous models, data, tasks, and embodiments, and closed-loop post-training converts verified interaction into reusable experience. Together, these components define a modular physical-intelligence stack for adaptive and self-improving embodied agents.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 58 of its 87 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
58 of 87 references.
Closest ancestors · 2
Same direction, newest first
- 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots2 Jul
- 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AI15 Jun
Other references · 56
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
38 more
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2022A Generalist Agentcited by 808
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2022Behavior Transformers: Cloning k modes with one stonecited by 304
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2016Deep Visual Foresight for Planning Robot Motioncited by 285
- 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 260
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
- 2025Unified Video Action Modelcited by 205
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 118
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 111
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
- 2025RynnVLA-002: A Unified Vision-Language-Action and World Modelcited by 74
- 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 70
- 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Modelscited by 63
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 39
- 2021RLDS: an Ecosystem to Generate, Share and Use Datasets in Reinforcement Learningcited by 31
- 2025RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaborationcited by 28
- 2025Robobench: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models as Embodied Braincited by 25
- 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulationcited by 19
- 2014RoboBrain: Large-Scale Knowledge Engine for Robotscited by 13
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence
- 2025Embodied AI: From LLMs to World Models
- 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AI
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI