mlsanityData to 7 Oct 2026

World Models for Embodied Intelligence: From Plausible to Controllable to Actionable

arXiv 2609.16697 ↗First posted 15 Sep 2026cs.RO cs.AIcited by 1

On the map: World models → World models for navigation

Abstract (arXiv)

World models connect perception and decision-making in embodied intelligence by maintaining hidden state, anticipating consequences, comparing interventions, and adapting when execution departs from expectations. Although progress is often measured by visual fidelity, their value lies in improving behavior. Before reaching for a cup, a person anticipates its weight and resistance to grasping, shaping the hand before contact. Such anticipation is coarse and rarely pictorial, yet it guides action. This raises a central question: which predictive capabilities improve behavior? Existing surveys, organized by architecture, output modality, or application domain, leave this question implicit. We introduce three progressively stronger capability levels: Plausible models preserve task-relevant temporal, geometric, or physical structure; Controllable models additionally predict how interventions alter that structure; and Actionable models translate predictions into measurable gains in planning, action, learning, evaluation, verification, recovery, or data selection. We complement this hierarchy with a 3 x 4 matrix crossing geometry, physics, and action grounding with improvement loops centered on data, rewards, policies, and the model itself. Using this framework, we survey manipulation, navigation, locomotion, autonomous driving, and general embodied learning, tracing technical progressions, clarifying capability requirements, and examining datasets, benchmarks, and evaluation protocols. We identify challenges in long-horizon consistency, uncertainty calibration, causal intervention testing, latency, verification and recovery, and cross-embodiment transfer. This perspective shifts evaluation from visual plausibility toward whether predictions capture task-relevant state, reflect intervention effects, and improve the closed-loop behavior of embodied agents.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 145 of its 275 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

145 of 275 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026World Model for Robot Learning: A Comprehensive Survey30 Apr
  2. 2025A Comprehensive Survey on World Models for Embodied AI19 Oct
  3. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models1 Jul

Other references · 142

  1. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  2. 2018World Modelscited by 1,444
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  4. 2023Mastering Diverse Domains through World Modelscited by 1,193
  5. 2020Mastering Atari with Discrete World Modelscited by 990
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  7. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  8. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  9. 2019Model-Based Reinforcement Learning for Ataricited by 495
  10. 2026World Action Models are Zero-shot Policiescited by 411
  11. 2022Temporal Difference Learning for Model Predictive Controlcited by 375
  12. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
38 more
  1. 2022Transformers are Sample-Efficient World Modelscited by 317
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  3. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  4. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
  5. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
  6. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
  7. 2025Unified Video Action Modelcited by 195
  8. 2018Stochastic Adversarial Video Predictioncited by 173
  9. 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
  10. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
  11. 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
  12. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 93
  13. 2025TesserAct: Learning 4D Embodied World Modelscited by 90
  14. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 87
  15. 2021FitVid: Overfitting in Pixel-Level Video Predictioncited by 86
  16. 2025Video Generators are Robot Policiescited by 86
  17. 2024Pandora: Towards General World Model with Natural Language Actions and Video Statescited by 83
  18. 2025Yume: An Interactive World Generation Modelcited by 73
  19. 2018IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoningcited by 72
  20. 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 71
  21. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
  22. 2025Large Video Planner Enables Generalizable Robot Controlcited by 67
  23. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
  24. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
  25. 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulatorscited by 65
  26. 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 64
  27. 2025A Survey of World Models for Autonomous Drivingcited by 60
  28. 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AIcited by 60
  29. 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Modelcited by 58
  30. 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Trainingcited by 57
  31. 2025Evaluating Gemini Robotics Policies in a Veo World Simulatorcited by 50
  32. 2025Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Roboticscited by 47
  33. 2026LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestioncited by 46
  34. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
  35. 2026World Action Models: The Next Frontier in Embodied AIcited by 46
  36. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policiescited by 46
  37. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45
  38. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routingcited by 41

50 most cited of 142 All 142 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026HappyWorld-Benchcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence
  2. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
  3. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models
  4. 2026Lifting Embodied World Models for Planning and Control
  5. 2025A Step Toward World Models: A Survey on Robotic Manipulation
  6. 2026Learning Counterfactual World Models for Embodied Reasoning under Partial Observability
  7. 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform
  8. 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling