How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Position
On the map: World models → World models for navigation
Abstract (arXiv)
World models have become a central abstraction in modern AI. The term now refers to several different objects: action-conditioned environment models, latent imagination models, future-video predictors, interactive neural simulators, latent predictive representations, and synthetic-data engines. Evaluation has broadened along with the term. Recent papers measure video realism, perceptual similarity, instruction following, physical plausibility, policy ranking, executability, planning success, and downstream policy improvement. This produces both metric diversity and a recurring problem of claim/evidence mismatch: papers sometimes make a stronger claim about what their model is useful for than their evaluation can establish. This paper surveys the recent literature and argues that, for models presented as world models for embodied decision-making, the more decisive issue is not whether the model generates visually convincing videos, but whether it supports reliable interventional reasoning, policy evaluation, planning, and policy optimization under intervention, policy-induced distribution shift, and long-horizon rollout. We organize the survey using an L0--L7 ladder spanning visual plausibility to policy optimization utility, noting that the levels cut across several orthogonal axes and so form an evidential hierarchy rather than a single scalar. The framework foregrounds interventional action fidelity, closed-loop rollout validity, reward/value prediction, policy-ranking agreement, optimization lift, model exploitability, and uncertainty calibration, with a minimal feasible reporting set for real-robot settings.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 52 of its 65 references that are in the map. First posted on arXiv 13 Jun 2026.
Builds on
52 of 65 references.
Closest ancestors · 2
Same direction, newest first
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models9 Feb
- 2024WHALE: Towards Generalizable and Scalable World Models for Embodied Decision-making8 Nov
Other references · 50
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2023Video Language Planningcited by 160
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2024Evaluating the World Model Implicit in a Generative Modelcited by 107
38 more
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
- 2024IRASim: A Fine-Grained World Model for Robot Manipulationcited by 93
- 2020The Value Equivalence Principle for Model-Based Reinforcement Learningcited by 88
- 2020Objective Mismatch in Model-based Reinforcement Learningcited by 87
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Modelscited by 68
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
- 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulatorscited by 65
- 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Trainingcited by 57
- 2025Evaluating Gemini Robotics Policies in a Veo World Simulatorcited by 50
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45
- 2026RISE: Self-Improving Robot Policy with Compositional World Modelcited by 39
- 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Modelcited by 39
- 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policycited by 36
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
- 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulationcited by 35
- 2021Proper Value Equivalencecited by 33
- 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 33
- 2025A Shortcut-aware Video-QA Benchmark for Physical Understanding via Minimal Video Pairscited by 30
- 2026Rethinking Video Generation Model for the Embodied Worldcited by 30
- 2024EVA: An Embodied World Model for Future Video Anticipationcited by 28
- 2025DiWA: Diffusion Policy Adaptation with World Modelscited by 28
- 2026World-Gymnast: Training Robots with Reinforcement Learning in a World Modelcited by 25
- 2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learningcited by 23
- 2025Scalable Policy Evaluation with Video World Modelscited by 22
- 2025WorldPrediction: A Benchmark for High-level World Modeling and Long-horizon Procedural Planningcited by 19
- 2025RoboEnvision: A Long-Horizon Video Generation Model for Multi-Task Robot Manipulationcited by 16
- 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulationcited by 15
- 2026EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewardscited by 14
- 2022Adversarial Counterfactual Environment Model Learningcited by 12
- 2026dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Modelcited by 11
- 2023A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learningcited by 9
- 2026Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learningcited by 9
- 2026RoboVIP: Multi-View Video Generation with Visual Identity Prompting Augments Robot Manipulationcited by 6
- 2026Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Modelscited by 4
- 2026EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fieldscited by 3
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Diagnosing JEPA World Models with Action-Conditioned Predictive Consistencycited by 2
- 2026The Intervention Gap in Latent World Modelscited by 2
- 2026No Free Checker: A Survey of Verifiers for Robot Policiescited by 0
- 2026MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generationcited by 0
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimizationcited by 0
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligencecited by 0
- 2026Not All Errors Matter: Decision-Relevant Prediction Error Predicts Planning Qualitycited by 0
- 2026The Planning Limits of Latent World Modelscited by 0
- 2026In CEM, a World Model Is Also a Proposal Mechanismcited by 0
- 2026In CEM, a World Model Is Also a Proposal Mechanism1 Oct 2026
- 2026The Planning Limits of Latent World Models30 Sep 2026
- 2026Not All Errors Matter: Decision-Relevant Prediction Error Predicts Planning Quality26 Sep 2026
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization19 Sep 2026
- 2026MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generation18 Sep 2026
- 2026No Free Checker: A Survey of Verifiers for Robot Policies8 Sep 2026
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence30 Aug 2026
- 2026The Intervention Gap in Latent World Models30 Aug 2026
- 2026Diagnosing JEPA World Models with Action-Conditioned Predictive Consistency13 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2025World-in-World: World Models in a Closed-Loop World
- 2024WorldSimBench: Towards Video Generation Models as World Simulators
- 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Test
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform