Critique of World Model
On the map: World models → World models for language agents
Abstract (arXiv)
World Model, the algorithmic simulator of the real-world environment which biological agents experience and act upon, has been an emerging topic in recent years due to the rising need to develop virtual agents with artificial (general) intelligence. There has been much discussion on what a world model really is, how to build it, how to use it, and how to evaluate it. In this essay, starting from the imagination in the famed Sci-Fi classic Dune, and drawing inspiration from the concept of ``hypothetical thinking'' in psychology literature, we argue the primary goal of a world model to be it simulating all actionable possibilities of the real world for purposeful reasoning and acting. We examine the key design dimensions of world modeling: data, representation, architecture, learning objective, and usage, surveying existing approaches and analyzing their tradeoffs. Building on this examination, we propose a new Generative Latent Prediction (GLP) architecture for a general-purpose world model, based on stateful, hierarchical, multi-level, and mixed continuous/discrete representations, and a generative and self-supervised learning framework, with an outlook of a Physical, Agentic, and Nested (PAN) AGI system enabled by such a model.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 26 of its 70 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
26 of 70 references.
Closest ancestors · 3
Same direction, newest first
- 2025Cosmos World Foundation Model Platform for Physical AI7 Jan
- 2023Reasoning with Language Model is Planning with World Model24 May
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May
Other references · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2017Neural Discrete Representation Learningcited by 4,712
- 2018World Modelscited by 1,513
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2016Deep Visual Foresight for Planning Robot Motioncited by 285
11 more
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
- 2025Fast Video Generation with Sliding Tile Attentioncited by 128
- 2015Model Predictive Path Integral Control using Covariance Variable Importance Samplingcited by 124
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 104
- 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 97
- 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 89
- 2024Pandora: Towards General World Model with Natural Language Actions and Video Statescited by 86
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2021Toward a `Standard Model' of Machine Learningcited by 8
Built on by
Citing papers per year: 2025: 9; 2026: 16.
25 papers.
Sort:
By area:
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agentscited by 62
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulationcited by 36
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2025ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interactioncited by 15
- 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresightcited by 14
- 2025General Agentic Planning Through Simulative Reasoning with World Modelscited by 13
- 2025SimWorld: An Open-ended Realistic Simulator for Autonomous Agents in Physical and Social Worldscited by 12
- 2026LatentUM: Unleashing the Potential of Interleaved Cross-Modal Reasoning via a Latent-Space Unified Modelcited by 8
- 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspectivecited by 7
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 7
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 6
13 more
- 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026TABQAWORLD: Optimizing Multimodal Reasoning for Multi-Turn Table Question Answeringcited by 4
- 2026Enhancing Table Reasoning with Deterministic Table-State Rewardscited by 3
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Predictive Objectives Discard Exogenous Control-Relevant Features: A Controlled Mechanistic Studycited by 2
- 2026Music-JEPA: Learning a World Model of Sound from Actioncited by 2
- 2026GMT: Goal-Conditioned Multimodal Transformer for 6-DOF Object Trajectory Synthesis in 3D Scenescited by 1
- 2026What You Think is What You See: Driving Exploration in VLM Agents via Visual-Linguistic Curiositycited by 1
- 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planningcited by 1
- 2026Counterfactual Transport Flows for Offline Conservative Trajectory Refinementcited by 0
- 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modelingcited by 0
- 2026WOVEN: Weaving Visual World Modeling into Multimodal LLMscited by 0
- 2026WOVEN: Weaving Visual World Modeling into Multimodal LLMs8 Oct 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026Music-JEPA: Learning a World Model of Sound from Action24 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026Predictive Objectives Discard Exogenous Control-Relevant Features: A Controlled Mechanistic Study29 Jun 2026
- 2026Counterfactual Transport Flows for Offline Conservative Trajectory Refinement8 Jun 2026
- 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modeling2 Jun 2026
- 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planning21 May 2026
- 2026What You Think is What You See: Driving Exploration in VLM Agents via Visual-Linguistic Curiosity5 May 2026
- 2026Human Cognition in Machines: A Unified Perspective of World Models17 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026TABQAWORLD: Optimizing Multimodal Reasoning for Multi-Turn Table Question Answering3 Apr 2026
13 more
- 2026LatentUM: Unleashing the Potential of Interleaved Cross-Modal Reasoning via a Latent-Space Unified Model2 Apr 2026
- 2026GMT: Goal-Conditioned Multimodal Transformer for 6-DOF Object Trajectory Synthesis in 3D Scenes18 Mar 2026
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model11 Feb 2026
- 2026Enhancing Table Reasoning with Deterministic Table-State Rewards30 Jan 2026
- 2025SimWorld: An Open-ended Realistic Simulator for Autonomous Agents in Physical and Social Worlds30 Nov 2025
- 2025ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interaction26 Nov 2025
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulation12 Nov 2025
- 2025A Step Toward World Models: A Survey on Robotic Manipulation31 Oct 2025
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents19 Oct 2025
- 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresight9 Oct 2025
- 2025WoW: Towards a World omniscient World model Through Embodied Interaction26 Sep 2025
- 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective11 Sep 2025
- 2025General Agentic Planning Through Simulative Reasoning with World Models31 Jul 2025
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agentscited by 62
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulationcited by 36
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2025ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interactioncited by 15
- 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresightcited by 14
- 2025General Agentic Planning Through Simulative Reasoning with World Modelscited by 13
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 7
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 6
- 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
12 most cited of 17 All 17 (JSON)
- 2026WOVEN: Weaving Visual World Modeling into Multimodal LLMs8 Oct 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026Music-JEPA: Learning a World Model of Sound from Action24 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modeling2 Jun 2026
- 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planning21 May 2026
- 2026What You Think is What You See: Driving Exploration in VLM Agents via Visual-Linguistic Curiosity5 May 2026
- 2026Human Cognition in Machines: A Unified Perspective of World Models17 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model11 Feb 2026
- 2025ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interaction26 Nov 2025
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulation12 Nov 2025
12 newest of 17 All 17 (JSON)
- 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspectivecited by 7
- 2026TABQAWORLD: Optimizing Multimodal Reasoning for Multi-Turn Table Question Answeringcited by 4
- 2026Enhancing Table Reasoning with Deterministic Table-State Rewardscited by 3
- 2026GMT: Goal-Conditioned Multimodal Transformer for 6-DOF Object Trajectory Synthesis in 3D Scenescited by 1
- 2026TABQAWORLD: Optimizing Multimodal Reasoning for Multi-Turn Table Question Answering3 Apr 2026
- 2026GMT: Goal-Conditioned Multimodal Transformer for 6-DOF Object Trajectory Synthesis in 3D Scenes18 Mar 2026
- 2026Enhancing Table Reasoning with Deterministic Table-State Rewards30 Jan 2026
- 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective11 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
- 2025World-in-World: World Models in a Closed-Loop World
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling
- 2024Making Large Language Models into World Models with Precondition and Effect Knowledge
- 2026Qwen-AgentWorld: Language World Models for General Agents
- 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling