Current Agents Fail to Leverage World Model as Tool for Foresight
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
Agents built on vision-language models increasingly face tasks that demand anticipating future states rather than relying on short-horizon reasoning. Generative world models offer a promising remedy: agents could use them as external simulators to foresee outcomes before acting. This paper empirically examines whether current agents can leverage such world models as tools to enhance their cognition. Across diverse agentic and visual question answering tasks, we observe that some agents rarely invoke simulation (fewer than 1%), frequently misuse predicted rollouts (approximately 15%), and often exhibit inconsistent or even degraded performance (up to 5%) when simulation is available or enforced. Attribution analysis further indicates that the primary bottleneck lies in the agents' capacity to decide when to simulate, how to interpret predicted outcomes, and how to integrate foresight into downstream reasoning. These findings underscore the need for mechanisms that foster calibrated, strategic interaction with world models, paving the way toward more reliable anticipatory cognition in future agent systems.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 25 of its 38 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
25 of 38 references.
Closest ancestors · 5
Same direction, newest first
- 2025World-in-World: World Models in a Closed-Loop World20 Oct
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents19 Oct
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
- 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation17 Oct
- 2023Reasoning with Language Model is Planning with World Model24 May
Other references · 20
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
- 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agentscited by 159
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
- 2024An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Modelscited by 50
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulationcited by 48
8 more
- 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websitescited by 45
- 2025Pre-Trained Video Generative Models as World Simulatorscited by 44
- 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 42
- 2025Energy-Based Transformers are Scalable Learners and Thinkerscited by 31
- 2025RepoMaster: Autonomous Exploration and Understanding of GitHub Repositories for Complex Task Solvingcited by 19
- 2025REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Taskscited by 16
- 2025Can World Models Benefit VLMs for World Dynamics?cited by 9
- 2024MARPLE: A Benchmark for Long-Horizon Inferencecited by 5
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
- 2026WebWorld: A Large-Scale World Model for Web Agent Trainingcited by 26
- 2026Reinforcement World Model Learning for LLM-based Agentscited by 24
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoningcited by 14
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026Self-Evolving World Models for LLM Agent Planningcited by 13
- 2026AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constraintscited by 7
- 2026Aligning Agentic World Models via Knowledgeable Experience Learningcited by 5
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 5
- 2026CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposingcited by 4
- 2026Safety, Security, and Cognitive Risks in World Modelscited by 3
- 2026Self-Execution Simulation Improves Coding Modelscited by 3
5 more
- 2026World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoningcited by 2
- 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planningcited by 1
- 2026Quo Vadis, World Modeling?cited by 0
- 2026PreAct-Nav: Agentic Reasoning Before Action for Urban Navigationcited by 0
- 2026Software World Models: From Consequence Prediction to Decision Valuecited by 0
- 2026Software World Models: From Consequence Prediction to Decision Value4 Oct 2026
- 2026PreAct-Nav: Agentic Reasoning Before Action for Urban Navigation4 Oct 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Self-Evolving World Models for LLM Agent Planning29 Jun 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constraints4 Jun 2026
- 2026World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning2 Jun 2026
- 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planning21 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposing6 Apr 2026
- 2026Safety, Security, and Cognitive Risks in World Models1 Apr 2026
5 more
- 2026Self-Execution Simulation Improves Coding Models11 Mar 2026
- 2026WebWorld: A Large-Scale World Model for Web Agent Training16 Feb 2026
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning9 Feb 2026
- 2026Reinforcement World Model Learning for LLM-based Agents5 Feb 2026
- 2026Aligning Agentic World Models via Knowledgeable Experience Learning19 Jan 2026
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
- 2026WebWorld: A Large-Scale World Model for Web Agent Trainingcited by 26
- 2026Reinforcement World Model Learning for LLM-based Agentscited by 24
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoningcited by 14
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026Self-Evolving World Models for LLM Agent Planningcited by 13
- 2026Aligning Agentic World Models via Knowledgeable Experience Learningcited by 5
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 5
- 2026Safety, Security, and Cognitive Risks in World Modelscited by 3
- 2026World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoningcited by 2
- 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planningcited by 1
- 2026Quo Vadis, World Modeling?cited by 0
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Self-Evolving World Models for LLM Agent Planning29 Jun 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning2 Jun 2026
- 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planning21 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026Safety, Security, and Cognitive Risks in World Models1 Apr 2026
- 2026WebWorld: A Large-Scale World Model for Web Agent Training16 Feb 2026
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning9 Feb 2026
- 2026Reinforcement World Model Learning for LLM-based Agents5 Feb 2026
- 2026Aligning Agentic World Models via Knowledgeable Experience Learning19 Jan 2026
- 2026Self-Execution Simulation Improves Coding Modelscited by 3
- 2026Self-Execution Simulation Improves Coding Models11 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Internalizing the Future: A Unified Agentic Training Paradigm for World Model Planning
- 2026From Control to Foresight: Simulation as a New Paradigm for Human-Agent Collaboration
- 2026World Reasoning Arena
- 2026EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making
- 2026Towards a Belief-Based World Model for LLM Agents
- 2026What Do LLM Agents Know About Their World? Task2Quiz: A Paradigm for Studying Environment Understanding
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulation
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling