mlsanityData to 14 Oct 2026

Current Agents Fail to Leverage World Model as Tool for Foresight

arXiv 2601.03905 ↗First posted 7 Jan 2026cs.AI cs.CL cs.LGcited by 17

On the map: World models → World models for language agents

also in 1 more
Abstract (arXiv)

Agents built on vision-language models increasingly face tasks that demand anticipating future states rather than relying on short-horizon reasoning. Generative world models offer a promising remedy: agents could use them as external simulators to foresee outcomes before acting. This paper empirically examines whether current agents can leverage such world models as tools to enhance their cognition. Across diverse agentic and visual question answering tasks, we observe that some agents rarely invoke simulation (fewer than 1%), frequently misuse predicted rollouts (approximately 15%), and often exhibit inconsistent or even degraded performance (up to 5%) when simulation is available or enforced. Attribution analysis further indicates that the primary bottleneck lies in the agents' capacity to decide when to simulate, how to interpret predicted outcomes, and how to integrate foresight into downstream reasoning. These findings underscore the need for mechanisms that foster calibrated, strategic interaction with world models, paving the way toward more reliable anticipatory cognition in future agent systems.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 25 of its 38 references that are in the map. First posted on arXiv 7 Jan 2026.

Builds on

25 of 38 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025World-in-World: World Models in a Closed-Loop World20 Oct
  2. 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents19 Oct
  3. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
  4. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation17 Oct
  5. 2023Reasoning with Language Model is Planning with World Model24 May

Other references · 20

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  4. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
  5. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  6. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
  7. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
  8. 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agentscited by 159
  9. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
  10. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
  11. 2024An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Modelscited by 50
  12. 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulationcited by 48
8 more
  1. 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websitescited by 45
  2. 2025Pre-Trained Video Generative Models as World Simulatorscited by 44
  3. 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 42
  4. 2025Energy-Based Transformers are Scalable Learners and Thinkerscited by 31
  5. 2025RepoMaster: Autonomous Exploration and Understanding of GitHub Repositories for Complex Task Solvingcited by 19
  6. 2025REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Taskscited by 16
  7. 2025Can World Models Benefit VLMs for World Dynamics?cited by 9
  8. 2024MARPLE: A Benchmark for Long-Horizon Inferencecited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 17.

17 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Internalizing the Future: A Unified Agentic Training Paradigm for World Model Planning
  2. 2026From Control to Foresight: Simulation as a New Paradigm for Human-Agent Collaboration
  3. 2026World Reasoning Arena
  4. 2026EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making
  5. 2026Towards a Belief-Based World Model for LLM Agents
  6. 2026What Do LLM Agents Know About Their World? Task2Quiz: A Paradigm for Studying Environment Understanding
  7. 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulation
  8. 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling