mlsanityData to 7 Oct 2026

Quo Vadis, World Modeling?

arXiv 2608.02713 ↗First posted 3 Aug 2026cs.CV cs.AI cs.ROcited by 0

On the map: World models → World models for language agents

Abstract (arXiv)

Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to parallelize. World modeling offers a natural intermediate proxy that allows agents to query lower-cost, more controllable feedback before committing to real actions. Classical world models instantiate this proxy primarily through future physical-state prediction, a formulation useful yet narrow for agents that require actionable feedback beyond raw state transitions. In this work, we conceptualize Agent-Centric Interactive World Proxies, shifting the fundamental paradigm from physical state transitions to agent-usable information transitions, such as execution outcomes, retrieved experiences or skills, and verification signals, broadening the scope of world modeling to provide versatile feedback for continually improving agents. To systematically map this design space, we organize world proxies into six functional forms based on their feedback modalities: dynamics, spatial, execution, memory/experience, skill, and reward/verification proxies, which together characterize the primary ways world modeling serves agent improvement. We further analyze how these proxies empower agents across three progressive levels: L.1 Inference-Time Guidance, where proxy outputs enrich in-context information for superior decisions; L.2 Training-Time Optimization, where proxy outputs yield rewards, critiques, or synthetic rollouts for policy learning; and L.3 Agent-Proxy Co-Evolution, where real-environment evidence continuously updates both the proxy and the agent for co-evolution. Ultimately, this work recasts world modeling into an agent-centric paradigm, establishing a roadmap for building world proxies that empower agents to plan better, learn faster, and evolve continually.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 209 of its 216 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

209 of 216 references.

Closest ancestors · 26

Same direction, newest first

  1. 2026MCP-Cosmos: World Model-Augmented Agents for Complex Task Execution in MCP Environments9 May
  2. 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr
  3. 2026World-Model-Augmented Web Agents with Action Correction17 Feb
  4. 2026WebWorld: A Large-Scale World Model for Web Agent Training16 Feb
  5. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
  6. 2026Debugging code world models7 Feb
  7. 2026Aligning Agentic World Models via Knowledgeable Experience Learning19 Jan
  8. 2026Current Agents Fail to Leverage World Model as Tool for Foresight7 Jan
  9. 2025Web World Models29 Dec
  10. 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents19 Oct
  11. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
  12. 2025WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesis6 Jul
14 more
  1. 2025World Modelling Improves Language Model Agents3 Jun
  2. 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Model23 Apr
  3. 2025Cosmos World Foundation Model Platform for Physical AI7 Jan
  4. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov
  5. 2024World Models: The Safety Perspective12 Nov
  6. 2024Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents10 Nov
  7. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation17 Oct
  8. 2024Evaluating the World Model Implicit in a Generative Model6 Jun
  9. 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search24 May
  10. 2024Agent Planning with World Knowledge Model23 May
  11. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
  12. 2023Reasoning with Language Model is Planning with World Model24 May
  13. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
  14. 2022Inner Monologue: Embodied Reasoning through Planning with Language Models12 Jul

Other references · 183

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  10. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  11. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  12. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
38 more
  1. 2017Deep reinforcement learning from human preferencescited by 3,846
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  4. 2023Let's Verify Step by Stepcited by 3,598
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  9. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  10. 2020Learning to summarize from human feedbackcited by 2,562
  11. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  12. 2022Video Diffusion Modelscited by 2,280
  13. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  14. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  15. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  16. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  17. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  18. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  19. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  20. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  21. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  22. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  23. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  24. 2018World Modelscited by 1,444
  25. 2024A Survey on LLM-as-a-Judgecited by 1,384
  26. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  27. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  28. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  29. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  30. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  31. 2023Mastering Diverse Domains through World Modelscited by 1,193
  32. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  33. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  34. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  35. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  36. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  37. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  38. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951

50 most cited of 183 All 183 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Traces to Agentic Worlds: Agentic Language World Models for Interactive Environment Simulation
  2. 2026CoMAP: Co-Evolving World Models and Agent Policies for LLM Agents
  3. 2026ProPlay: Procedural World Models for Self-Evolving LLM Agents
  4. 2025World-in-World: World Models in a Closed-Loop World
  5. 2026World Models as an Intermediary between Agents and the Real World
  6. 2026How do World Models and Policies Compose in LLM Agents? A Joint Spectral and Behavioral Account
  7. 2024Making Large Language Models into World Models with Precondition and Effect Knowledge
  8. 2025General agents contain world models