Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
As AI systems move from generating text to accomplishing goals through sustained interaction, the ability to model environment dynamics becomes a central bottleneck. Agents that manipulate objects, navigate software, coordinate with others, or design experiments require predictive environment models, yet the term world model carries different meanings across research communities. We introduce a "levels x laws" taxonomy organized along two axes. The first defines three capability levels: L1 Predictor, which learns one-step local transition operators; L2 Simulator, which composes them into multi-step, action-conditioned rollouts that respect domain laws; and L3 Evolver, which autonomously revises its own model when predictions fail against new evidence. The second identifies four governing-law regimes: physical, digital, social, and scientific. These regimes determine what constraints a world model must satisfy and where it is most likely to fail. Using this framework, we synthesize over 400 works and summarize more than 100 representative systems spanning model-based reinforcement learning, video generation, web and GUI agents, multi-agent social simulation, and AI-driven scientific discovery. We analyze methods, failure modes, and evaluation practices across level-regime pairs, propose decision-centric evaluation principles and a minimal reproducible evaluation package, and outline architectural guidance, open problems, and governance challenges. The resulting roadmap connects previously isolated communities and charts a path from passive next-step prediction toward world models that can simulate, and ultimately reshape, the environments in which agents operate. Code and resources are available at: https://github.com/matrix-agent/awesome-agentic-world-modeling.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 174 of its 518 references that are in the map. First posted on arXiv 24 Apr 2026.
Builds on
174 of 518 references.
Closest ancestors · 23
Same direction, newest first
- 2026World-Model-Augmented Web Agents with Action Correction17 Feb
- 2026WebWorld: A Large-Scale World Model for Web Agent Training16 Feb
- 2026Neuro-Symbolic Synergy for World Modeling11 Feb
- 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
- 2026Reinforcement World Model Learning for LLM-based Agents5 Feb
- 2026Aligning Agentic World Models via Knowledgeable Experience Learning19 Jan
- 2026Current Agents Fail to Leverage World Model as Tool for Foresight7 Jan
- 2025Web World Models29 Dec
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec
- 2025Multilingual Agent-Based World Modeling for Social Science8 Dec
- 2025Social World Model-Augmented Mechanism Design Policy Learning22 Oct
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents19 Oct
11 more
- 2025Code World Models for General Game Playing6 Oct
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
- 2025Social World Models30 Aug
- 2025WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesis6 Jul
- 2025World Modelling Improves Language Model Agents3 Jun
- 2025SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Users14 Apr
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
- 2025Cosmos World Foundation Model Platform for Physical AI7 Jan
- 2024World Models: The Safety Perspective12 Nov
- 2024Project Sid: Many-agent simulations toward AI civilization31 Oct
- 2023S3: Social-network Simulation System with Large Language Model-Empowered Agents27 Jul
Other references · 151
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2024Understanding the planning of LLM agents: A surveycited by 414
- 2026World Action Models are Zero-shot Policiescited by 411
38 more
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
- 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 315
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 216
- 2018Deep Learning: A Critical Appraisalcited by 214
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
- 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelscited by 161
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
- 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Gamecited by 148
- 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2024BiLLM: Pushing the Limit of Post-Training Quantization for LLMscited by 137
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 127
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 117
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationcited by 110
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutationcited by 100
- 2019A Signal Propagation Perspective for Pruning Neural Networks at Initializationcited by 96
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 93
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 93
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Modelscited by 91
- 2025TesserAct: Learning 4D Embodied World Modelscited by 90
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
- 2025PlanGenLLMs: A Modern Survey of LLM Planning Capabilitiescited by 82
50 most cited of 151 All 151 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Modelscited by 12
- 2026Graph World Models: Concepts, Taxonomy, and Future Directionscited by 5
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 3
- 2026Critique of Agent Modelcited by 2
- 2026EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary Worldcited by 1
- 2026Do AI-Native Biotechs Need Departments? Benchmarking Company World Models for AI-Driven Drug Developmentcited by 0
- 2026Learning Stateful Predictive Knowledge From Experiencecited by 0
- 2026Quo Vadis, World Modeling?cited by 0
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026Do AI-Native Biotechs Need Departments? Benchmarking Company World Models for AI-Driven Drug Development21 Jul 2026
- 2026EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary World19 Jul 2026
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation7 Jul 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026Critique of Agent Model22 Jun 2026
- 2026SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models22 May 2026
- 2026Learning Stateful Predictive Knowledge From Experience19 May 2026
- 2026Graph World Models: Concepts, Taxonomy, and Future Directions30 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications
- 2026World Models as an Intermediary between Agents and the Real World
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
- 2026A Tutorial on World Models and Physical AI
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulation
- 2025Critique of World Model
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2026How do World Models and Policies Compose in LLM Agents? A Joint Spectral and Behavioral Account