Aligning Agentic World Models via Knowledgeable Experience Learning
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
Current Large Language Models (LLMs) exhibit a critical modal disconnect: they possess vast semantic knowledge but lack the procedural grounding to respect the immutable laws of the physical world. Consequently, while these agents implicitly function as world models, their simulations often suffer from physical hallucinations-generating plans that are logically sound but physically unexecutable. Existing alignment strategies predominantly rely on resource-intensive training or fine-tuning, which attempt to compress dynamic environmental rules into static model parameters. However, such parametric encapsulation is inherently rigid, struggling to adapt to the open-ended variability of physical dynamics without continuous, costly retraining. To bridge this gap, we introduce WorldMind, a framework that autonomously constructs a symbolic World Knowledge Repository by synthesizing environmental feedback. Specifically, it unifies Process Experience to enforce physical feasibility via prediction errors and Goal Experience to guide task optimality through successful trajectories. Experiments on EB-ALFRED and EB-Habitat demonstrate that WorldMind achieves superior performance compared to baselines with remarkable cross-model and cross-environment transferability.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 89 of its 116 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
89 of 116 references.
Closest ancestors · 17
Same direction, newest first
- 2026Current Agents Fail to Leverage World Model as Tool for Foresight7 Jan
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec
- 2025Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspective16 Oct
- 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents13 Oct
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning16 Jul
- 2025Dyna-Think: Synergizing Reasoning, Acting, and World Model Simulation in AI Agents31 May
- 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Model23 Apr
- 2025WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents22 Apr
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov
- 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation17 Oct
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents9 Oct
5 more
- 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents5 Jul
- 2024Agent Planning with World Knowledge Model23 May
- 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 72
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2018World Modelscited by 1,444
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2024Genie: Generative Interactive Environmentscited by 706
38 more
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2019Model-Based Reinforcement Learning for Ataricited by 495
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 420
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 226
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 180
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
- 2023Structured World Models from Human Videoscited by 144
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2023ADriver-I: A General World Model for Autonomous Drivingcited by 102
- 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 99
- 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 90
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 87
- 2025MemInsight: Autonomous Memory Augmentation for LLM Agentscited by 84
- 2024World Models for Autonomous Driving: An Initial Surveycited by 79
- 2021DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representationscited by 73
- 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 67
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
- 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 65
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Taskscited by 62
- 2025Embodied AI Agents: Modeling the Worldcited by 57
- 2023TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Predictioncited by 56
- 2025FLEX: Continuous Agent Evolution via Forward Learning from Experiencecited by 51
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 50
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45
- 2025Building Self-Evolving Agents via Experience-Driven Lifelong Learning: A Framework and Benchmarkcited by 43
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Code as Agent Harnesscited by 40
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 3
- 2026Quo Vadis, World Modeling?cited by 0
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026Code as Agent Harness18 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024Making Large Language Models into World Models with Precondition and Effect Knowledge
- 2026From Traces to Agentic Worlds: Agentic Language World Models for Interactive Environment Simulation
- 2026World Potential Model: Pretrained World Knowledge as Progress Potentials
- 2026Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents
- 2024Enhancing Agent Learning through World Dynamics Modeling
- 2025Thinking by Doing: Building Efficient World Model Reasoning in LLMs via Multi-turn Interaction
- 2026From Language Models to World-Acting Systems: Progress and Limits of Agentic AI across Digital, Social, Virtual, and Physical Environments