mlsanityData to 7 Oct 2026

Aligning Agentic World Models via Knowledgeable Experience Learning

arXiv 2601.13247 ↗First posted 19 Jan 2026cs.CL cs.AI cs.CVcited by 5

On the map: World models → World models for language agents

also in 1 more
Abstract (arXiv)

Current Large Language Models (LLMs) exhibit a critical modal disconnect: they possess vast semantic knowledge but lack the procedural grounding to respect the immutable laws of the physical world. Consequently, while these agents implicitly function as world models, their simulations often suffer from physical hallucinations-generating plans that are logically sound but physically unexecutable. Existing alignment strategies predominantly rely on resource-intensive training or fine-tuning, which attempt to compress dynamic environmental rules into static model parameters. However, such parametric encapsulation is inherently rigid, struggling to adapt to the open-ended variability of physical dynamics without continuous, costly retraining. To bridge this gap, we introduce WorldMind, a framework that autonomously constructs a symbolic World Knowledge Repository by synthesizing environmental feedback. Specifically, it unifies Process Experience to enforce physical feasibility via prediction errors and Goal Experience to guide task optimality through successful trajectories. Experiments on EB-ALFRED and EB-Habitat demonstrate that WorldMind achieves superior performance compared to baselines with remarkable cross-model and cross-environment transferability.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 89 of its 116 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

89 of 116 references.

Closest ancestors · 17

Same direction, newest first

  1. 2026Current Agents Fail to Leverage World Model as Tool for Foresight7 Jan
  2. 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec
  3. 2025Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspective16 Oct
  4. 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents13 Oct
  5. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
  6. 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning16 Jul
  7. 2025Dyna-Think: Synergizing Reasoning, Acting, and World Model Simulation in AI Agents31 May
  8. 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Model23 Apr
  9. 2025WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents22 Apr
  10. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov
  11. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation17 Oct
  12. 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents9 Oct
5 more
  1. 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents5 Jul
  2. 2024Agent Planning with World Knowledge Model23 May
  3. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
  4. 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May
  5. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 72

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  6. 2018World Modelscited by 1,444
  7. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  8. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  9. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  10. 2023Mastering Diverse Domains through World Modelscited by 1,193
  11. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  12. 2024Genie: Generative Interactive Environmentscited by 706
38 more
  1. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  2. 2019Model-Based Reinforcement Learning for Ataricited by 495
  3. 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 420
  4. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  5. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  6. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  7. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  8. 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 226
  9. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
  10. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  11. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  12. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  13. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  14. 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 180
  15. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
  16. 2023Structured World Models from Human Videoscited by 144
  17. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  18. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  19. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
  20. 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
  21. 2023ADriver-I: A General World Model for Autonomous Drivingcited by 102
  22. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 99
  23. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 90
  24. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 87
  25. 2025MemInsight: Autonomous Memory Augmentation for LLM Agentscited by 84
  26. 2024World Models for Autonomous Driving: An Initial Surveycited by 79
  27. 2021DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representationscited by 73
  28. 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 67
  29. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
  30. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 65
  31. 20253D and 4D World Modeling: A Surveycited by 64
  32. 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Taskscited by 62
  33. 2025Embodied AI Agents: Modeling the Worldcited by 57
  34. 2023TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Predictioncited by 56
  35. 2025FLEX: Continuous Agent Evolution via Forward Learning from Experiencecited by 51
  36. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 50
  37. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45
  38. 2025Building Self-Evolving Agents via Experience-Driven Lifelong Learning: A Framework and Benchmarkcited by 43

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Making Large Language Models into World Models with Precondition and Effect Knowledge
  2. 2026From Traces to Agentic Worlds: Agentic Language World Models for Interactive Environment Simulation
  3. 2026World Potential Model: Pretrained World Knowledge as Progress Potentials
  4. 2026Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform
  5. 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents
  6. 2024Enhancing Agent Learning through World Dynamics Modeling
  7. 2025Thinking by Doing: Building Efficient World Model Reasoning in LLMs via Multi-turn Interaction
  8. 2026From Language Models to World-Acting Systems: Progress and Limits of Agentic AI across Digital, Social, Virtual, and Physical Environments