MemWM: Memory-Augmented Text-Based World Model
On the map: World models → World models for language agents
Abstract (arXiv)
World models are increasingly used to support planning in agents by predicting how environment states evolve in response to agent actions. Yet fluent next-state predictions can still omit task-critical facts, corrupt product attributes, or apply incorrect transition rules. To address such systematic prediction errors, we introduce MemWM, a memory-augmented text-based world model. MemWM uses world memory, a curated memory bank of transition rules, state caches, and hard-to-predict facts, to condition next-state imagination. We evaluate factual state preservation with Structured State Fidelity (SSF), which scores predicted states through benchmark-specific facts and fields. Compared with SFT, memory-augmented training improves SSF by up to 206.3%. In the full planning setting, we keep the policy model frozen and provide policy-side world skill: retrieved task-level skills and step-wise corrective guidance for action selection. Across ALFWorld, WebShop, and ScienceWorld, memory-augmented agents improve downstream success over an SFT-trained world-model agent, with up to a 65.4% relative gain. Sensitivity analyses further show that retrieved memory improves task success and efficiency under different memory and action-budget settings.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 18 of its 41 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
18 of 41 references.
Closest ancestors · 5
Same direction, newest first
- 2026Beyond State Consistency: Behavior Consistency in Text-Based World Models15 Apr
- 2026Imagine-then-Plan: Agent Learning from Adaptive Lookahead with World Models13 Jan
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec
- 2024Agent Planning with World Knowledge Model23 May
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learning8 Oct
Other references · 13
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2018World Modelscited by 1,444
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 252
- 2023Augmenting Language Models with Long-Term Memorycited by 186
- 2025Loong: Synthesize Long Chain-of-Thoughts at Scale through Verifierscited by 14
- 2025Reinforcement Mid-Trainingcited by 6
1 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Self-Evolving World Models for LLM Agent Planning
- 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents
- 2026Towards a Belief-Based World Model for LLM Agents
- 2026Agent vs. Parametric World Models: Hybrid Planning for Reliable Language Agents
- 2026Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Making
- 2026Qwen-AgentWorld: Language World Models for General Agents
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents
- 2026CoMAP: Co-Evolving World Models and Agent Policies for LLM Agents