Making Large Language Models into World Models with Precondition and Effect Knowledge
On the map: World models → World models for language agents
Abstract (arXiv)
World models, which encapsulate the dynamics of how actions affect environments, are foundational to the functioning of intelligent agents. In this work, we explore the potential of Large Language Models (LLMs) to operate as world models. Although LLMs are not inherently designed to model real-world dynamics, we show that they can be induced to perform two critical world model functions: determining the applicability of an action based on a given world state, and predicting the resulting world state upon action execution. This is achieved by fine-tuning two separate LLMs-one for precondition prediction and another for effect prediction-while leveraging synthetic data generation techniques. Through human-participant studies, we validate that the precondition and effect knowledge generated by our models aligns with human understanding of world dynamics. We also analyze the extent to which the world model trained on our synthetic data results in an inferred state space that supports the creation of action chains, a necessary property for planning.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 22 of its 45 references that are in the map. First posted on arXiv 18 Sep 2024.
Builds on
22 of 45 references.
Closest ancestors · 8
Same direction, newest first
- 2024Robust agents learn causal world models16 Feb
- 2023Reasoning with Language Model is Planning with World Model24 May
- 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning24 May
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May
- 2023Explainable Reinforcement Learning via a Causal World Model4 May
- 2023Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling28 Jan
- 2021Learning Knowledge Graph-based World Models of Textual Environments17 Jun
- 2021Modeling Worlds in Text17 Jun
Other references · 14
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2020Planning to Explore via Self-Supervised World Modelscited by 368
- 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 69
- 2018Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehensioncited by 62
- 2024Can Language Models Serve as Text-Based World Simulators?cited by 52
- 2024Mastering Memory Tasks with World Modelscited by 38
- 2021PaCo: Preconditions Attributed to Commonsense Knowledgecited by 9
- 2020Modeling Preconditions in Text with a Crowd-sourced Datasetcited by 8
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understandingcited by 4
2 more
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervisioncited by 4
- 2021Toward Diverse Precondition Generationcited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 9; 2026: 11.
22 papers.
Sort:
By area:
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?cited by 42
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agentscited by 26
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 26
- 2024LLM-Based World Models Can Make Decisions Solely, But Rigorous Evaluations are Neededcited by 10
- 2025When Do Neural Networks Learn World Models?cited by 8
- 2025G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibrationcited by 8
- 2025What Does it Mean for a Neural Network to Learn a "World Model"?cited by 8
- 2025WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agentscited by 5
- 2026Self-Improving World Modelling with Latent Actionscited by 5
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 5
- 2026World-State Transformations for Neuro-symbolic Interactive Storytellingcited by 2
10 more
- 2026PriorZero: Bridging Language Priors and World Models for Decision Makingcited by 1
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?cited by 0
- 2025Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AIcited by 0
- 2026LOGOS-CA: A Cellular Automaton Using Natural Language as State and Rulecited by 0
- 2026Absurd World: A Simple Yet Powerful Method to Absurdify the Real-world for Probing LLM Reasoning Capabilitiescited by 0
- 2026Agent-driven Long-tail Simulation for Autonomous Drivingcited by 0
- 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Controlcited by 0
- 2026Reconstructing Persistent Worlds from Narratives for Narrative-Grounded Interactive Experiencescited by 0
- 2026STEP: State-Aware Task Estimation and Planning with Multi-Modal LLMs for Human-Robot Collaborationcited by 0
- 2026Agentic Cognitive Depth: Operational Criteria for Evaluating LLM Agentscited by 0
- 2026Agentic Cognitive Depth: Operational Criteria for Evaluating LLM Agents3 Oct 2026
- 2026STEP: State-Aware Task Estimation and Planning with Multi-Modal LLMs for Human-Robot Collaboration27 Aug 2026
- 2026Reconstructing Persistent Worlds from Narratives for Narrative-Grounded Interactive Experiences3 Aug 2026
- 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Control30 Jul 2026
- 2026Agent-driven Long-tail Simulation for Autonomous Driving5 Jul 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026World-State Transformations for Neuro-symbolic Interactive Storytelling23 May 2026
- 2026PriorZero: Bridging Language Priors and World Models for Decision Making12 May 2026
- 2026Absurd World: A Simple Yet Powerful Method to Absurdify the Real-world for Probing LLM Reasoning Capabilities10 May 2026
- 2026Self-Improving World Modelling with Latent Actions5 Feb 2026
- 2026LOGOS-CA: A Cellular Automaton Using Natural Language as State and Rule18 Jan 2026
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec 2025
10 more
- 2025Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AI16 Oct 2025
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?13 Sep 2025
- 2025What Does it Mean for a Neural Network to Learn a "World Model"?29 Jul 2025
- 2025G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibration10 Jun 2025
- 2025WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents22 Apr 2025
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models22 Mar 2025
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generation18 Feb 2025
- 2025When Do Neural Networks Learn World Models?13 Feb 2025
- 2024LLM-Based World Models Can Make Decisions Solely, But Rigorous Evaluations are Needed13 Nov 2024
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents9 Oct 2024
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?cited by 42
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agentscited by 26
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 26
- 2024LLM-Based World Models Can Make Decisions Solely, But Rigorous Evaluations are Neededcited by 10
- 2025When Do Neural Networks Learn World Models?cited by 8
- 2025What Does it Mean for a Neural Network to Learn a "World Model"?cited by 8
- 2025WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agentscited by 5
- 2026Self-Improving World Modelling with Latent Actionscited by 5
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 5
- 2026PriorZero: Bridging Language Priors and World Models for Decision Makingcited by 1
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026PriorZero: Bridging Language Priors and World Models for Decision Making12 May 2026
- 2026Self-Improving World Modelling with Latent Actions5 Feb 2026
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec 2025
- 2025What Does it Mean for a Neural Network to Learn a "World Model"?29 Jul 2025
- 2025WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents22 Apr 2025
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generation18 Feb 2025
- 2025When Do Neural Networks Learn World Models?13 Feb 2025
- 2024LLM-Based World Models Can Make Decisions Solely, But Rigorous Evaluations are Needed13 Nov 2024
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents9 Oct 2024
- 2026LOGOS-CA: A Cellular Automaton Using Natural Language as State and Rulecited by 0
- 2026Absurd World: A Simple Yet Powerful Method to Absurdify the Real-world for Probing LLM Reasoning Capabilitiescited by 0
- 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Controlcited by 0
- 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Control30 Jul 2026
- 2026Absurd World: A Simple Yet Powerful Method to Absurdify the Real-world for Probing LLM Reasoning Capabilities10 May 2026
- 2026LOGOS-CA: A Cellular Automaton Using Natural Language as State and Rule18 Jan 2026
- 2026Agent-driven Long-tail Simulation for Autonomous Drivingcited by 0
- 2026Agent-driven Long-tail Simulation for Autonomous Driving5 Jul 2026
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2025G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibrationcited by 8
- 2026World-State Transformations for Neuro-symbolic Interactive Storytellingcited by 2
- 2025Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AIcited by 0
- 2026Reconstructing Persistent Worlds from Narratives for Narrative-Grounded Interactive Experiencescited by 0
- 2026Reconstructing Persistent Worlds from Narratives for Narrative-Grounded Interactive Experiences3 Aug 2026
- 2026World-State Transformations for Neuro-symbolic Interactive Storytelling23 May 2026
- 2025Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AI16 Oct 2025
- 2025G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibration10 Jun 2025
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models22 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents
- 2026Qwen-AgentWorld: Language World Models for General Agents
- 2024Enhancing Agent Learning through World Dynamics Modeling
- 2026Towards a Belief-Based World Model for LLM Agents
- 2026Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform
- 2026World Agent: Can Language Models Keep a World Running?
- 2026Aligning Agentic World Models via Knowledgeable Experience Learning
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents