mlsanityData to 14 Oct 2026

Making Large Language Models into World Models with Precondition and Effect Knowledge

arXiv 2409.12278 ↗First posted 18 Sep 2024cs.CLcited by 22

On the map: World models → World models for language agents

Abstract (arXiv)

World models, which encapsulate the dynamics of how actions affect environments, are foundational to the functioning of intelligent agents. In this work, we explore the potential of Large Language Models (LLMs) to operate as world models. Although LLMs are not inherently designed to model real-world dynamics, we show that they can be induced to perform two critical world model functions: determining the applicability of an action based on a given world state, and predicting the resulting world state upon action execution. This is achieved by fine-tuning two separate LLMs-one for precondition prediction and another for effect prediction-while leveraging synthetic data generation techniques. Through human-participant studies, we validate that the precondition and effect knowledge generated by our models aligns with human understanding of world dynamics. We also analyze the extent to which the world model trained on our synthetic data results in an inferred state space that supports the creation of action chains, a necessary property for planning.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 22 of its 45 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

22 of 45 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024Robust agents learn causal world models16 Feb
  2. 2023Reasoning with Language Model is Planning with World Model24 May
  3. 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning24 May
  4. 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May
  5. 2023Explainable Reinforcement Learning via a Causal World Model4 May
  6. 2023Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling28 Jan
  7. 2021Learning Knowledge Graph-based World Models of Textual Environments17 Jun
  8. 2021Modeling Worlds in Text17 Jun

Other references · 14

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  4. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  5. 2020Planning to Explore via Self-Supervised World Modelscited by 368
  6. 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 69
  7. 2018Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehensioncited by 62
  8. 2024Can Language Models Serve as Text-Based World Simulators?cited by 52
  9. 2024Mastering Memory Tasks with World Modelscited by 38
  10. 2021PaCo: Preconditions Attributed to Commonsense Knowledgecited by 9
  11. 2020Modeling Preconditions in Text with a Crowd-sourced Datasetcited by 8
  12. 2022Learning Action Conditions from Instructional Manuals for Instruction Understandingcited by 4
2 more
  1. 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervisioncited by 4
  2. 2021Toward Diverse Precondition Generationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 9; 2026: 11.

22 papers.

Sort:

By area:

  1. 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?cited by 42
  2. 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
  3. 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agentscited by 26
  4. 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 26
  5. 2024LLM-Based World Models Can Make Decisions Solely, But Rigorous Evaluations are Neededcited by 10
  6. 2025When Do Neural Networks Learn World Models?cited by 8
  7. 2025G-Sim: Generative Simulations with Large Language Models and Gradient-Free Calibrationcited by 8
  8. 2025What Does it Mean for a Neural Network to Learn a "World Model"?cited by 8
  9. 2025WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agentscited by 5
  10. 2026Self-Improving World Modelling with Latent Actionscited by 5
  11. 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 5
  12. 2026World-State Transformations for Neuro-symbolic Interactive Storytellingcited by 2
10 more
  1. 2026PriorZero: Bridging Language Priors and World Models for Decision Makingcited by 1
  2. 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?cited by 0
  3. 2025Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AIcited by 0
  4. 2026LOGOS-CA: A Cellular Automaton Using Natural Language as State and Rulecited by 0
  5. 2026Absurd World: A Simple Yet Powerful Method to Absurdify the Real-world for Probing LLM Reasoning Capabilitiescited by 0
  6. 2026Agent-driven Long-tail Simulation for Autonomous Drivingcited by 0
  7. 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Controlcited by 0
  8. 2026Reconstructing Persistent Worlds from Narratives for Narrative-Grounded Interactive Experiencescited by 0
  9. 2026STEP: State-Aware Task Estimation and Planning with Multi-Modal LLMs for Human-Robot Collaborationcited by 0
  10. 2026Agentic Cognitive Depth: Operational Criteria for Evaluating LLM Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents
  2. 2026Qwen-AgentWorld: Language World Models for General Agents
  3. 2024Enhancing Agent Learning through World Dynamics Modeling
  4. 2026Towards a Belief-Based World Model for LLM Agents
  5. 2026Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform
  6. 2026World Agent: Can Language Models Keep a World Running?
  7. 2026Aligning Agentic World Models via Knowledgeable Experience Learning
  8. 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents