When Do Causal World Models Help Modular LLM Agents
Not on the map. Why?
Abstract (arXiv)
LLM agents increasingly act through modular systems, such as order, payment, inventory, and shipment services, where actions in one module change which transitions are valid in another. Standard world models usually fit observational traces, but this is not the quantity needed for intervention-time planning: a trace may show that payment precedes shipment without identifying whether payment authorizes shipment, inventory mediates the effect, or a hidden trigger explains both. We study this gap through FedCausalCompose, a causal world-model framework for modular LLM agents in which local actions provide intervention-response evidence for cross-module interfaces. We first show that observational world models incur an irreducible interventional error under unblocked back-door paths, that interface recovery improves with intervention-response coverage, and that an oracle causal composition can beat the non-causal lower bound when coverage and local mechanism errors are controlled. We then test the resulting prediction in diagnostic agent settings. Causal interfaces help most in structured tool environments, where API signatures expose preconditions and downstream effects. In contrast, dialogue and narrative environments often ignore raw edge lists unless a short attention anchor makes the causal information decision-relevant. These results identify a concrete condition for causal world models in LLM agents: causal structure helps when cross-module interfaces are both statistically identifiable and presented in a form the agent can use at action time.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 34 references that are in the map. First posted on arXiv 12 Jul 2026.
Builds on
28 of 34 references.
References · 28
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2019Invariant Risk Minimizationcited by 1,832
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
16 more
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
- 2020Differentiable Causal Discovery from Interventional Datacited by 218
- 2022Causal Discovery in Heterogeneous Environments Under the Sparse Mechanism Shift Hypothesiscited by 54
- 2024Can Language Models Serve as Text-Based World Simulators?cited by 50
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 25
- 2023Explainable Reinforcement Learning via a Causal World Modelcited by 22
- 2025Dyna-Think: Synergizing Reasoning, Acting, and World Model Simulation in AI Agentscited by 14
- 2022Provably Efficient Causal Model-Based Reinforcement Learning for Systematic Generalizationcited by 12
- 2025R-WoM: Retrieval-augmented World Model For Computer-use Agentscited by 10
- 2024Momentum for the Win: Collaborative Federated Reinforcement Learning across Heterogeneous Environmentscited by 7
- 2026PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environmentscited by 5
- 2025Regret-Based Federated Causal Discovery with Unknown Interventionscited by 2
- 2026Federated Causal Discovery Across Heterogeneous Datasets under Latent Confoundingcited by 2
Built on by
Not cited yet.