Understanding Rollout Error in Graph World Models
On the map: World models → World models for language agents
Abstract (arXiv)
World models are increasingly used for planning, yet most analyses of rollout error assume vector-valued states and scalar error amplification. Many planning environments, however, are naturally graph-structured: agents, tools, skills, routes, and dependencies interact through evolving relations. In this work, we study how prediction errors accumulate in Graph World Models (GWMs). We formulate fixed-edge and dynamic-edge GWM rollouts under a unified state-action transition framework and derive topology-aware error bounds. For fixed-edge rollouts, we show that long-horizon node error separates into a topology factor, governed by the graph spectral radius, and a model factor, governed by layer spectral norms. For dynamic-edge rollouts, we introduce a joint node-edge error operator that captures feedback between feature prediction and structure prediction, revealing when edge errors amplify future message passing. Motivated by these bounds, we propose Error-Aware GWM, a training objective that combines spectral regularization, rollout consistency, and critical-node weighting. Across synthetic graph topologies and heterogeneous agent-graph testbeds, we find that rollout error and planning regret grow with horizon, that dynamic-edge training is necessary when structure evolves, and that Error-Aware GWM improves long-horizon stability without sacrificing one-step accuracy. Our results characterize when graph world models remain reliable under autoregressive planning and when topology makes them fail.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 47 of its 58 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
47 of 58 references.
Closest ancestors · 2
Same direction, newest first
- 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents5 Jul
- 2021Learning Knowledge Graph-based World Models of Textual Environments17 Jun
Other references · 45
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
33 more
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 748
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
- 2021Do Transformers Really Perform Bad for Graph Representation?cited by 318
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2018Graph networks as learnable physics engines for inference and controlcited by 242
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2019Contrastive Learning of Structured World Modelscited by 206
- 2024LLaGA: Large Language and Graph Assistantcited by 177
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136
- 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
- 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 91
- 2018Lipschitz Continuity in Model-based Reinforcement Learningcited by 90
- 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 67
- 2025VRAG: Learning World Models for Interactive Video Generationcited by 37
- 2026Hierarchical Planning with Latent World Modelscited by 34
- 2026GraSP: Graph-Structured Skill Compositions for LLM Agentscited by 25
- 2025NeuralOS: Towards Simulating Operating Systems via Neural Generative Modelscited by 17
- 2025Dyn-O: Building Structured World Models with Object-Centric Representationscited by 12
- 2024The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisitedcited by 11
- 2025Audited Skill-Graph Self-Improvement for Agentic LLMs via Verifiable Rewards, Experience Synthesis, and Continual Memorycited by 8
- 2025SmallWorlds: Assessing Dynamics Understanding of World Models in Isolated Environmentscited by 4
- 2025Prismatic World Model: Learning Compositional Dynamics for Planning in Hybrid Systemscited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026A Structural Dynamics Graph World Model: Unified Modeling, Constrained Rollout, and Interpretable Calibrationcited by 2
- 2026Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologiescited by 0
- 2026World-as-Graph: Relational World Modeling Through Latent Space Graphscited by 0
- 2026World-as-Graph: Relational World Modeling Through Latent Space Graphs30 Sep 2026
- 2026Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologies23 Sep 2026
- 2026A Structural Dynamics Graph World Model: Unified Modeling, Constrained Rollout, and Interpretable Calibration9 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Repair the Amplifier, Not the Symptom: Stable World-Model Correction for Agent Rollouts
- 2026Graph World Models: Concepts, Taxonomy, and Future Directions
- 2026WorldGraph: Graph-Native World Modeling
- 2026When Can You Correct Distribution Drift in Temporal Graph Generation? A Sharpening--Drift Tension and an Impossibility for Observation-Based Correction
- 2026DynGraphAgentBench: A Benchmark for Agentic Lifecycle Control in Dynamic Graph Anomaly Detection
- 2025IGDA: Interactive Graph Discovery through Large Language Model Agents
- 2026TIGPO: Temporal Instance-Graph Policy Optimization for Long-Horizon LLM Agents
- 2026When Low Prediction Error Misleads Planning: Diagnosing Representation, Dynamics, and Decision Failures in Latent World Models