mlsanityData to 7 Oct 2026

Understanding Rollout Error in Graph World Models

arXiv 2606.27780 ↗First posted 26 Jun 2026cs.AIcited by 3

On the map: World models → World models for language agents

Abstract (arXiv)

World models are increasingly used for planning, yet most analyses of rollout error assume vector-valued states and scalar error amplification. Many planning environments, however, are naturally graph-structured: agents, tools, skills, routes, and dependencies interact through evolving relations. In this work, we study how prediction errors accumulate in Graph World Models (GWMs). We formulate fixed-edge and dynamic-edge GWM rollouts under a unified state-action transition framework and derive topology-aware error bounds. For fixed-edge rollouts, we show that long-horizon node error separates into a topology factor, governed by the graph spectral radius, and a model factor, governed by layer spectral norms. For dynamic-edge rollouts, we introduce a joint node-edge error operator that captures feedback between feature prediction and structure prediction, revealing when edge errors amplify future message passing. Motivated by these bounds, we propose Error-Aware GWM, a training objective that combines spectral regularization, rollout consistency, and critical-node weighting. Across synthetic graph topologies and heterogeneous agent-graph testbeds, we find that rollout error and planning regret grow with horizon, that dynamic-edge training is necessary when structure evolves, and that Error-Aware GWM improves long-horizon stability without sacrificing one-step accuracy. Our results characterize when graph world models remain reliable under autoregressive planning and when topology makes them fail.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 47 of its 58 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

47 of 58 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents5 Jul
  2. 2021Learning Knowledge Graph-based World Models of Textual Environments17 Jun

Other references · 45

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  5. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  6. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  7. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  8. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  9. 2018World Modelscited by 1,444
  10. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  11. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  12. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
33 more
  1. 2023Mastering Diverse Domains through World Modelscited by 1,193
  2. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  3. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
  4. 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
  5. 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 748
  6. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  7. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
  8. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
  9. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  10. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
  11. 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
  12. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
  13. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
  14. 2021Do Transformers Really Perform Bad for Graph Representation?cited by 318
  15. 2021GRAND: Graph Neural Diffusioncited by 258
  16. 2018Graph networks as learnable physics engines for inference and controlcited by 242
  17. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  18. 2019Contrastive Learning of Structured World Modelscited by 206
  19. 2024LLaGA: Large Language and Graph Assistantcited by 177
  20. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136
  21. 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
  22. 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 91
  23. 2018Lipschitz Continuity in Model-based Reinforcement Learningcited by 90
  24. 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 67
  25. 2025VRAG: Learning World Models for Interactive Video Generationcited by 37
  26. 2026Hierarchical Planning with Latent World Modelscited by 34
  27. 2026GraSP: Graph-Structured Skill Compositions for LLM Agentscited by 25
  28. 2025NeuralOS: Towards Simulating Operating Systems via Neural Generative Modelscited by 17
  29. 2025Dyn-O: Building Structured World Models with Object-Centric Representationscited by 12
  30. 2024The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisitedcited by 11
  31. 2025Audited Skill-Graph Self-Improvement for Agentic LLMs via Verifiable Rewards, Experience Synthesis, and Continual Memorycited by 8
  32. 2025SmallWorlds: Assessing Dynamics Understanding of World Models in Isolated Environmentscited by 4
  33. 2025Prismatic World Model: Learning Compositional Dynamics for Planning in Hybrid Systemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Repair the Amplifier, Not the Symptom: Stable World-Model Correction for Agent Rollouts
  2. 2026Graph World Models: Concepts, Taxonomy, and Future Directions
  3. 2026WorldGraph: Graph-Native World Modeling
  4. 2026When Can You Correct Distribution Drift in Temporal Graph Generation? A Sharpening--Drift Tension and an Impossibility for Observation-Based Correction
  5. 2026DynGraphAgentBench: A Benchmark for Agentic Lifecycle Control in Dynamic Graph Anomaly Detection
  6. 2025IGDA: Interactive Graph Discovery through Large Language Model Agents
  7. 2026TIGPO: Temporal Instance-Graph Policy Optimization for Long-Horizon LLM Agents
  8. 2026When Low Prediction Error Misleads Planning: Diagnosing Representation, Dynamics, and Decision Failures in Latent World Models