Graph World Model
On the map: World models → World models for language agents
Abstract (arXiv)
World models (WMs) demonstrate strong capabilities in prediction, generation, and planning tasks. Existing WMs primarily focus on unstructured data and cannot leverage the ubiquitous structured data, often represented as graphs, in the digital world. While multiple graph foundation models have been proposed, they focus on graph learning tasks and cannot extend to diverse multi-modal data and interdisciplinary tasks. To address these challenges, we propose the Graph World Model (GWM), a world model that supports both unstructured and graph-structured states with multi-modal information and represents diverse tasks as actions. The core of a GWM is a generic message-passing algorithm to aggregate structured information, either over a unified multi-modal token space by converting multi-modal data into text (GWM-T) or a unified multi-modal embedding space by modality-specific encoders (GWM-E). Notably, GWM introduces action nodes to support diverse tasks, where action nodes are linked to other nodes via direct reference or similarity computation. Extensive experiments on six tasks from diverse domains, including multi-modal generation and matching, recommendation, graph prediction, multi-agent, retrieval-augmented generation, and planning and optimization, show that the same GWM outperforms or matches domain-specific baselines' performance, benefits from multi-hop structures, and demonstrates strong zero-shot/few-shot capabilities on unseen new tasks. Our code for GWM is released at https://github.com/ulab-uiuc/GWM.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 65 of its 90 references that are in the map. First posted on arXiv 14 Jul 2025.
Builds on
65 of 90 references.
Closest ancestors · 1
Same direction, newest first
Other references · 64
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Graph Attention Networkscited by 8,854
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
38 more
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
- 2024Genie: Generative Interactive Environmentscited by 706
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2023Instruction Tuning with GPT-4cited by 676
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 493
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 363
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 215
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
- 2024LLaGA: Large Language and Graph Assistantcited by 177
- 2018Graph Convolutional Reinforcement Learningcited by 148
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136
- 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
- 2023How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrievalcited by 116
- 2024Language Agents as Optimizable Graphscited by 81
- 2019Fine-Grained Spoiler Detection from Large-Scale Review Corporacited by 76
- 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 67
- 2023Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorldcited by 65
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 11.
14 papers.
Sort:
By area:
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 40
- 2026Graph World Models: Concepts, Taxonomy, and Future Directionscited by 5
- 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modelingcited by 3
- 2026NGDB-Zoo: Towards Efficient and Scalable Neural Graph Databases Trainingcited by 2
- 2026Modality-free Graph In-context Alignmentcited by 2
- 2026A Structural Dynamics Graph World Model: Unified Modeling, Constrained Rollout, and Interpretable Calibrationcited by 2
- 2025ResearchArcade: Graph Interface for Academic Taskscited by 0
- 2025Debugging Tabular Log as Dynamic Graphscited by 0
- 2026HyperWorld: Hypergraph-Structured State Serialization Improves Learned Textual World Modelscited by 0
- 2026GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planningcited by 0
- 2026Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologiescited by 0
- 2026Graph World Models for Constrained Epidemic Policy Planningcited by 0
- 2026Network World Models as Environments for Algorithm Design on Complex Systems1 Oct 2026
- 2026World-as-Graph: Relational World Modeling Through Latent Space Graphs30 Sep 2026
- 2026Graph World Models for Constrained Epidemic Policy Planning28 Sep 2026
- 2026Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologies23 Sep 2026
- 2026GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planning16 Sep 2026
- 2026A Structural Dynamics Graph World Model: Unified Modeling, Constrained Rollout, and Interpretable Calibration9 Aug 2026
- 2026HyperWorld: Hypergraph-Structured State Serialization Improves Learned Textual World Models12 Jun 2026
- 2026Graph World Models: Concepts, Taxonomy, and Future Directions30 Apr 2026
- 2026Modality-free Graph In-context Alignment13 Mar 2026
- 2026NGDB-Zoo: Towards Efficient and Scalable Neural Graph Databases Training25 Feb 2026
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents14 Jan 2026
- 2025Debugging Tabular Log as Dynamic Graphs28 Dec 2025
2 more
- 2026Graph World Models: Concepts, Taxonomy, and Future Directionscited by 5
- 2026A Structural Dynamics Graph World Model: Unified Modeling, Constrained Rollout, and Interpretable Calibrationcited by 2
- 2026HyperWorld: Hypergraph-Structured State Serialization Improves Learned Textual World Modelscited by 0
- 2026GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planningcited by 0
- 2026Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologiescited by 0
- 2026Graph World Models for Constrained Epidemic Policy Planningcited by 0
- 2026World-as-Graph: Relational World Modeling Through Latent Space Graphscited by 0
- 2026Network World Models as Environments for Algorithm Design on Complex Systemscited by 0
- 2026Network World Models as Environments for Algorithm Design on Complex Systems1 Oct 2026
- 2026World-as-Graph: Relational World Modeling Through Latent Space Graphs30 Sep 2026
- 2026Graph World Models for Constrained Epidemic Policy Planning28 Sep 2026
- 2026Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologies23 Sep 2026
- 2026GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planning16 Sep 2026
- 2026A Structural Dynamics Graph World Model: Unified Modeling, Constrained Rollout, and Interpretable Calibration9 Aug 2026
- 2026HyperWorld: Hypergraph-Structured State Serialization Improves Learned Textual World Models12 Jun 2026
- 2026Graph World Models: Concepts, Taxonomy, and Future Directions30 Apr 2026
- 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modelingcited by 3
- 2026Modality-free Graph In-context Alignmentcited by 2
- 2025ResearchArcade: Graph Interface for Academic Taskscited by 0
- 2025Debugging Tabular Log as Dynamic Graphscited by 0
- 2026Modality-free Graph In-context Alignment13 Mar 2026
- 2025Debugging Tabular Log as Dynamic Graphs28 Dec 2025
- 2025ResearchArcade: Graph Interface for Academic Tasks27 Nov 2025
- 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modeling21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026WorldGraph: Graph-Native World Modeling
- 2026Few-Shot Demonstrations Elicit the Use of In-Context World Representations in LLMs
- 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrieval
- 2026Are Large Language Models Suitable for Graph Computation? Progress and Prospects
- 2025Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigation
- 2023Which Modality should I use -- Text, Motif, or Image? : Understanding Graphs with Large Language Models
- 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
- 2023Talk like a Graph: Encoding Graphs for Large Language Models