mlsanityData to 7 Oct 2026

Graph World Model

arXiv 2507.10539 ↗First posted 14 Jul 2025cs.LGcited by 14

On the map: World models → World models for language agents

Abstract (arXiv)

World models (WMs) demonstrate strong capabilities in prediction, generation, and planning tasks. Existing WMs primarily focus on unstructured data and cannot leverage the ubiquitous structured data, often represented as graphs, in the digital world. While multiple graph foundation models have been proposed, they focus on graph learning tasks and cannot extend to diverse multi-modal data and interdisciplinary tasks. To address these challenges, we propose the Graph World Model (GWM), a world model that supports both unstructured and graph-structured states with multi-modal information and represents diverse tasks as actions. The core of a GWM is a generic message-passing algorithm to aggregate structured information, either over a unified multi-modal token space by converting multi-modal data into text (GWM-T) or a unified multi-modal embedding space by modality-specific encoders (GWM-E). Notably, GWM introduces action nodes to support diverse tasks, where action nodes are linked to other nodes via direct reference or similarity computation. Extensive experiments on six tasks from diverse domains, including multi-modal generation and matching, recommendation, graph prediction, multi-agent, retrieval-augmented generation, and planning and optimization, show that the same GWM outperforms or matches domain-specific baselines' performance, benefits from multi-hop structures, and demonstrates strong zero-shot/few-shot capabilities on unseen new tasks. Our code for GWM is released at https://github.com/ulab-uiuc/GWM.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 65 of its 90 references that are in the map. First posted on arXiv 14 Jul 2025.

Builds on

65 of 90 references.

Closest ancestors · 1

Same direction, newest first

  1. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learning8 Oct

Other references · 64

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2017Graph Attention Networkscited by 8,854
  8. 2023Visual Instruction Tuningcited by 7,792
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  10. 2017Inductive Representation Learning on Large Graphscited by 6,284
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  12. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
38 more
  1. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  2. 2020Longformer: The Long-Document Transformercited by 3,362
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  5. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  6. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  7. 2016Generative Adversarial Imitation Learningcited by 1,576
  8. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  9. 2019Simplifying Graph Convolutional Networkscited by 1,470
  10. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  11. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  12. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  13. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  14. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  15. 2024Genie: Generative Interactive Environmentscited by 706
  16. 2015Image-based Recommendations on Styles and Substitutescited by 702
  17. 2023Instruction Tuning with GPT-4cited by 676
  18. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
  19. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  20. 2020Graph Neural Networks in Recommender Systems: A Surveycited by 493
  21. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
  22. 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 363
  23. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  24. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  25. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
  26. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  27. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 215
  28. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  29. 2024LLaGA: Large Language and Graph Assistantcited by 177
  30. 2018Graph Convolutional Reinforcement Learningcited by 148
  31. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136
  32. 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
  33. 2023How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrievalcited by 116
  34. 2024Language Agents as Optimizable Graphscited by 81
  35. 2019Fine-Grained Spoiler Detection from Large-Scale Review Corporacited by 76
  36. 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 67
  37. 2023Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorldcited by 65
  38. 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 11.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026WorldGraph: Graph-Native World Modeling
  2. 2026Few-Shot Demonstrations Elicit the Use of In-Context World Representations in LLMs
  3. 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrieval
  4. 2026Are Large Language Models Suitable for Graph Computation? Progress and Prospects
  5. 2025Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigation
  6. 2023Which Modality should I use -- Text, Motif, or Image? : Understanding Graphs with Large Language Models
  7. 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
  8. 2023Talk like a Graph: Encoding Graphs for Large Language Models