World-as-Graph: Relational World Modeling Through Latent Space Graphs
On the map: World models → Latent predictive world models also fits: Embodied and robot world models
Abstract (arXiv)
World models aim to learn representations of real-world environments and predict their future evolution. Recent object-centric world models have made expressive progress by representing visual scenes as sets of object-level latent states, but object-object relations are often captured only implicitly, which limits explicit relational and temporal structure modeling and object-centric dynamic memory modeling. To address such challenges, we propose World-As-Graph (WAG), a graph-based object-centric world model that introduces relational inductive bias into JEPA-style predictive representation learning. The proposed WAG contains two main modules: (1) Relation-aware structure induction, which constructs time-varying latent graphs from object-centric slots and designs relation-aware object masking policies to guide relational object representation learning in latent space; (2) Object-centric memory transition, which maintains and updates object-level dynamic states by combining relational information from neighboring objects with historical memory, enabling effective autoregressive future prediction. Extensive experiments on both visual reasoning and robotic manipulation tasks could demonstrate the superior performance of our proposed WAG.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 41 of its 46 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
41 of 46 references.
Closest ancestors · 10
Same direction, newest first
- 2026Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control28 Jul
- 2026When Does LeJEPA Learn a World Model?25 May
- 2025Object-Centric World Models for Causality-Aware Reinforcement Learning18 Nov
- 2025Learning Interactive World Model for Object-Centric Reinforcement Learning4 Nov
- 2025Dyn-O: Building Structured World Models with Object-Centric Representations4 Jul
- 2024SPARTAN: A Sparse Transformer World Model Attending to What Matters11 Nov
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture19 Jan
- 2021Conditional Object-Centric Learning from Video24 Nov
- 2019Contrastive Learning of Structured World Models27 Nov
Other references · 31
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2018World Modelscited by 1,444
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2024Genie: Generative Interactive Environmentscited by 706
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
- 2020Inductive Representation Learning on Temporal Graphscited by 454
- 2025Motus: A Unified Latent Action World Modelcited by 231
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 227
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
19 more
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
- 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 141
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136
- 2025Unified Vision-Language-Action Modelcited by 128
- 2023Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similaritiescited by 78
- 2020Attention over learned object embeddings enables complex visual reasoningcited by 59
- 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
- 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 29
- 2024A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challengescited by 29
- 2024SOLD: Slot Object-Centric Latent Dynamics Models for Relational Manipulation Learning from Pixelscited by 23
- 2024A survey of dynamic graph neural networkscited by 21
- 2025Audio-JEPA: Joint-Embedding Predictive Architecture for Audio Representation Learningcited by 17
- 2024State Space Models on Temporal Graphs: A First-Principles Studycited by 16
- 2025Graph World Modelcited by 14
- 2026Chain of World: World Model Thinking in Latent Motioncited by 8
- 2026Graph World Models: Concepts, Taxonomy, and Future Directionscited by 5
- 2026Understanding Rollout Error in Graph World Modelscited by 3
- 2026A Structural Dynamics Graph World Model: Unified Modeling, Constrained Rollout, and Interpretable Calibrationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Causal-JEPA: Learning World Models through Object-Level Latent Masking
- 2026Towards Spatio-Temporal World Scene Graph Generation from Monocular Videos
- 2026HCLSM: Hierarchical Causal Latent State Machines for Object-Centric World Modeling
- 2024Slot Structured World Models
- 2026Physical Object Understanding with a Physically Controllable World Model
- 2026Object-Centric World Models Meet Monte Carlo Tree Search
- 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation
- 2026WorldGraph: Graph-Native World Modeling