Relational Learning as World Modeling
On the map: World models → World models for language agents
Abstract (arXiv)
Relational learning typically predicts from a database state, but decision making asks a different question: how will that state change under an action? In operational systems, the answer depends on system-specific dynamics that may not be visible in the database itself. We view each such system as a relational "world" and ask whether a model can infer how it behaves from observed executions. We introduce TabWM (Tabular World Model) and WorldRel, a generator of executable relational worlds for pretraining. Given executions from an unseen world, TabWM uses them as context to predict the sparse structured edits caused by a new action without parameter updates. Across 512 held-out worlds, complete-edit F1 rises from 0.016 with no observed executions to 0.685 with 64, where a correct edit must match its operation, relational location, and value. Because these predictions are explicit relational edits, they can be applied recursively to imagine candidate futures and compare actions before they are taken. Broader search over these predicted futures improves the realized return of selected action sequences. Together, these results suggest that relational dynamics can be learned in context, broadening relational learning from modeling system state to modeling how that state changes under action.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 29 of its 41 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
29 of 41 references.
Closest ancestors · 3
Same direction, newest first
- 2026Do Enterprise Systems Need Learned World Models? The Importance of Context to Infer Dynamics12 May
- 2026World of Workflows: A Benchmark for Bringing World Models to Enterprise Systems29 Jan
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov
Other references · 26
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2020Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learningcited by 98
- 2020Objective Mismatch in Model-based Reinforcement Learningcited by 96
- 2024RelBench: A Benchmark for Deep Learning on Relational Databasescited by 96
- 2020The Value Equivalence Principle for Model-Based Reinforcement Learningcited by 94
- 2025Griffin: Towards a Graph-Centric Relational Database Foundation Modelcited by 47
- 2025Relational Transformer: Toward Zero-Shot Foundation Models for Relational Datacited by 39
14 more
- 2026PluRel: Synthetic Data unlocks Scaling Laws for Relational Foundation Modelscited by 19
- 2026KumoRFM-2: Scaling Foundation Models for Relational Learningcited by 19
- 2019Automated Discovery of Business Process Simulation Models from Event Logscited by 17
- 2023From system models to class models: An in-context learning paradigmcited by 16
- 2026Relational In-Context Learning via Synthetic Pre-training with Structural Priorcited by 14
- 2021Learning Accurate Business Process Simulation Models from Event Logs via Automated Process Discovery and Deep Learningcited by 11
- 2025Doubling Your Data in Minutes: Ultra-fast Tabular Data Generation via LLM-Induced Dependency Graphscited by 9
- 2025Not All Features Deserve Attention: Graph-Guided Dependency Learning for Tabular Data Generation with Language Modelscited by 8
- 2024Enhanced Transformer architecture for in-context learning of dynamical systemscited by 7
- 2025Position: Foundation Models for Tabular Data within Systemic Contexts Need Groundingcited by 6
- 2026Consolidating Rewarded Perturbations for LLM Post-Trainingcited by 3
- 2026SAGE: Sparse Adaptive Guidance for Dependency-Aware Tabular Data Generationcited by 1
- 2026Active Tabular Augmentation via Policy-Guided Diffusion Inpaintingcited by 1
- 2026Statistically Indistinguishable, Operationally Distinct: A Formal Barrier for Tabular Foundation Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Making Large Language Models into World Models with Precondition and Effect Knowledge
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents
- 2026Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Making
- 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents
- 2026Long-Horizon Textual World Modeling through Structured Reasoning
- 2026How do World Models and Policies Compose in LLM Agents? A Joint Spectral and Behavioral Account
- 2026Towards a Belief-Based World Model for LLM Agents
- 2026RoleWorld: Knowledge Transfer in World Modeling with Functional Role Abstractions