FluidWorld: Reaction-Diffusion Dynamics as a Predictive Substrate for World Models
On the map: World models → Latent predictive world models
Abstract (arXiv)
World models learn to predict future states of an environment, enabling planning and mental simulation. Current approaches default to Transformer-based predictors operating in learned latent spaces. This comes at a cost: O(N^2) computation and no explicit spatial inductive bias. This paper asks a foundational question: is self-attention necessary for predictive world modeling, or can alternative computational substrates achieve comparable or superior results? I introduce FluidWorld, a proof-of-concept world model whose predictive dynamics are governed by partial differential equations (PDEs) of reaction-diffusion type. Instead of using a separate neural network predictor, the PDE integration itself produces the future state prediction. In a strictly parameter-matched three-way ablation on unconditional UCF-101 video prediction (64x64, ~800K parameters, identical encoder, decoder, losses, and data), FluidWorld is compared against both a Transformer baseline (self-attention) and a ConvLSTM baseline (convolutional recurrence). While all three models converge to comparable single-step prediction loss, FluidWorld achieves 2x lower reconstruction error, produces representations with 10-15% higher spatial structure preservation and 18-25% more effective dimensionality, and critically maintains coherent multi-step rollouts where both baselines degrade rapidly. All experiments were conducted on a single consumer-grade PC (Intel Core i5, NVIDIA RTX 4070 Ti), without any large-scale compute. These results establish that PDE-based dynamics, which natively provide O(N) spatial complexity, adaptive computation, and global spatial coherence through diffusion, are a viable and parameter-efficient alternative to both attention and convolutional recurrence for world modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 25 of its 34 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
25 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2019Root Mean Square Layer Normalizationcited by 1,425
12 more
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2017PDE-Net: Learning PDEs from Datacited by 304
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2023Transformer-based World Models Are Happy With 100k Interactionscited by 137
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Featurescited by 53
- 2026Representation Learning for Spatiotemporal Physical Systemscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
- 2026VisualPatchWorld: Code World Models as Latent Structured Representations for Planning
- 2026Nano World Models: A Minimalist Implementation of Future Video Prediction
- 2025SmallWorlds: Assessing Dynamics Understanding of World Models in Isolated Environments
- 2026AGI Maze Prediction Datasets: A Compact Benchmark for Learning World Dynamics with Transformers
- 2026MiniWorld: Democratizing the Training of Video World Models from Scratch
- 2026Predictive Statistics Shape Emergent World Representations of Grid Walkers
- 2026ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow