WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformer
Not on the map. Why?
Abstract (arXiv)
A unified simulator that can model diverse physical phenomena without solver-specific redesign is a long-standing goal across simulation science. We present a learning-based particle simulator built on a single transformer architecture to model cloth, elastic solds, Newtonian and non-Newtonian fluids, granular materials, and molecular dynamics. Our model follows a prediction-correction design on a shared Lagrangian particle representation. An explicit predictor first advances particles under the known external forces, producing an intermediate state that captures externally driven motion but not inter-particle interactions. A learned corrector then predicts the residual position and velocity updates through three stages: a particle tokenizer that encodes local particle-particle, particle-boundary, and topology-guided interactions; a super-token encoder that hierarchically merges particle tokens into a compact set of super tokens via alternating self-attention and token merging; and a super-token decoder that lifts these super tokens back to particle resolution through cross-attention to predict per-particle position and velocity corrections. Progressive token merging reduces the attention cost at successive encoder layers by halving the token count at each level, and the decoder communicates through the compact super-token set rather than full particle-to-particle attention. Across the six dynamics categories, the same architecture generalizes to unseen materials, boundary configurations, initial conditions, and external forces. We further demonstrate downstream interactive control, inverse design, and learning from real-world manipulation data, reducing the need for per-phenomenon solver engineering.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 45 of its 80 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
45 of 80 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2020Point Transformercited by 1,470
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2022Token Merging: Your ViT But Fastercited by 1,021
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
33 more
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2016Accelerating Eulerian Fluid Simulation With Convolutional Networkscited by 130
- 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
- 2016A Compositional Object-Based Approach to Learning Physical Dynamicscited by 119
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 113
- 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
- 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 68
- 2020PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformationcited by 63
- 2018SPNets: Differentiable Fluid Dynamics for Deep Neural Networkscited by 62
- 2018tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flowcited by 44
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 41
- 2024Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulationcited by 27
- 2024BENO: Boundary-embedded Neural Operators for Elliptic PDEscited by 24
- 2025RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illuminationcited by 23
- 2023GIPC: Fast and stable Gauss-Newton optimization of IPC barrier energycited by 7
- 2024StiffGIPC: Advancing GPU IPC for stiff affine-deformable simulationcited by 6
- 2024SENC: Handling Self-collision in Neural Cloth Simulationcited by 4
- 2024Shape Space Spectracited by 4
- 2025Precise Gradient Discontinuities in Neural Fields for Subspace Physicscited by 3
- 2025Fast Subspace Fluid Simulation with a Temporally-Aware Basiscited by 2
- 2025Odd-DC: Generalizable Neural Model Reduction via Odd Difference-of-Convex Structurecited by 1
- 2026Low-Rank Koopman Deformables with Log-Linear Time Integrationcited by 1
- 2026Factorized Neural Implicit DMD for Parametric Dynamicscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Learning a Particle Dynamics Model with Real-world Videos
- 2025ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulation
- 2026UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matching
- 2025Universal Physics Simulation: A Foundational Diffusion Approach
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations
- 2026PhysiFormer: Learning to Simulate Mechanics in World Space
- 2025MDDM: A Molecular Dynamics Diffusion Model to Predict Particle Self-Assembly