Read, Write, Relax: Why Neural PDE Surrogates Need Both Global and Local Processing
Not on the map. Why?
Abstract (arXiv)
Recent mesh-based simulation advances have, in no small part, relied on neural surrogates of two distinct families: global models that route information through a small set of latent tokens, and local models that perform message passing across mesh edges. Consistent with both classes is the inability to perform beyond low-dimensional problems and small-scale or oversimplified meshes, the simulation regimes where industrial problems reside. Our work shows this explicitly and presents a unified formulation. In global approaches, latent-token attention acts as a spatial low-pass filter, while local message passing lacks the global reach necessary to propagate information across large mesh spaces. Viewed through the error, the two operators are the halves of a multigrid cycle: one corrects errors at the lower end of the spectrum, the other at the higher end, and neither can do the other's job. We introduce Read-Write-Relax (RWR), which interleaves latent attention with message-passing relaxation under a unified formulation. The interleaved processor lowers error across the entire spectrum, making RWR the most accurate model in nearly every comparison across our industrial and public benchmarks. It is also markedly data-efficient in the scarce-data regimes, accurate on the engineering quantities of interest, and scales full-field predictions to challenging, large-scale problems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 56 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
41 of 56 references.
References · 41
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
29 more
- 2022Message Passing Neural PDE Solverscited by 386
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2022How Do Vision Transformers Work?cited by 307
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
- 2019Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernelcited by 213
- 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 195
- 2022Scalable Adaptive Computation for Iterative Generationcited by 195
- 2023Exphormer: Sparse Transformers for Graphscited by 170
- 2022Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practicecited by 136
- 2022MultiScale MeshGraphNetscited by 98
- 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 97
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
- 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 80
- 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 62
- 2023On the Connection Between MPNN and Graph Transformercited by 61
- 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 57
- 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNNcited by 45
- 2024AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fieldscited by 39
- 2025Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systemscited by 31
- 2024Toward a Better Understanding of Fourier Neural Operators from a Spectral Perspectivecited by 25
- 2024BENO: Boundary-embedded Neural Operators for Elliptic PDEscited by 24
- 2025GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformercited by 23
- 2025FLARE: Fast Low-rank Attention Routing Enginecited by 6
- 2023Multiscale Neural Operators for Solving Time-Independent PDEscited by 5
- 2025Graph Transformers for inverse physics: reconstructing flows around arbitrary 2D airfoilscited by 5
- 2026Simple yet Effective: Low-Rank Spatial Attention for Neural Operatorscited by 4
- 2026Crash Assessment via Mesh-Based Graph Neural Networks and Physics-Aware Attentioncited by 1
Built on by
Not cited yet.