Multi-fidelity graph-based neural networks architectures to learn Navier-Stokes solutions on non-parametrized 2D domains
On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs
Abstract (arXiv)
We propose a graph-based, multi-fidelity learning framework for the prediction of stationary Navier--Stokes solutions in non-parametrized two-dimensional geometries. The method is designed to guide the learning process through successive approximations, starting from reduced-order and full Stokes models, and progressively approaching the Navier--Stokes solution. To effectively capture both local and long-range dependencies in the velocity and pressure fields, we combine graph neural networks with Transformer and Mamba architectures. While Transformers achieve the highest accuracy, we show that Mamba can be successfully adapted to graph-structured data through an unsupervised node-ordering strategy. The Mamba approach significantly reduces computational cost while maintaining performance. Physical knowledge is embedded directly into the architecture through an encoding-processing-physics informed decoding pipeline. Derivatives are computed through algebraic operators constructed via the Weighted Least Squares method. The flexibility of these operators allows us not only to make the output obey the governing equations, but also to constrain selected hidden features to satisfy mass conservation. We introduce additional physical biases through an enriched graph convolution with the same differential operators describing the PDEs. Overall, we successfully guide the learning process by physical knowledge and fluid dynamics insights, leading to more regular and accurate predictions
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 35 of its 57 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
35 of 57 references.
References · 35
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Rethinking Attention with Performerscited by 1,584
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
- 2019Self-Attention Graph Poolingcited by 421
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
23 more
- 2024Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Modelscited by 232
- 2022Structure-Aware Transformer for Graph Representation Learningcited by 191
- 2022Graph neural networks for materials science and chemistrycited by 181
- 2019Understanding Attention and Generalization in Graph Neural Networkscited by 169
- 2023Exphormer: Sparse Transformers for Graphscited by 166
- 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spacescited by 132
- 2020GraphNorm: A Principled Approach to Accelerating Graph Neural Network Trainingcited by 116
- 2022MultiScale MeshGraphNetscited by 94
- 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 84
- 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
- 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
- 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNNcited by 43
- 2025Transformers are Graph Neural Networkscited by 29
- 2023Learning Reduced-Order Models for Cardiovascular Simulations with Graph Neural Networkscited by 20
- 2022A Finite Element-Inspired Hypergraph Neural Network: Application to Fluid Dynamics Simulationscited by 14
- 2024LaB-GATr: geometric algebra transformers for large biomedical surface and volume meshescited by 12
- 2024Multi-Grid Graph Neural Networks with Self-Attention for Computational Mechanicscited by 9
- 2024Learning time-dependent PDE via graph neural networks and deep operator network for robust accuracy on irregular gridscited by 7
- 2024Deep vectorised operators for pulsatile hemodynamics estimation in coronary arteries from a steady-state priorcited by 6
- 2025Training Transformers for Mesh-Based Simulationscited by 4
- 2025Physics-Informed Machine Learning in Biomedical Science and Engineeringcited by 4
- 2023An Implicit GNN Solver for Poisson-like problemscited by 3
- 2025Graph Deep Learning for Intracranial Aneurysm Blood Flow Simulation and Risk Assessmentcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networks
- 2026Physics and Data Driven Transformer-Mamba Framework for Flow Field
- 2026Fluid-DiT: Graph-Free Diffusion Transformers for Fluid Flow Simulations Learning
- 2025FoilDiff: A Hybrid Transformer Backbone for Diffusion-based Modelling of 2D Airfoil Flow Fields
- 2024PiRD: Physics-informed Residual Diffusion for Flow Field Reconstruction
- 2025P3D: Scalable Neural Surrogates for High-Resolution 3D Physics Simulations with Global Context
- 2026Eradicating Negative Transfer in Multi-Physics Foundation Models via Sparse Mixture-of-Experts Routing
- 2025Towards a Foundation Model for Partial Differential Equations Across Physics Domains