Simulating Continuum Mechanics with Multi-Scale Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Continuum mechanics simulators, numerically solving one or more partial differential equations, are essential tools in many areas of science and engineering, but their performance often limits application in practice. Recent modern machine learning approaches have demonstrated their ability to accelerate spatio-temporal predictions, although, with only moderate accuracy in comparison. Here we introduce MultiScaleGNN, a novel multi-scale graph neural network model for learning to infer unsteady continuum mechanics. MultiScaleGNN represents the physical domain as an unstructured set of nodes, and it constructs one or more graphs, each of them encoding different scales of spatial resolution. Successive learnt message passing between these graphs improves the ability of GNNs to capture and forecast the system state in problems encompassing a range of length scales. Using graph representations, MultiScaleGNN can impose periodic boundary conditions as an inductive bias on the edges in the graphs, and achieve independence to the nodes' positions. We demonstrate this method on advection problems and incompressible fluid dynamics. Our results show that the proposed model can generalise from uniform advection fields to high-gradient fields on complex domains at test time and infer long-term Navier-Stokes solutions within a range of Reynolds numbers. Simulations obtained with MultiScaleGNN are between two and four orders of magnitude faster than the ones on which it was trained.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 9 Jun 2021.
Builds on
25 of 39 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Layer Normalizationcited by 5,579
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2017Self-Normalizing Neural Networkscited by 591
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2018Graph networks as learnable physics engines for inference and controlcited by 242
- 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
- 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
13 more
- 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
- 2016Accelerating Eulerian Fluid Simulation With Convolutional Networkscited by 128
- 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
- 2016A Compositional Object-Based Approach to Learning Physical Dynamicscited by 119
- 2019Hamiltonian Graph Networks with ODE Integratorscited by 107
- 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
- 2018Flexible Neural Representation for Physics Predictioncited by 91
- 2018Propagation Networks for Model-Based Control Under Partial Observationcited by 64
- 2019Graph Element Networks: adaptive, structured computation and memorycited by 41
- 2017Application of Convolutional Neural Network to Predict Airfoil Lift Coefficientcited by 26
- 2020Comparing recurrent and convolutional neural networks for predicting wave propagationcited by 15
- 2018Approximating the solution to wave propagation using deep neural networkscited by 8
- 2020Simulating Surface Wave Dynamics with Convolutional Networkscited by 6
Built on by
Citing papers per year: 2021: 2; 2022: 6; 2023: 10; 2024: 9; 2025: 8; 2026: 4.
39 papers.
Sort:
- 2022MultiScale MeshGraphNetscited by 94
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 77
- 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNNcited by 43
- 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
- 2024Probabilistic Weather Forecasting with Hierarchical Graph Neural Networkscited by 29
- 2023Graph-based Neural Weather Prediction for Limited Area Modelingcited by 22
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2023MMGP: a Mesh Morphing Gaussian Process-based machine learning method for regression of physical problems under non-parameterized geometrical variabilitycited by 15
- 2021Differentiable Physics: A Position Piececited by 12
- 2023Multi-Scale Message Passing Neural PDE Solverscited by 12
- 2024Mesh-based Super-Resolution of Fluid Flows with Multiscale Graph Neural Networkscited by 10
- 2024Multi-Grid Graph Neural Networks with Self-Attention for Computational Mechanicscited by 9
27 more
- 2025MeshMask: Physics-Based Simulations with Masked Graph Neural Networkscited by 8
- 2024A Microstructure-based Graph Neural Network for Accelerating Multiscale Simulationscited by 7
- 2025AMR-Transformer: Enabling Efficient Long-range Interaction for Complex Neural Fluid Simulationcited by 7
- 2021Deep Surrogate for Direct Time Fluid Dynamicscited by 5
- 2023Multi-Scale Simulation of Complex Systems: A Perspective of Integrating Knowledge and Datacited by 5
- 2023Multi-GPU Approach for Training of Graph ML Models on large CFD Meshescited by 4
- 2025A graph neural network surrogate model for mesh-based crashworthiness prediction of vehicle panel componentscited by 4
- 2025Training Transformers for Mesh-Based Simulationscited by 4
- 2022REMuS-GNN: A Rotation-Equivariant Model for Simulating Continuum Dynamicscited by 3
- 2023An Implicit GNN Solver for Poisson-like problemscited by 3
- 2023Learning CO2 plume migration in faulted reservoirs with Graph Neural Networkscited by 3
- 2024Up-sampling-only and Adaptive Mesh-based GNN for Simulating Physical Systemscited by 3
- 2022DS-GPS : A Deep Statistical Graph Poisson Solver (for faster CFD simulations)cited by 2
- 2023On the Relationships between Graph Neural Networks for the Simulation of Physical Systems and Classical Numerical Methodscited by 2
- 2024LatticeGraphNet: A two-scale graph neural operator for simulating lattice structurescited by 2
- 2024Learning Physical Simulation with Message Passing Transformercited by 2
- 2024Scalable and Consistent Graph Neural Networks for Distributed Mesh-based Data-driven Modelingcited by 2
- 2023Proposing an intelligent mesh smoothing method with graph neural networkscited by 1
- 2025Curriculum Learning for Mesh-based simulationscited by 1
- 2025Graph Deep Learning for Intracranial Aneurysm Blood Flow Simulation and Risk Assessmentcited by 1
- 2024Statistical Edge Detection And UDF Learning For Shape Representationcited by 0
- 2025PLAID: A Unified Data Model for Machine Learning on Heterogeneous Physics Simulationscited by 0
- 2025Learning Deformable Body Interactions With Adaptive Spatial Tokenizationcited by 0
- 2026Deterministic and probabilistic neural surrogates of global hybrid-Vlasov simulationscited by 0
- 2026A Dual-Graph Spatiotemporal GNN Surrogate for Nonlinear Response Prediction of Reinforced Concrete Beams under Four-Point Bendingcited by 0
- 2026Physics-Informed Coarsening for Multigrid Graph Neural Surrogatescited by 0
- 2026Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panelscited by 0
- 2026Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panels18 Jun 2026
- 2026Physics-Informed Coarsening for Multigrid Graph Neural Surrogates29 May 2026
- 2026A Dual-Graph Spatiotemporal GNN Surrogate for Nonlinear Response Prediction of Reinforced Concrete Beams under Four-Point Bending7 Mar 2026
- 2026Deterministic and probabilistic neural surrogates of global hybrid-Vlasov simulations18 Jan 2026
- 2025Graph Deep Learning for Intracranial Aneurysm Blood Flow Simulation and Risk Assessment9 Dec 2025
- 2025Curriculum Learning for Mesh-based simulations16 Sep 2025
- 2025Training Transformers for Mesh-Based Simulations25 Aug 2025
- 2025Learning Deformable Body Interactions With Adaptive Spatial Tokenization18 Jul 2025
- 2025PLAID: A Unified Data Model for Machine Learning on Heterogeneous Physics Simulations5 May 2025
- 2025A graph neural network surrogate model for mesh-based crashworthiness prediction of vehicle panel components16 Mar 2025
- 2025AMR-Transformer: Enabling Efficient Long-range Interaction for Complex Neural Fluid Simulation13 Mar 2025
- 2025MeshMask: Physics-Based Simulations with Masked Graph Neural Networks15 Jan 2025
27 more
- 2024Scalable and Consistent Graph Neural Networks for Distributed Mesh-based Data-driven Modeling2 Oct 2024
- 2024Multi-Grid Graph Neural Networks with Self-Attention for Computational Mechanics18 Sep 2024
- 2024Mesh-based Super-Resolution of Fluid Flows with Multiscale Graph Neural Networks12 Sep 2024
- 2024Up-sampling-only and Adaptive Mesh-based GNN for Simulating Physical Systems7 Sep 2024
- 2024Learning Physical Simulation with Message Passing Transformer10 Jun 2024
- 2024Probabilistic Weather Forecasting with Hierarchical Graph Neural Networks7 Jun 2024
- 2024Statistical Edge Detection And UDF Learning For Shape Representation6 May 2024
- 2024A Microstructure-based Graph Neural Network for Accelerating Multiscale Simulations20 Feb 2024
- 2024LatticeGraphNet: A two-scale graph neural operator for simulating lattice structures1 Feb 2024
- 2023Graph-based Neural Weather Prediction for Limited Area Modeling29 Sep 2023
- 2023Deep Learning in Deterministic Computational Mechanics27 Sep 2023
- 2023Proposing an intelligent mesh smoothing method with graph neural networks24 Sep 2023
- 2023Multi-GPU Approach for Training of Graph ML Models on large CFD Meshes25 Jul 2023
- 2023Multi-Scale Simulation of Complex Systems: A Perspective of Integrating Knowledge and Data17 Jun 2023
- 2023Learning CO2 plume migration in faulted reservoirs with Graph Neural Networks16 Jun 2023
- 2023MMGP: a Mesh Morphing Gaussian Process-based machine learning method for regression of physical problems under non-parameterized geometrical variability22 May 2023
- 2023On the Relationships between Graph Neural Networks for the Simulation of Physical Systems and Classical Numerical Methods31 Mar 2023
- 2023Multi-Scale Message Passing Neural PDE Solvers7 Feb 2023
- 2023An Implicit GNN Solver for Poisson-like problems6 Feb 2023
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics14 Dec 2022
- 2022DS-GPS : A Deep Statistical Graph Poisson Solver (for faster CFD simulations)21 Nov 2022
- 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNN5 Oct 2022
- 2022MultiScale MeshGraphNets2 Oct 2022
- 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networks1 Jun 2022
- 2022REMuS-GNN: A Rotation-Equivariant Model for Simulating Continuum Dynamics5 May 2022
- 2021Deep Surrogate for Direct Time Fluid Dynamics16 Dec 2021
- 2021Differentiable Physics: A Position Piece14 Sep 2021
- 2022MultiScale MeshGraphNetscited by 94
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 77
- 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNNcited by 43
- 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
- 2024Probabilistic Weather Forecasting with Hierarchical Graph Neural Networkscited by 29
- 2023Graph-based Neural Weather Prediction for Limited Area Modelingcited by 22
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2023MMGP: a Mesh Morphing Gaussian Process-based machine learning method for regression of physical problems under non-parameterized geometrical variabilitycited by 15
- 2021Differentiable Physics: A Position Piececited by 12
- 2023Multi-Scale Message Passing Neural PDE Solverscited by 12
- 2024Mesh-based Super-Resolution of Fluid Flows with Multiscale Graph Neural Networkscited by 10
- 2024Multi-Grid Graph Neural Networks with Self-Attention for Computational Mechanicscited by 9
12 most cited of 39 All 39 (JSON)
- 2026Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panels18 Jun 2026
- 2026Physics-Informed Coarsening for Multigrid Graph Neural Surrogates29 May 2026
- 2026A Dual-Graph Spatiotemporal GNN Surrogate for Nonlinear Response Prediction of Reinforced Concrete Beams under Four-Point Bending7 Mar 2026
- 2026Deterministic and probabilistic neural surrogates of global hybrid-Vlasov simulations18 Jan 2026
- 2025Graph Deep Learning for Intracranial Aneurysm Blood Flow Simulation and Risk Assessment9 Dec 2025
- 2025Curriculum Learning for Mesh-based simulations16 Sep 2025
- 2025Training Transformers for Mesh-Based Simulations25 Aug 2025
- 2025Learning Deformable Body Interactions With Adaptive Spatial Tokenization18 Jul 2025
- 2025PLAID: A Unified Data Model for Machine Learning on Heterogeneous Physics Simulations5 May 2025
- 2025A graph neural network surrogate model for mesh-based crashworthiness prediction of vehicle panel components16 Mar 2025
- 2025AMR-Transformer: Enabling Efficient Long-range Interaction for Complex Neural Fluid Simulation13 Mar 2025
- 2025MeshMask: Physics-Based Simulations with Masked Graph Neural Networks15 Jan 2025
12 newest of 39 All 39 (JSON)