mlsanityData to 7 Oct 2026

PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systems

arXiv 2410.01337 ↗First posted 2 Oct 2024cs.LG cs.AI cs.CEcited by 18

Not on the map. Why?

Abstract (arXiv)

Solving partial differential equations (PDEs) serves as a cornerstone for modeling complex dynamical systems. Recent progresses have demonstrated grand benefits of data-driven neural-based models for predicting spatiotemporal dynamics (e.g., tremendous speedup gain compared with classical numerical methods). However, most existing neural models rely on rich training data, have limited extrapolation and generalization abilities, and suffer to produce precise or reliable physical prediction under intricate conditions (e.g., irregular mesh or geometry, complex boundary conditions, diverse PDE parameters, etc.). To this end, we propose a new graph learning approach, namely, Physics-encoded Message Passing Graph Network (PhyMPGN), to model spatiotemporal PDE systems on irregular meshes given small training datasets. Specifically, we incorporate a GNN into a numerical integrator to approximate the temporal marching of spatiotemporal dynamics for a given PDE system. Considering that many physical phenomena are governed by diffusion processes, we further design a learnable Laplace block, which encodes the discrete Laplace-Beltrami operator, to aid and guide the GNN learning in a physically feasible solution space. A boundary condition padding strategy is also designed to improve the model convergence and accuracy. Extensive experiments demonstrate that PhyMPGN is capable of accurately predicting various types of spatiotemporal dynamics on coarse unstructured meshes, consistently achieves the state-of-the-art results, and outperforms other baselines with considerable gains.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 45 of its 76 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

45 of 76 references.

References · 45

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  7. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  8. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  9. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  10. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  11. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  12. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
33 more
  1. 2019Diffusion Improves Graph Learningcited by 414
  2. 2022Message Passing Neural PDE Solverscited by 368
  3. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  4. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  5. 2015Diffusion-Convolutional Neural Networkscited by 268
  6. 2021GRAND: Graph Neural Diffusioncited by 258
  7. 2021Factorized Fourier Neural Operatorscited by 237
  8. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  9. 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
  10. 2022U-NO: U-shaped Neural Operatorscited by 219
  11. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  12. 2020Physics-informed learning of governing equations from scarce datacited by 167
  13. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
  14. 2020Transformers for Modeling Physical Systemscited by 105
  15. 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
  16. 2021Learned Coarse Models for Efficient Turbulence Simulationcited by 90
  17. 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
  18. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
  19. 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
  20. 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
  21. 2019LanczosNet: Multi-Scale Deep Graph Convolutional Networkscited by 73
  22. 2021Encoding physics to learn reaction-diffusion processescited by 61
  23. 2020Learning continuous-time PDEs from sparse data with graph neural networkscited by 53
  24. 2022Physics-Embedded Neural Networks: Graph Neural PDE Solvers with Mixed Boundary Conditionscited by 33
  25. 2022A mixed formulation for physics-informed neural networks as a potential solver for engineering problems in heterogeneous domains: comparison with finite element methodcited by 33
  26. 2022Delta-PINNs: physics-informed neural networks on complex geometriescited by 28
  27. 2019Differentiable Physics-informed Graph Networkscited by 25
  28. 2022Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEscited by 25
  29. 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
  30. 2022SeismicNet: Physics-informed neural networks for seismic wave modeling in semi-infinite domaincited by 16
  31. 2022Multi-Output Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Uncertaintiescited by 14
  32. 2024Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equationscited by 4
  33. 2023GPINN: Physics-informed Neural Network with Graph Embeddingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 12.

18 papers.

Sort:

By area:

  1. 2024Predicting Change, Not States: An Alternate Framework for Neural PDE Surrogatescited by 8
  2. 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operatorscited by 6
  3. 2025PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systemscited by 5
  4. 2026Imposing Boundary Conditions on Neural Operators via Learned Function Extensionscited by 3
  5. 2026NGDB-Zoo: Towards Efficient and Scalable Neural Graph Databases Trainingcited by 2
  6. 2026Geometry-Aware Neural Optimizer for Shape Optimization and Inversioncited by 2
  7. 2025Learnable-Differentiable Finite Volume Solver for Accelerated Simulation of Flowscited by 1
  8. 2026DGNet: Discrete Green Networks for Data-Efficient Learning of Spatiotemporal PDEscited by 1
  9. 2026A meshfree exterior calculus for generalizable and data-efficient learning of physics from point cloudscited by 1
  10. 2025OmniFluids: Physics Pre-trained Modeling of Fluid Dynamicscited by 0
  11. 2025MNO: Multiscale Neural Operator for 3D Computational Fluid Dynamicscited by 0
  12. 2025Stable spectral neural operator for learning stiff PDE systems from limited datacited by 0
6 more
  1. 2026CloDS: Visual-Only Unsupervised Cloth Dynamics Learning in Unknown Conditionscited by 0
  2. 2026MAVEN: A Mesh-Aware Volumetric Encoding Network for Simulating 3D Flexible Deformationcited by 0
  3. 2026PerFlow: Physics-Embedded Rectified Flow for Efficient Reconstruction and Uncertainty Quantification of Spatiotemporal Dynamicscited by 0
  4. 2026NPSolver: Neural Poisson Solver with Iterative Physics Supervisioncited by 0
  5. 2026P-K-GCN: Physics-augmented Koopman-enhanced Graph Convolutional Network for Deep Spatiotemporal Super-resolutioncited by 0
  6. 2026Physics-Refined Spatiotemporal Forecasting on Open-Boundary Hydrologic Graphscited by 0