mlsanityData to 7 Oct 2026

Spatiotemporal Graph Learning with Direct Volumetric Information Passing and Feature Enhancement

arXiv 2409.18013 ↗First posted 26 Sep 2024cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Data-driven learning of physical systems has kindled significant attention, where many neural models have been developed. In particular, mesh-based graph neural networks (GNNs) have demonstrated significant potential in modeling spatiotemporal dynamics across arbitrary geometric domains. However, the existing node-edge message-passing and aggregation mechanism in GNNs limits the representation learning ability. In this paper, we proposed a dual-module framework, Cell-embedded and Feature-enhanced Graph Neural Network (aka, CeFeGNN), for learning spatiotemporal dynamics. Specifically, we embed learnable cell attributions to the common node-edge message passing process, which better captures the spatial dependency of regional features. Such a strategy essentially upgrades the local aggregation scheme from first order (e.g., from edge to node) to a higher order (e.g., from volume and edge to node), which takes advantage of volumetric information in message passing. Meanwhile, a novel feature-enhanced block is designed to further improve the model's performance and alleviate the over-smoothness problem. Extensive experiments on various PDE systems and one real-world dataset demonstrate that CeFeGNN achieves superior performance compared with other baselines.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 76 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

39 of 76 references.

References · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  5. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  6. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  7. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  8. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  9. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  10. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  11. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  12. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
27 more
  1. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  2. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  3. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  4. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  5. 2020Towards Deeper Graph Neural Networkscited by 296
  6. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  7. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  8. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  9. 2021Factorized Fourier Neural Operatorscited by 237
  10. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  11. 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 219
  12. 2022U-NO: U-shaped Neural Operatorscited by 219
  13. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
  14. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  15. 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
  16. 2021Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problemscited by 100
  17. 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
  18. 2022Topological Deep Learning: Going Beyond Graph Datacited by 92
  19. 2014A Clockwork RNNcited by 70
  20. 2020Cell Complex Neural Networkscited by 66
  21. 2021Encoding physics to learn reaction-diffusion processescited by 61
  22. 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
  23. 2019A Multigrid Method for Efficiently Training Video Modelscited by 52
  24. 2022Learning Physics-Informed Neural Networks without Stacked Back-propagationcited by 23
  25. 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariancecited by 15
  26. 2023STAEformer: Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for Traffic Forecastingcited by 12
  27. 2024Multiscale graph neural networks with adaptive mesh refinement for accelerating mesh-based simulationscited by 12

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.