Spatiotemporal Graph Learning with Direct Volumetric Information Passing and Feature Enhancement
Not on the map. Why?
Abstract (arXiv)
Data-driven learning of physical systems has kindled significant attention, where many neural models have been developed. In particular, mesh-based graph neural networks (GNNs) have demonstrated significant potential in modeling spatiotemporal dynamics across arbitrary geometric domains. However, the existing node-edge message-passing and aggregation mechanism in GNNs limits the representation learning ability. In this paper, we proposed a dual-module framework, Cell-embedded and Feature-enhanced Graph Neural Network (aka, CeFeGNN), for learning spatiotemporal dynamics. Specifically, we embed learnable cell attributions to the common node-edge message passing process, which better captures the spatial dependency of regional features. Such a strategy essentially upgrades the local aggregation scheme from first order (e.g., from edge to node) to a higher order (e.g., from volume and edge to node), which takes advantage of volumetric information in message passing. Meanwhile, a novel feature-enhanced block is designed to further improve the model's performance and alleviate the over-smoothness problem. Extensive experiments on various PDE systems and one real-world dataset demonstrate that CeFeGNN achieves superior performance compared with other baselines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 76 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
39 of 76 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
27 more
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Factorized Fourier Neural Operatorscited by 237
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 219
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
- 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
- 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
- 2021Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problemscited by 100
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
- 2022Topological Deep Learning: Going Beyond Graph Datacited by 92
- 2014A Clockwork RNNcited by 70
- 2020Cell Complex Neural Networkscited by 66
- 2021Encoding physics to learn reaction-diffusion processescited by 61
- 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
- 2019A Multigrid Method for Efficiently Training Video Modelscited by 52
- 2022Learning Physics-Informed Neural Networks without Stacked Back-propagationcited by 23
- 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariancecited by 15
- 2023STAEformer: Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for Traffic Forecastingcited by 12
- 2024Multiscale graph neural networks with adaptive mesh refinement for accelerating mesh-based simulationscited by 12
Built on by
Citing papers per year: 2025: 1.
1 paper.