Graph Element Networks: adaptive, structured computation and memory
Not on the map. Why?
Abstract (arXiv)
We explore the use of graph neural networks (GNNs) to model spatial processes in which there is no a priori graphical structure. Similar to finite element analysis, we assign nodes of a GNN to spatial locations and use a computational process defined on the graph to model the relationship between an initial function defined over a space and a resulting function in the same space. We use GNNs as a computational substrate, and show that the locations of the nodes in space as well as their connectivity can be optimized to focus on the most complex parts of the space. Moreover, this representational strategy allows the learned input-output relationship to generalize over the size of the underlying space and run the same model at different levels of precision, trading computation for accuracy. We demonstrate this method on a traditional PDE problem, a physical prediction problem from robotics, and learning to predict scene images from novel viewpoints.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 13; 2023: 10; 2024: 4; 2025: 1; 2026: 2.
41 papers.
Sort:
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
- 2021Simulating Continuum Mechanics with Multi-Scale Graph Neural Networkscited by 39
- 2021Reinforcement Learning for Adaptive Mesh Refinementcited by 37
- 2022Physics-Embedded Neural Networks: Graph Neural PDE Solvers with Mixed Boundary Conditionscited by 33
- 2021Noether Networks: Meta-Learning Useful Conserved Quantitiescited by 26
- 2024HAMLET: Graph Transformer Neural Operator for Partial Differential Equationscited by 24
29 more
- 2021Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 20
- 2021Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networkscited by 18
- 2022Learning the Solution Operator of Boundary Value Problems using Graph Neural Networkscited by 17
- 2023Neural Relational Inference with Fast Modular Meta-learningcited by 16
- 2023Grounding Graph Network Simulators using Physical Sensor Observationscited by 15
- 2022A Finite Element-Inspired Hypergraph Neural Network: Application to Fluid Dynamics Simulationscited by 14
- 2021Convergent Graph Solverscited by 11
- 2022Towards Fast Simulation of Environmental Fluid Mechanics with Multi-Scale Graph Neural Networkscited by 11
- 2023GNN-based physics solver for time-independent PDEscited by 10
- 2023Better Neural PDE Solvers Through Data-Free Mesh Moverscited by 9
- 2022A composable machine-learning approach for steady-state simulations on high-resolution gridscited by 8
- 2022Learning time-dependent PDE solver using Message Passing Graph Neural Networkscited by 7
- 2024Learning time-dependent PDE via graph neural networks and deep operator network for robust accuracy on irregular gridscited by 7
- 2022Quasi-optimal hp-finite element refinements towards singularities via deep neural network predictioncited by 6
- 2022REMuS-GNN: A Rotation-Equivariant Model for Simulating Continuum Dynamicscited by 3
- 2023An Implicit GNN Solver for Poisson-like problemscited by 3
- 2023Inductive biases in deep learning models for weather predictioncited by 3
- 2023Learning Space-Time Continuous Neural PDEs from Partially Observed Statescited by 3
- 2023Learning Efficient Surrogate Dynamic Models with Graph Spline Networkscited by 2
- 2024LatticeGraphNet: A two-scale graph neural operator for simulating lattice structurescited by 2
- 2024G-Adaptivity: optimised graph-based mesh relocation for finite element methodscited by 2
- 2025Learning Effective Dynamics across Spatio-Temporal Scales of Complex Flowscited by 2
- 2021Skeleton-based Hand-Gesture Recognition with Lightweight Graph Convolutional Networkscited by 1
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 0
- 2021An FEA surrogate model with Boundary Oriented Graph Embedding approachcited by 0
- 2022Inference from Real-World Sparse Measurementscited by 0
- 2023SURF: A Generalization Benchmark for GNNs Predicting Fluid Dynamicscited by 0
- 2026WeatherNext 3: Increasing resolution and performance of global weather models with raw observationscited by 0
- 2026Where to Compute and How to Interact: Operator-Readable Adaptation with Gauge-Aware Transportcited by 0
- 2026Where to Compute and How to Interact: Operator-Readable Adaptation with Gauge-Aware Transport14 Sep 2026
- 2026WeatherNext 3: Increasing resolution and performance of global weather models with raw observations3 Sep 2026
- 2025Learning Effective Dynamics across Spatio-Temporal Scales of Complex Flows11 Feb 2025
- 2024G-Adaptivity: optimised graph-based mesh relocation for finite element methods5 Jul 2024
- 2024Learning time-dependent PDE via graph neural networks and deep operator network for robust accuracy on irregular grids13 Feb 2024
- 2024HAMLET: Graph Transformer Neural Operator for Partial Differential Equations5 Feb 2024
- 2024LatticeGraphNet: A two-scale graph neural operator for simulating lattice structures1 Feb 2024
- 2023Better Neural PDE Solvers Through Data-Free Mesh Movers9 Dec 2023
- 2023SURF: A Generalization Benchmark for GNNs Predicting Fluid Dynamics30 Oct 2023
- 2023Learning Efficient Surrogate Dynamic Models with Graph Spline Networks25 Oct 2023
- 2023Neural Relational Inference with Fast Modular Meta-learning10 Oct 2023
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEs1 Sep 2023
29 more
- 2023Learning Space-Time Continuous Neural PDEs from Partially Observed States9 Jul 2023
- 2023Inductive biases in deep learning models for weather prediction6 Apr 2023
- 2023GNN-based physics solver for time-independent PDEs28 Mar 2023
- 2023Grounding Graph Network Simulators using Physical Sensor Observations23 Feb 2023
- 2023An Implicit GNN Solver for Poisson-like problems6 Feb 2023
- 2022A Finite Element-Inspired Hypergraph Neural Network: Application to Fluid Dynamics Simulations30 Dec 2022
- 2022GraphCast: Learning skillful medium-range global weather forecasting24 Dec 2022
- 2022Inference from Real-World Sparse Measurements20 Oct 2022
- 2022A composable machine-learning approach for steady-state simulations on high-resolution grids11 Oct 2022
- 2022Quasi-optimal hp-finite element refinements towards singularities via deep neural network prediction13 Sep 2022
- 2022Learning the Solution Operator of Boundary Value Problems using Graph Neural Networks28 Jun 2022
- 2022Physics-Embedded Neural Networks: Graph Neural PDE Solvers with Mixed Boundary Conditions24 May 2022
- 2022REMuS-GNN: A Rotation-Equivariant Model for Simulating Continuum Dynamics5 May 2022
- 2022Towards Fast Simulation of Environmental Fluid Mechanics with Multi-Scale Graph Neural Networks5 May 2022
- 2022Learning time-dependent PDE solver using Message Passing Graph Neural Networks15 Apr 2022
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learning31 Mar 2022
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attention22 Jan 2022
- 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Network6 Jan 2022
- 2021Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognition6 Dec 2021
- 2021Noether Networks: Meta-Learning Useful Conserved Quantities6 Dec 2021
- 2021An FEA surrogate model with Boundary Oriented Graph Embedding approach30 Aug 2021
- 2021Neural Operator: Learning Maps Between Function Spaces19 Aug 2021
- 2021Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networks21 Jul 2021
- 2021Simulating Continuum Mechanics with Multi-Scale Graph Neural Networks9 Jun 2021
- 2021Convergent Graph Solvers3 Jun 2021
- 2021Choose a Transformer: Fourier or Galerkin31 May 2021
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognition12 Apr 2021
- 2021Skeleton-based Hand-Gesture Recognition with Lightweight Graph Convolutional Networks9 Apr 2021
- 2021Reinforcement Learning for Adaptive Mesh Refinement1 Mar 2021
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
- 2021Simulating Continuum Mechanics with Multi-Scale Graph Neural Networkscited by 39
- 2021Reinforcement Learning for Adaptive Mesh Refinementcited by 37
- 2022Physics-Embedded Neural Networks: Graph Neural PDE Solvers with Mixed Boundary Conditionscited by 33
- 2021Noether Networks: Meta-Learning Useful Conserved Quantitiescited by 26
- 2024HAMLET: Graph Transformer Neural Operator for Partial Differential Equationscited by 24
12 most cited of 41 All 41 (JSON)
- 2026Where to Compute and How to Interact: Operator-Readable Adaptation with Gauge-Aware Transport14 Sep 2026
- 2026WeatherNext 3: Increasing resolution and performance of global weather models with raw observations3 Sep 2026
- 2025Learning Effective Dynamics across Spatio-Temporal Scales of Complex Flows11 Feb 2025
- 2024G-Adaptivity: optimised graph-based mesh relocation for finite element methods5 Jul 2024
- 2024Learning time-dependent PDE via graph neural networks and deep operator network for robust accuracy on irregular grids13 Feb 2024
- 2024HAMLET: Graph Transformer Neural Operator for Partial Differential Equations5 Feb 2024
- 2024LatticeGraphNet: A two-scale graph neural operator for simulating lattice structures1 Feb 2024
- 2023Better Neural PDE Solvers Through Data-Free Mesh Movers9 Dec 2023
- 2023SURF: A Generalization Benchmark for GNNs Predicting Fluid Dynamics30 Oct 2023
- 2023Learning Efficient Surrogate Dynamic Models with Graph Spline Networks25 Oct 2023
- 2023Neural Relational Inference with Fast Modular Meta-learning10 Oct 2023
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEs1 Sep 2023
12 newest of 41 All 41 (JSON)