Graph Wave Networks
Not on the map. Why?
Abstract (arXiv)
Dynamics modeling has been introduced as a novel paradigm in message passing (MP) of graph neural networks (GNNs). Existing methods consider MP between nodes as a heat diffusion process, and leverage heat equation to model the temporal evolution of nodes in the embedding space. However, heat equation can hardly depict the wave nature of graph signals in graph signal processing. Besides, heat equation is essentially a partial differential equation (PDE) involving a first partial derivative of time, whose numerical solution usually has low stability, and leads to inefficient model training. In this paper, we would like to depict more wave details in MP, since graph signals are essentially wave signals that can be seen as a superposition of a series of waves in the form of eigenvector. This motivates us to consider MP as a wave propagation process to capture the temporal evolution of wave signals in the space. Based on wave equation in physics, we innovatively develop a graph wave equation to leverage the wave propagation on graphs. In details, we demonstrate that the graph wave equation can be connected to traditional spectral GNNs, facilitating the design of graph wave networks based on various Laplacians and enhancing the performance of the spectral GNNs. Besides, the graph wave equation is particularly a PDE involving a second partial derivative of time, which has stronger stability on graphs than the heat equation that involves a first partial derivative of time. Additionally, we theoretically prove that the numerical solution derived from the graph wave equation are constantly stable, enabling to significantly enhance model efficiency while ensuring its performance. Extensive experiments show that GWNs achieve SOTA and efficient performance on benchmark datasets, and exhibit outstanding performance in addressing challenging graph problems, such as over-smoothing and heterophily.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 56 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
40 of 56 references.
References · 40
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
28 more
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
- 2019Diffusion Improves Graph Learningcited by 414
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
- 2019Graph Neural Networks with convolutional ARMA filterscited by 185
- 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
- 2019Graph Neural Ordinary Differential Equationscited by 154
- 2020Characteristic Functions on Graphs: Birds of a Feather, from Statistical Descriptors to Parametric Modelscited by 116
- 2019Continuous Graph Neural Networkscited by 114
- 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
- 2021Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patternscited by 95
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
- 2021Dissecting the Diffusion Process in Linear Graph Convolutional Networkscited by 58
- 2021How Framelets Enhance Graph Neural Networkscited by 46
- 2022Model Degradation Hinders Deep Graph Neural Networkscited by 26
- 2022A Graph-Enhanced Click Model for Web Searchcited by 17
- 2023A Generalized Neural Diffusion Framework on Graphscited by 13
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Wave-PDE Nets: Trainable Wave-Equation Layers as an Alternative to Attention
- 2025Graph Network-based Structural Simulator: Graph Neural Networks for Structural Dynamics
- 2024Graph Neural Reaction Diffusion Models
- 2025Graph-Aware Diffusion for Signal Generation
- 2023Supercharging Graph Transformers with Advective Diffusion
- 2026DGNet: Discrete Green Networks for Data-Efficient Learning of Spatiotemporal PDEs
- 2026Graph Residual Conjugate Diffusion: SNR-Equalized Heat Flow for Graph Signals
- 2026Colored Graph Signal Diffusion Models