Framelet Message Passing
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) have achieved champion in wide applications. Neural message passing is a typical key module for feature propagation by aggregating neighboring features. In this work, we propose a new message passing based on multiscale framelet transforms, called Framelet Message Passing. Different from traditional spatial methods, it integrates framelet representation of neighbor nodes from multiple hops away in node message update. We also propose a continuous message passing using neural ODE solvers. It turns both discrete and continuous cases can provably achieve network stability and limit oversmoothing due to the multiscale property of framelets. Numerical experiments on real graph datasets show that the continuous version of the framelet message passing significantly outperforms existing methods when learning heterogeneous graphs and achieves state-of-the-art performance on classic node classification tasks with low computational costs.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 57 of its 80 references that are in the map. First posted on arXiv 28 Feb 2023.
Builds on
57 of 80 references.
References · 57
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
38 more
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 545
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
- 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 261
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
- 2020Graph Random Neural Network for Semi-Supervised Learning on Graphscited by 213
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2019Graph Neural Ordinary Differential Equationscited by 154
- 2020Directional Graph Networkscited by 133
- 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
- 2019Stability Properties of Graph Neural Networkscited by 127
- 2020From Local Structures to Size Generalization in Graph Neural Networkscited by 124
- 2020Graphon Neural Networks and the Transferability of Graph Neural Networkscited by 118
- 2019Continuous Graph Neural Networkscited by 114
- 2020Towards Deeper Graph Neural Networks with Differentiable Group Normalizationcited by 114
- 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
- 2019Stability and Generalization of Graph Convolutional Neural Networkscited by 81
- 2020Graph Neural Networks: Architectures, Stability and Transferabilitycited by 80
- 2022Expander Graph Propagationcited by 75
- 2021Graph Neural Networks Inspired by Classical Iterative Algorithmscited by 60
- 2022Generalization Analysis of Message Passing Neural Networks on Large Random Graphscited by 59
- 2022Oversquashing in GNNs through the lens of information contraction and graph expansioncited by 53
- 2018Geometric Scattering for Graph Data Analysiscited by 49
- 2021How Framelets Enhance Graph Neural Networkscited by 46
- 2022Rewiring with Positional Encodings for Graph Neural Networkscited by 36
- 2019On the Transferability of Spectral Graph Filterscited by 28
- 2021Interpretable Stability Bounds for Spectral Graph Filterscited by 28
- 2020On the Stability of Graph Convolutional Neural Networks under Edge Rewiringcited by 25
- 2020Let's Agree to Degree: Comparing Graph Convolutional Networks in the Message-Passing Frameworkcited by 24
- 2019Fast Haar Transforms for Graph Neural Networkscited by 20
- 2021Beyond Low-Pass Filters: Adaptive Feature Propagation on Graphscited by 18
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 1.
3 papers.
- 2023Unifying over-smoothing and over-squashing in graph neural networks: A physics informed approach and beyondcited by 13
- 2024Dirac--Bianconi Graph Neural Networks -- Enabling Non-Diffusive Long-Range Graph Predictionscited by 2
- 2023A Unified View on Neural Message Passing with Opinion Dynamics for Social Networkscited by 1
- 2024Dirac--Bianconi Graph Neural Networks -- Enabling Non-Diffusive Long-Range Graph Predictions17 Jul 2024
- 2023A Unified View on Neural Message Passing with Opinion Dynamics for Social Networks2 Oct 2023
- 2023Unifying over-smoothing and over-squashing in graph neural networks: A physics informed approach and beyond6 Sep 2023