Simplifying Graph Kernels for Efficient
Not on the map. Why?
Abstract (arXiv)
While kernel methods and Graph Neural Networks offer complementary strengths, integrating the two has posed challenges in efficiency and scalability. The Graph Neural Tangent Kernel provides a theoretical bridge by interpreting GNNs through the lens of neural tangent kernels. However, its reliance on deep, stacked layers introduces repeated computations that hinder performance. In this work, we introduce a new perspective by designing the simplified graph kernel, which replaces deep layer stacking with a streamlined K-step message aggregation process. This formulation avoids iterative layer-wise propagation altogether, leading to a more concise and computationally efficient framework without sacrificing the expressive power needed for graph tasks. Beyond this simplification, we propose another Simplified Graph Kernel, which draws from Gaussian Process theory to model infinite-width GNNs. Rather than simulating network depth, this kernel analytically computes kernel values based on the statistical behavior of nonlinear activations in the infinite limit. This eliminates the need for explicit architecture simulation, further reducing complexity. Our experiments on standard graph and node classification benchmarks show that our methods achieve competitive accuracy while reducing runtime. This makes them practical alternatives for learning on graphs at scale. Full implementation and reproducibility materials are provided at: https://anonymous.4open.science/r/SGNK-1CE4/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 4 Jul 2025.
Builds on
26 of 49 references.
References · 26
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
14 more
- 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 738
- 2017Deep Neural Networks as Gaussian Processescited by 622
- 2019On Exact Computation with an Infinitely Wide Neural Netcited by 573
- 2020Dataset Meta-Learning from Kernel Ridge-Regressioncited by 230
- 2019Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernelscited by 161
- 2020DiffNet++: A Neural Influence and Interest Diffusion Network for Social Recommendationcited by 46
- 2019Graph Kernels: A Surveycited by 44
- 2020Random Walks: A Review of Algorithms and Applicationscited by 38
- 2023Fast Graph Condensation with Structure-based Neural Tangent Kernelcited by 36
- 2018RetGK: Graph Kernels based on Return Probabilities of Random Walkscited by 32
- 2023Graph Neural Tangent Kernel: Convergence on Large Graphscited by 16
- 2023Multi-agent Attacks for Black-box Social Recommendationscited by 9
- 2020Infinitely Wide Graph Convolutional Networks: Semi-supervised Learning via Gaussian Processescited by 8
- 2021Fast Graph Neural Tangent Kernel via Kronecker Sketchingcited by 2
Built on by
Not cited yet.