Transferring Social Network Knowledge from Multiple GNN Teachers to Kolmogorov-Arnold Networks
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have shown strong performance on graph-structured data, but their reliance on graph connectivity often limits scalability and efficiency. Kolmogorov-Arnold Networks (KANs), a recent architecture with learnable univariate functions, offer strong nonlinear expressiveness and efficient inference. In this work, we integrate KANs into three popular GNN architectures-GAT, SGC, and APPNP-resulting in three new models: KGAT, KSGC, and KAPPNP. We further adopt a multi-teacher knowledge amalgamation framework, where knowledge from multiple KAN-based GNNs is distilled into a graph-independent KAN student model. Experiments on benchmark datasets show that the proposed models improve node classification accuracy, and the knowledge amalgamation approach significantly boosts student model performance. Our findings highlight the potential of KANs for enhancing GNN expressiveness and for enabling efficient, graph-free inference.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
17 of 33 references.
References · 17
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Graph Attention Networkscited by 8,923
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2024KAN: Kolmogorov-Arnold Networkscited by 649
- 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 152
- 2020Distilling Knowledge from Graph Convolutional Networkscited by 129
- 2024GKAN: Graph Kolmogorov-Arnold Networkscited by 53
5 more
- 2024KAGNNs: Kolmogorov-Arnold Networks meet Graph Learningcited by 49
- 2018Amalgamating Knowledge towards Comprehensive Classificationcited by 38
- 2024GraphKAN: Enhancing Feature Extraction with Graph Kolmogorov Arnold Networkscited by 32
- 2024Kolmogorov-Arnold Graph Neural Networkscited by 32
- 2019Knowledge Amalgamation from Heterogeneous Networks by Common Feature Learningcited by 28
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Graph Knowledge Distillation from GNNs to Kolmogorov--Arnold Networks via Self-Attention Dynamic Sampling
- 2025Enhancing Graph Neural Networks: A Mutual Learning Approach
- 2023Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphs
- 2022Boosting Graph Neural Networks via Adaptive Knowledge Distillation
- 2023Frameless Graph Knowledge Distillation
- 2026InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation
- 2022Weisfeiler and Leman Go Relational
- 2021Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Framework