Node Feature Kernels Increase Graph Convolutional Network Robustness
Not on the map. Why?
Abstract (arXiv)
The robustness of the much-used Graph Convolutional Networks (GCNs) to perturbations of their input is becoming a topic of increasing importance. In this paper, the random GCN is introduced for which a random matrix theory analysis is possible. This analysis suggests that if the graph is sufficiently perturbed, or in the extreme case random, then the GCN fails to benefit from the node features. It is furthermore observed that enhancing the message passing step in GCNs by adding the node feature kernel to the adjacency matrix of the graph structure solves this problem. An empirical study of a GCN utilised for node classification on six real datasets further confirms the theoretical findings and demonstrates that perturbations of the graph structure can result in GCNs performing significantly worse than Multi-Layer Perceptrons run on the node features alone. In practice, adding a node feature kernel to the message passing of perturbed graphs results in a significant improvement of the GCN's performance, thereby rendering it more robust to graph perturbations. Our code is publicly available at:https://github.com/ChangminWu/RobustGCN.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 50 references that are in the map. First posted on arXiv 4 Sep 2021.
Builds on
29 of 50 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
17 more
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
- 2019Provably Powerful Graph Networkscited by 385
- 2020Graph Structure Learning for Robust Graph Neural Networkscited by 368
- 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 332
- 2019Adversarial Attacks on Graph Neural Networks via Meta Learningcited by 261
- 2020Graph Neural Networks with Heterophilycited by 202
- 2020GNNGuard: Defending Graph Neural Networks against Adversarial Attackscited by 195
- 2018Adversarial Attack and Defense on Graph Data: A Surveycited by 166
- 2017A Random Matrix Approach to Neural Networkscited by 80
- 2020Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networkscited by 76
- 2019Coloring graph neural networks for node disambiguationcited by 49
- 2020Graph Neural Networks: Taxonomy, Advances and Trendscited by 48
- 2020Random Matrix Theory Proves that Deep Learning Representations of GAN-data Behave as Gaussian Mixturescited by 47
- 2020Reliable Graph Neural Networks via Robust Aggregationcited by 43
- 2019Power up! Robust Graph Convolutional Network via Graph Poweringcited by 15
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 2.
5 papers.
- 2023Graph Neural Networks Use Graphs When They Shouldn'tcited by 25
- 2023RDGSL: Dynamic Graph Representation Learning with Structure Learningcited by 13
- 2022Robust Node Classification on Graphs: Jointly from Bayesian Label Transition and Topology-based Label Propagationcited by 12
- 2024A Simple and Yet Fairly Effective Defense for Graph Neural Networkscited by 12
- 2024Bounding the Expected Robustness of Graph Neural Networks Subject to Node Feature Attackscited by 9
- 2024Bounding the Expected Robustness of Graph Neural Networks Subject to Node Feature Attacks27 Apr 2024
- 2024A Simple and Yet Fairly Effective Defense for Graph Neural Networks21 Feb 2024
- 2023Graph Neural Networks Use Graphs When They Shouldn't8 Sep 2023
- 2023RDGSL: Dynamic Graph Representation Learning with Structure Learning5 Sep 2023
- 2022Robust Node Classification on Graphs: Jointly from Bayesian Label Transition and Topology-based Label Propagation21 Aug 2022