mlsanityData to 7 Oct 2026

Node Feature Kernels Increase Graph Convolutional Network Robustness

arXiv 2109.01785 ↗First posted 4 Sep 2021cs.LG cs.SI stat.MLcited by 5

Not on the map. Why?

Abstract (arXiv)

The robustness of the much-used Graph Convolutional Networks (GCNs) to perturbations of their input is becoming a topic of increasing importance. In this paper, the random GCN is introduced for which a random matrix theory analysis is possible. This analysis suggests that if the graph is sufficiently perturbed, or in the extreme case random, then the GCN fails to benefit from the node features. It is furthermore observed that enhancing the message passing step in GCNs by adding the node feature kernel to the adjacency matrix of the graph structure solves this problem. An empirical study of a GCN utilised for node classification on six real datasets further confirms the theoretical findings and demonstrates that perturbations of the graph structure can result in GCNs performing significantly worse than Multi-Layer Perceptrons run on the node features alone. In practice, adding a node feature kernel to the message passing of perturbed graphs results in a significant improvement of the GCN's performance, thereby rendering it more robust to graph perturbations. Our code is publicly available at:https://github.com/ChangminWu/RobustGCN.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 50 references that are in the map. First posted on arXiv 4 Sep 2021.

Builds on

29 of 50 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  7. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  8. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  9. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  10. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  11. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  12. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
17 more
  1. 2020Simple and Deep Graph Convolutional Networkscited by 857
  2. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  3. 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
  4. 2019Provably Powerful Graph Networkscited by 385
  5. 2020Graph Structure Learning for Robust Graph Neural Networkscited by 368
  6. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 332
  7. 2019Adversarial Attacks on Graph Neural Networks via Meta Learningcited by 261
  8. 2020Graph Neural Networks with Heterophilycited by 202
  9. 2020GNNGuard: Defending Graph Neural Networks against Adversarial Attackscited by 195
  10. 2018Adversarial Attack and Defense on Graph Data: A Surveycited by 166
  11. 2017A Random Matrix Approach to Neural Networkscited by 80
  12. 2020Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networkscited by 76
  13. 2019Coloring graph neural networks for node disambiguationcited by 49
  14. 2020Graph Neural Networks: Taxonomy, Advances and Trendscited by 48
  15. 2020Random Matrix Theory Proves that Deep Learning Representations of GAN-data Behave as Gaussian Mixturescited by 47
  16. 2020Reliable Graph Neural Networks via Robust Aggregationcited by 43
  17. 2019Power up! Robust Graph Convolutional Network via Graph Poweringcited by 15

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 2; 2024: 2.

5 papers.