mlsanityData to 7 Oct 2026

Demystifying Graph Convolution with a Simple Concatenation

arXiv 2207.12931 ↗First posted 18 Jul 2022cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph convolution (GConv) is a widely used technique that has been demonstrated to be extremely effective for graph learning applications, most notably node categorization. On the other hand, many GConv-based models do not quantify the effect of graph topology and node features on performance, and are even surpassed by some models that do not consider graph structure or node properties. We quantify the information overlap between graph topology, node features, and labels in order to determine graph convolution's representation power in the node classification task. In this work, we first determine the linear separability of graph convoluted features using analysis of variance. Mutual information is used to acquire a better understanding of the possible non-linear relationship between graph topology, node features, and labels. Our theoretical analysis demonstrates that a simple and efficient graph operation that concatenates only graph topology and node properties consistently outperforms conventional graph convolution, especially in the heterophily case. Extensive empirical research utilizing a synthetic dataset and real-world benchmarks demonstrates that graph concatenation is a simple but more flexible alternative to graph convolution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 18 Jul 2022.

Builds on

29 of 40 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  6. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  7. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  8. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  9. 2019Simplifying Graph Convolutional Networkscited by 1,470
  10. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  11. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  12. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
17 more
  1. 2020Simple and Deep Graph Convolutional Networkscited by 857
  2. 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
  3. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
  4. 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
  5. 2020Parameterized Explainer for Graph Neural Networkcited by 423
  6. 2018Deep Learning on Graphs: A Surveycited by 393
  7. 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
  8. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
  9. 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
  10. 2020Towards Deeper Graph Neural Networkscited by 296
  11. 2020XGNN: Towards Model-Level Explanations of Graph Neural Networkscited by 211
  12. 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
  13. 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
  14. 2019Explainability Techniques for Graph Convolutional Networkscited by 160
  15. 2020Towards Deeper Graph Neural Networks with Differentiable Group Normalizationcited by 113
  16. 2020Tackling Over-Smoothing for General Graph Convolutional Networkscited by 66
  17. 2020Revisiting Over-smoothing in Deep GCNscited by 55

Built on by

Not cited yet.