Demystifying Graph Convolution with a Simple Concatenation
Not on the map. Why?
Abstract (arXiv)
Graph convolution (GConv) is a widely used technique that has been demonstrated to be extremely effective for graph learning applications, most notably node categorization. On the other hand, many GConv-based models do not quantify the effect of graph topology and node features on performance, and are even surpassed by some models that do not consider graph structure or node properties. We quantify the information overlap between graph topology, node features, and labels in order to determine graph convolution's representation power in the node classification task. In this work, we first determine the linear separability of graph convoluted features using analysis of variance. Mutual information is used to acquire a better understanding of the possible non-linear relationship between graph topology, node features, and labels. Our theoretical analysis demonstrates that a simple and efficient graph operation that concatenates only graph topology and node properties consistently outperforms conventional graph convolution, especially in the heterophily case. Extensive empirical research utilizing a synthetic dataset and real-world benchmarks demonstrates that graph concatenation is a simple but more flexible alternative to graph convolution.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 18 Jul 2022.
Builds on
29 of 40 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
17 more
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2018Deep Learning on Graphs: A Surveycited by 393
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
- 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2020XGNN: Towards Model-Level Explanations of Graph Neural Networkscited by 211
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
- 2019Explainability Techniques for Graph Convolutional Networkscited by 160
- 2020Towards Deeper Graph Neural Networks with Differentiable Group Normalizationcited by 113
- 2020Tackling Over-Smoothing for General Graph Convolutional Networkscited by 66
- 2020Revisiting Over-smoothing in Deep GCNscited by 55
Built on by
Not cited yet.