Position-Sensing Graph Neural Networks: Proactively Learning Nodes Relative Positions
Not on the map. Why?
Abstract (arXiv)
Most existing graph neural networks (GNNs) learn node embeddings using the framework of message passing and aggregation. Such GNNs are incapable of learning relative positions between graph nodes within a graph. To empower GNNs with the awareness of node positions, some nodes are set as anchors. Then, using the distances from a node to the anchors, GNNs can infer relative positions between nodes. However, P-GNNs arbitrarily select anchors, leading to compromising position-awareness and feature extraction. To eliminate this compromise, we demonstrate that selecting evenly distributed and asymmetric anchors is essential. On the other hand, we show that choosing anchors that can aggregate embeddings of all the nodes within a graph is NP-complete. Therefore, devising efficient optimal algorithms in a deterministic approach is practically not feasible. To ensure position-awareness and bypass NP-completeness, we propose Position-Sensing Graph Neural Networks (PSGNNs), learning how to choose anchors in a back-propagatable fashion. Experiments verify the effectiveness of PSGNNs against state-of-the-art GNNs, substantially improving performance on various synthetic and real-world graph datasets while enjoying stable scalability. Specifically, PSGNNs on average boost AUC more than 14% for pairwise node classification and 18% for link prediction over the existing state-of-the-art position-aware methods. Our source code is publicly available at: https://github.com/ZhenyueQin/PSGNN.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 24 May 2021.
Builds on
22 of 44 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2018Link Prediction Based on Graph Neural Networkscited by 832
10 more
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 545
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2020DeeperGCN: All You Need to Train Deeper GCNscited by 250
- 2019Position-aware Graph Neural Networkscited by 203
- 2019Graph Wavelet Neural Networkcited by 131
- 2019A Gentle Introduction to Deep Learning for Graphscited by 108
- 2019Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimatorcited by 25
- 2018Contextual Graph Markov Model: A Deep and Generative Approach to Graph Processingcited by 13
- 2018Graph Laplacian mixture modelcited by 8
Built on by
Not cited yet.