GIPA: A General Information Propagation Algorithm for Graph Learning
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) have been widely used in graph-structured data computation, showing promising performance in various applications such as node classification, link prediction, and network recommendation. Existing works mainly focus on node-wise correlation when doing weighted aggregation of neighboring nodes based on attention, such as dot product by the dense vectors of two nodes. This may cause conflicting noise in nodes to be propagated when doing information propagation. To solve this problem, we propose a General Information Propagation Algorithm (GIPA in short), which exploits more fine-grained information fusion including bit-wise and feature-wise correlations based on edge features in their propagation. Specifically, the bit-wise correlation calculates the element-wise attention weight through a multi-layer perceptron (MLP) based on the dense representations of two nodes and their edge; The feature-wise correlation is based on the one-hot representations of node attribute features for feature selection. We evaluate the performance of GIPA on the Open Graph Benchmark proteins (OGBN-proteins for short) dataset and the Alipay dataset of Alibaba. Experimental results reveal that GIPA outperforms the state-of-the-art models in terms of prediction accuracy, e.g., GIPA achieves an average ROC-AUC of 0.8901± 0.0011, which is better than that of all the existing methods listed in the OGBN-proteins leaderboard.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 19 Jan 2023.
Builds on
35 of 47 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
23 more
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2019Heterogeneous Graph Attention Networkcited by 734
- 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 584
- 2020Heterogeneous Graph Transformercited by 582
- 2019Graph Transformer Networkscited by 523
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2020DeeperGCN: All You Need to Train Deeper GCNscited by 250
- 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 242
- 2018Adaptive Sampling Towards Fast Graph Representation Learningcited by 180
- 2019Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networkscited by 177
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2016Discriminative Embeddings of Latent Variable Models for Structured Datacited by 131
- 2017DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understandingcited by 71
- 2018GeniePath: Graph Neural Networks with Adaptive Receptive Pathscited by 66
- 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
- 2017Attributed Social Network Embeddingcited by 34
- 2021GraphTheta: A Distributed Graph Neural Network Learning System With Flexible Training Strategycited by 8
Built on by
Not cited yet.