mlsanityData to 14 Oct 2026

GIPA: A General Information Propagation Algorithm for Graph Learning

arXiv 2301.08209 ↗First posted 19 Jan 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph neural networks (GNNs) have been widely used in graph-structured data computation, showing promising performance in various applications such as node classification, link prediction, and network recommendation. Existing works mainly focus on node-wise correlation when doing weighted aggregation of neighboring nodes based on attention, such as dot product by the dense vectors of two nodes. This may cause conflicting noise in nodes to be propagated when doing information propagation. To solve this problem, we propose a General Information Propagation Algorithm (GIPA in short), which exploits more fine-grained information fusion including bit-wise and feature-wise correlations based on edge features in their propagation. Specifically, the bit-wise correlation calculates the element-wise attention weight through a multi-layer perceptron (MLP) based on the dense representations of two nodes and their edge; The feature-wise correlation is based on the one-hot representations of node attribute features for feature selection. We evaluate the performance of GIPA on the Open Graph Benchmark proteins (OGBN-proteins for short) dataset and the Alipay dataset of Alibaba. Experimental results reveal that GIPA outperforms the state-of-the-art models in terms of prediction accuracy, e.g., GIPA achieves an average ROC-AUC of 0.8901± 0.0011, which is better than that of all the existing methods listed in the OGBN-proteins leaderboard.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 19 Jan 2023.

Builds on

35 of 47 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  9. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  10. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  11. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  12. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
23 more
  1. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  2. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  3. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
  4. 2020Simple and Deep Graph Convolutional Networkscited by 860
  5. 2016Wide & Deep Learning for Recommender Systemscited by 747
  6. 2019Heterogeneous Graph Attention Networkcited by 734
  7. 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 584
  8. 2020Heterogeneous Graph Transformercited by 582
  9. 2019Graph Transformer Networkscited by 523
  10. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  11. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
  12. 2020Towards Deeper Graph Neural Networkscited by 296
  13. 2020DeeperGCN: All You Need to Train Deeper GCNscited by 250
  14. 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 242
  15. 2018Adaptive Sampling Towards Fast Graph Representation Learningcited by 180
  16. 2019Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networkscited by 177
  17. 2021Training Graph Neural Networks with 1000 Layerscited by 169
  18. 2016Discriminative Embeddings of Latent Variable Models for Structured Datacited by 131
  19. 2017DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understandingcited by 71
  20. 2018GeniePath: Graph Neural Networks with Adaptive Receptive Pathscited by 66
  21. 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
  22. 2017Attributed Social Network Embeddingcited by 34
  23. 2021GraphTheta: A Distributed Graph Neural Network Learning System With Flexible Training Strategycited by 8

Built on by

Not cited yet.