mlsanityData to 7 Oct 2026

Improving Signed Propagation for Graph Neural Networks in Multi-Class Environments

arXiv 2301.08918 ↗First posted 21 Jan 2023cs.LG cs.SIcited by 2

Not on the map. Why?

Abstract (arXiv)

Message-passing Graph Neural Networks (GNNs), which collect information from adjacent nodes achieve dismal performance on heterophilic graphs. Various schemes have been proposed to solve this problem, and propagating signed information on heterophilic edges has gained great attention. Recently, some works provided theoretical analysis that signed propagation always leads to performance improvement under a binary class scenario. However, we notice that prior analyses do not align well with multi-class benchmark datasets. This paper provides a new understanding of signed propagation for multi-class scenarios and points out two drawbacks in terms of message-passing and parameter update: (1) Message-passing: if two nodes belong to different classes but have a high similarity, signed propagation can decrease the separability. (2) Parameter update: the prediction uncertainty (e.g., conflict evidence) of signed neighbors increases during training, which can impede the stability of the algorithm. Based on the observation, we introduce two novel strategies for improving signed propagation under multi-class graphs. The proposed scheme combines calibration to secure robustness while reducing uncertainty. We show the efficacy of our theorem through extensive experiments on six benchmark graph datasets.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 44 references that are in the map. First posted on arXiv 21 Jan 2023.

Builds on

23 of 44 references.

References · 23

  1. 2017Graph Attention Networkscited by 8,854
  2. 2017On Calibration of Modern Neural Networkscited by 4,860
  3. 2018How Powerful are Graph Neural Networks?cited by 4,355
  4. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  5. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  6. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  7. 2020Simple and Deep Graph Convolutional Networkscited by 857
  8. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  9. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
  10. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
  11. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
  12. 2020Graph Neural Networks with Heterophilycited by 202
11 more
  1. 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
  2. 2020Learning to Drop: Robust Graph Neural Network via Topological Denoisingcited by 127
  3. 2020Confidence-Aware Learning for Deep Neural Networkscited by 113
  4. 2020Uncertainty Aware Semi-Supervised Learning on Graph Datacited by 95
  5. 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 91
  6. 2021Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalizationcited by 70
  7. 2018GEMSEC: Graph Embedding with Self Clusteringcited by 61
  8. 2022GREAD: Graph Neural Reaction-Diffusion Networkscited by 54
  9. 2022Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution Shiftcited by 38
  10. 2020Rethinking Graph Regularization for Graph Neural Networkscited by 36
  11. 2022When Does A Spectral Graph Neural Network Fail in Node Classification?cited by 6

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.