mlsanityData to 7 Oct 2026

Alleviating neighbor bias: augmenting graph self-supervise learning with structural equivalent positive samples

arXiv 2212.04365 ↗First posted 8 Dec 2022cs.LG cs.AI cs.NIcited by 1

Not on the map. Why?

Abstract (arXiv)

In recent years, using a self-supervised learning framework to learn the general characteristics of graphs has been considered a promising paradigm for graph representation learning. The core of self-supervised learning strategies for graph neural networks lies in constructing suitable positive sample selection strategies. However, existing GNNs typically aggregate information from neighboring nodes to update node representations, leading to an over-reliance on neighboring positive samples, i.e., homophilous samples; while ignoring long-range positive samples, i.e., positive samples that are far apart on the graph but structurally equivalent samples, a problem we call "neighbor bias." This neighbor bias can reduce the generalization performance of GNNs. In this paper, we argue that the generalization properties of GNNs should be determined by combining homogeneous samples and structurally equivalent samples, which we call the "GC combination hypothesis." Therefore, we propose a topological signal-driven self-supervised method. It uses a topological information-guided structural equivalence sampling strategy. First, we extract multiscale topological features using persistent homology. Then we compute the structural equivalence of node pairs based on their topological features. In particular, we design a topological loss function to pull in non-neighboring node pairs with high structural equivalence in the representation space to alleviate neighbor bias. Finally, we use the joint training mechanism to adjust the effect of structural equivalence on the model to fit datasets with different characteristics. We conducted experiments on the node classification task across seven graph datasets. The results show that the model performance can be effectively improved using a strategy of topological signal enhancement.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 8 Dec 2022.

Builds on

24 of 38 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  7. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  9. 2019Contrastive Multiview Codingcited by 1,297
  10. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  11. 2018Deep Graph Infomaxcited by 1,101
  12. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
12 more
  1. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  2. 2014Distributed Representations of Sentences and Documentscited by 677
  3. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  4. 2020Deep Graph Contrastive Representation Learningcited by 535
  5. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  6. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  7. 2019Revisiting Self-Supervised Visual Representation Learningcited by 250
  8. 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 235
  9. 2020Self-supervised Learning on Graphs: Deep Insights and New Directioncited by 108
  10. 2015Ricci Curvature of the Internet Topologycited by 22
  11. 2021Powerful Graph Convolutioal Networks with Adaptive Propagation Mechanism for Homophily and Heterophilycited by 14
  12. 2021Persistent Homology and Graphs Representation Learningcited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.