Mitigating Degree Bias Adaptively with Hard-to-Learn Nodes in Graph Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) often suffer from degree bias in node classification tasks, where prediction performance varies across nodes with different degrees. Several approaches, which adopt Graph Contrastive Learning (GCL), have been proposed to mitigate this bias. However, the limited number of positive pairs and the equal weighting of all positives and negatives in GCL still lead to low-degree nodes acquiring insufficient and noisy information. This paper proposes the Hardness Adaptive Reweighted (HAR) contrastive loss to mitigate degree bias. It adds more positive pairs by leveraging node labels and adaptively weights positive and negative pairs based on their learning hardness. In addition, we develop an experimental framework named SHARP to extend HAR to a broader range of scenarios. Both our theoretical analysis and experiments validate the effectiveness of SHARP. The experimental results across four datasets show that SHARP achieves better performance against baselines at both global and degree levels.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
18 of 35 references.
References · 18
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2020Contrastive Learning with Hard Negative Samplescited by 628
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020Hard Negative Mixing for Contrastive Learningcited by 402
6 more
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
- 2020CoMatch: Semi-supervised Learning with Contrastive Graph Regularizationcited by 167
- 2022Uncovering the Structural Fairness in Graph Contrastive Learningcited by 29
- 2023Learning How to Propagate Messages in Graph Neural Networkscited by 23
- 2022ResNorm: Tackling Long-tailed Degree Distribution Issue in Graph Neural Networks via Normalizationcited by 15
- 2023Marginal Nodes Matter: Towards Structure Fairness in Graphscited by 2
Built on by
Not cited yet.