Understanding Community Bias Amplification in Graph Representation Learning
Not on the map. Why?
Abstract (arXiv)
In this work, we discover a phenomenon of community bias amplification in graph representation learning, which refers to the exacerbation of performance bias between different classes by graph representation learning. We conduct an in-depth theoretical study of this phenomenon from a novel spectral perspective. Our analysis suggests that structural bias between communities results in varying local convergence speeds for node embeddings. This phenomenon leads to bias amplification in the classification results of downstream tasks. Based on the theoretical insights, we propose random graph coarsening, which is proved to be effective in dealing with the above issue. Finally, we propose a novel graph contrastive learning model called Random Graph Coarsening Contrastive Learning (RGCCL), which utilizes random coarsening as data augmentation and mitigates community bias by contrasting the coarsened graph with the original graph. Extensive experiments on various datasets demonstrate the advantage of our method when dealing with community bias amplification.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 43 references that are in the map. First posted on arXiv 8 Dec 2023.
Builds on
35 of 43 references.
References · 35
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2018Deep Graph Infomaxcited by 1,106
- 2018MINE: Mutual Information Neural Estimationcited by 683
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
- 2020Contrastive Multi-View Representation Learning on Graphscited by 652
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
23 more
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2020Generalization and Representational Limits of Graph Neural Networkscited by 218
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Graph Condensation for Graph Neural Networkscited by 150
- 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 141
- 2021Towards the Generalization of Contrastive Self-Supervised Learningcited by 99
- 2021EDITS: Modeling and Mitigating Data Bias for Graph Neural Networkscited by 92
- 2021Scaling Up Graph Neural Networks Via Graph Coarseningcited by 80
- 2022Fairness in Graph Mining: A Surveycited by 76
- 2021Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalizationcited by 70
- 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 69
- 2019GraphZoom: A multi-level spectral approach for accurate and scalable graph embeddingcited by 58
- 2020Minimal Variance Sampling with Provable Guarantees for Fast Training of Graph Neural Networkscited by 54
- 2022A Non-Asymptotic Analysis of Oversmoothing in Graph Neural Networkscited by 49
- 2018Graph Coarsening with Preserved Spectral Propertiescited by 41
- 2022TAM: Topology-Aware Margin Loss for Class-Imbalanced Node Classificationcited by 41
- 2021Graph Communal Contrastive Learningcited by 34
- 2022Uncovering the Structural Fairness in Graph Contrastive Learningcited by 29
- 2023On Generalized Degree Fairness in Graph Neural Networkscited by 28
- 2022RawlsGCN: Towards Rawlsian Difference Principle on Graph Convolutional Networkcited by 27
- 2020Faster Graph Embeddings via Coarseningcited by 15
- 2020SCE: Scalable Network Embedding from Sparsest Cutcited by 12
- 2018Spectral Subspace Sparsificationcited by 3
Built on by
Not cited yet.