VIGraph: Generative Self-supervised Learning for Class-Imbalanced Node Classification
Not on the map. Why?
Abstract (arXiv)
Class imbalance in graph data presents significant challenges for node classification. While existing methods, such as SMOTE-based approaches, partially mitigate this issue, they still exhibit limitations in constructing imbalanced graphs. Generative self-supervised learning (SSL) methods, exemplified by graph autoencoders (GAEs), offer a promising solution by directly generating minority nodes from the data itself, yet their potential remains underexplored. In this paper, we delve into the shortcomings of SMOTE-based approaches in the construction of imbalanced graphs. Furthermore, we introduce VIGraph, a simple yet effective generative SSL approach that relies on the Variational GAE as the fundamental model. VIGraph strictly adheres to the concept of imbalance when constructing imbalanced graphs and innovatively leverages the variational inference (VI) ability of Variational GAE to generate nodes for minority classes. VIGraph introduces comprehensive training strategies, including cross-view contrastive learning at the decoding phase to capture semantic knowledge, adjacency matrix reconstruction to preserve graph structure, and alignment strategy to ensure stable training. VIGraph can generate high-quality nodes directly usable for classification, eliminating the need to integrate the generated nodes back to the graph as well as additional retraining found in SMOTE-based methods. We conduct extensive experiments, results from which demonstrate the superiority and generality of our approach.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 42 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
30 of 42 references.
References · 30
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 513
18 more
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 364
- 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
- 2019Dice Loss for Data-imbalanced NLP Taskscited by 182
- 2021GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networkscited by 147
- 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
- 2018Gradient Harmonized Single-stage Detectorcited by 114
- 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
- 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
- 2021Topology-Imbalance Learning for Semi-Supervised Node Classificationcited by 56
- 2021ImGAGN:Imbalanced Network Embedding via Generative Adversarial Graph Networkscited by 51
- 2022Heterogeneous Graph Masked Autoencoderscited by 47
- 2022TAM: Topology-Aware Margin Loss for Class-Imbalanced Node Classificationcited by 41
- 2020A Survey on Graph Neural Networks for Knowledge Graph Completioncited by 26
- 2023Class-Imbalanced Learning on Graphs: A Surveycited by 24
- 2022ImGCL: Revisiting Graph Contrastive Learning on Imbalanced Node Classificationcited by 21
- 2021CCGG: A Deep Autoregressive Model for Class-Conditional Graph Generationcited by 4
Built on by
Not cited yet.