Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labels
Not on the map. Why?
Abstract (arXiv)
Graph Convolutional Networks(GCNs) play a crucial role in graph learning tasks, however, learning graph embedding with few supervised signals is still a difficult problem. In this paper, we propose a novel training algorithm for Graph Convolutional Network, called Multi-Stage Self-Supervised(M3S) Training Algorithm, combined with self-supervised learning approach, focusing on improving the generalization performance of GCNs on graphs with few labeled nodes. Firstly, a Multi-Stage Training Framework is provided as the basis of M3S training method. Then we leverage DeepCluster technique, a popular form of self-supervised learning, and design corresponding aligning mechanism on the embedding space to refine the Multi-Stage Training Framework, resulting in M3S Training Algorithm. Finally, extensive experimental results verify the superior performance of our algorithm on graphs with few labeled nodes under different label rates compared with other state-of-the-art approaches.
Key facts. Cited by 111 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 31; 2023: 19; 2024: 18; 2025: 11; 2026: 4.
111 papers.
Sort:
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
- 2022How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervisioncited by 102
- 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 91
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
- 2022Graph Attention Multi-Layer Perceptroncited by 82
- 2021Towards Self-Explainable Graph Neural Networkcited by 75
- 2022Simple and Efficient Heterogeneous Graph Neural Networkcited by 71
- 2021Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Frameworkcited by 69
- 2021MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graphcited by 65
38 more
- 2022Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labelscited by 63
- 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
- 2021Molecular Contrastive Learning with Chemical Element Knowledge Graphcited by 50
- 2023GSLB: The Graph Structure Learning Benchmarkcited by 49
- 2022Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution Shiftcited by 38
- 2021FedGL: Federated Graph Learning Framework with Global Self-Supervisioncited by 34
- 2021Adaptive Transfer Learning on Graph Neural Networkscited by 31
- 2022Self-supervised Heterogeneous Graph Pre-training Based on Structural Clusteringcited by 30
- 2022DropMessage: Unifying Random Dropping for Graph Neural Networkscited by 29
- 2023Learning on Graphs with Out-of-Distribution Nodescited by 29
- 2022Bringing Your Own View: Graph Contrastive Learning without Prefabricated Data Augmentationscited by 28
- 2021Self-supervised Graph Neural Networks without explicit negative samplingcited by 25
- 2021Meta Propagation Networks for Graph Few-shot Semi-supervised Learningcited by 25
- 2023Learning Strong Graph Neural Networks with Weak Informationcited by 25
- 2022CLNode: Curriculum Learning for Node Classificationcited by 24
- 2023Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed Graphscited by 23
- 2022Modularity-Aware Graph Autoencoders for Joint Community Detection and Link Predictioncited by 22
- 2023Data-centric Graph Learning: A Surveycited by 22
- 2022CGC: Contrastive Graph Clustering for Community Detection and Trackingcited by 21
- 2024Uncertainty in Graph Neural Networks: A Surveycited by 20
- 2021X-GOAL: Multiplex Heterogeneous Graph Prototypical Contrastive Learningcited by 19
- 2022Informative Pseudo-Labeling for Graph Neural Networks with Few Labelscited by 19
- 2021ROD: Reception-aware Online Distillation for Sparse Graphscited by 18
- 2021Label-Wise Graph Convolutional Network for Heterophilic Graphscited by 17
- 2022Structure-Preserving Graph Representation Learningcited by 17
- 2023When to Pre-Train Graph Neural Networks? From Data Generation Perspective!cited by 17
- 2021Graph Neural Networks: Methods, Applications, and Opportunitiescited by 16
- 2022Defending Graph Convolutional Networks against Dynamic Graph Perturbations via Bayesian Self-supervisioncited by 16
- 2021GraphHop: An Enhanced Label Propagation Method for Node Classificationcited by 15
- 2021Self-supervised Consensus Representation Learning for Attributed Graphcited by 15
- 2022Semi-Supervised Hierarchical Graph Classificationcited by 15
- 2023Towards Data-centric Graph Machine Learning: Review and Outlookcited by 15
- 2022Learnable Graph Convolutional Network and Feature Fusion for Multi-view Learningcited by 13
- 2021CogDL: A Comprehensive Library for Graph Deep Learningcited by 12
- 2022Label-Enhanced Graph Neural Network for Semi-supervised Node Classificationcited by 11
- 2022Toward Robust Graph Semi-Supervised Learning against Extreme Data Scarcitycited by 11
- 2023Deep Insights into Noisy Pseudo Labeling on Graph Datacited by 11
- 2021SCR: Training Graph Neural Networks with Consistency Regularizationcited by 10
50 most cited of 111 All 111 (JSON)
- 2026ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation30 Aug 2026
- 2026Beyond the Golden Teacher: Enhancing Graph Learning through LLM-GNN Co-teaching10 Jun 2026
- 2026A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis2 May 2026
- 2026GNN-as-Judge: Unleashing the Power of LLMs for Graph Learning with GNN Feedback11 Mar 2026
- 2025Rethinking Semi-Supervised Node Classification with Self-Supervised Graph Clustering25 Nov 2025
- 2025Learning Noise-Resilient and Transferable Graph-Text Alignment via Dynamic Quality Assessment22 Oct 2025
- 2025CRoC: Context Refactoring Contrast for Graph Anomaly Detection with Limited Supervision17 Aug 2025
- 2025FreeGAD: A Training-Free yet Effective Approach for Graph Anomaly Detection14 Aug 2025
- 2025Differentiated Information Mining: A Semi-supervised Learning Framework for GNNs12 Aug 2025
- 2025Graph Prompting for Graph Learning Models: Recent Advances and Future Directions10 Jun 2025
- 2025Weak Supervision for Real World Graphs3 Jun 2025
- 2025PTCL: Pseudo-Label Temporal Curriculum Learning for Label-Limited Dynamic Graph24 Apr 2025
38 more
- 2025Adapt, Agree, Aggregate: Semi-Supervised Ensemble Labeling for Graph Convolutional Networks22 Mar 2025
- 2025IceBerg: Debiased Self-Training for Class-Imbalanced Node Classification10 Feb 2025
- 2025UPL: Uncertainty-aware Pseudo-labeling for Imbalance Transductive Node Classification2 Feb 2025
- 2024Automatic Self-supervised Learning for Social Recommendations25 Dec 2024
- 2024AnomalyAID: Reliable Interpretation for Semi-supervised Network Anomaly Detection18 Nov 2024
- 2024Variational Graph Contrastive Learning11 Nov 2024
- 2024Enhancing the Influence of Labels on Unlabeled Nodes in Graph Convolutional Networks4 Nov 2024
- 2024BANGS: Game-Theoretic Node Selection for Graph Self-Training12 Oct 2024
- 2024Enhancing Graph Self-Supervised Learning with Graph Interplay5 Oct 2024
- 2024LAMP: Learnable Meta-Path Guided Adversarial Contrastive Learning for Heterogeneous Graphs10 Sep 2024
- 2024HC-GST: Heterophily-aware Distribution Consistency based Graph Self-training25 Jul 2024
- 2024SpreadFGL: Edge-Client Collaborative Federated Graph Learning with Adaptive Neighbor Generation14 Jul 2024
- 2024Structure-Aware Consensus Network on Graphs with Few Labeled Nodes2 Jul 2024
- 2024Cross-Modality Program Representation Learning for Electronic Design Automation with High-Level Synthesis13 Jun 2024
- 2024Exploring Correlations of Self-Supervised Tasks for Graphs7 May 2024
- 2024Multi-View Subgraph Neural Networks: Self-Supervised Learning with Scarce Labeled Data19 Apr 2024
- 2024A Survey on Self-Supervised Graph Foundation Models: Knowledge-Based Perspective24 Mar 2024
- 2024Open-World Semi-Supervised Learning for Node Classification18 Mar 2024
- 2024Uncertainty in Graph Neural Networks: A Survey11 Mar 2024
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretraining15 Feb 2024
- 2024Distribution Consistency based Self-Training for Graph Neural Networks with Sparse Labels18 Jan 2024
- 2023CueGCL: Cluster-aware Personalized Self-Training for Unsupervised Graph Contrastive Learning18 Nov 2023
- 2023Unleashing the potential of GNNs via Bi-directional Knowledge Transfer26 Oct 2023
- 2023Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed Graphs15 Oct 2023
- 2023GSLB: The Graph Structure Learning Benchmark8 Oct 2023
- 2023Data-centric Graph Learning: A Survey8 Oct 2023
- 2023Deep Insights into Noisy Pseudo Labeling on Graph Data2 Oct 2023
- 2023Towards Data-centric Graph Machine Learning: Review and Outlook20 Sep 2023
- 2023Graph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Tasks19 Sep 2023
- 2023Learning on Graphs with Out-of-Distribution Nodes13 Aug 2023
- 2023Long-range Meta-path Search on Large-scale Heterogeneous Graphs17 Jul 2023
- 2023Combating Confirmation Bias: A Unified Pseudo-Labeling Framework for Entity Alignment5 Jul 2023
- 2023Learning Strong Graph Neural Networks with Weak Information29 May 2023
- 2023ProgSG: Cross-Modality Representation Learning for Programs in Electronic Design Automation18 May 2023
- 2023Seq-HGNN: Learning Sequential Node Representation on Heterogeneous Graph18 May 2023
- 2023Meta-multigraph Search: Rethinking Meta-structure on Heterogeneous Information Networks23 Apr 2023
- 2023When to Pre-Train Graph Neural Networks? From Data Generation Perspective!29 Mar 2023
- 2023Pseudo Contrastive Learning for Graph-based Semi-supervised Learning19 Feb 2023
50 newest of 111 All 111 (JSON)
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
- 2022How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervisioncited by 102
- 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 91
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
- 2022Graph Attention Multi-Layer Perceptroncited by 82
- 2021Towards Self-Explainable Graph Neural Networkcited by 75
- 2022Simple and Efficient Heterogeneous Graph Neural Networkcited by 71
- 2021Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Frameworkcited by 69
- 2021MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graphcited by 65
12 most cited of 111 All 111 (JSON)
- 2026ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation30 Aug 2026
- 2026Beyond the Golden Teacher: Enhancing Graph Learning through LLM-GNN Co-teaching10 Jun 2026
- 2026A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis2 May 2026
- 2026GNN-as-Judge: Unleashing the Power of LLMs for Graph Learning with GNN Feedback11 Mar 2026
- 2025Rethinking Semi-Supervised Node Classification with Self-Supervised Graph Clustering25 Nov 2025
- 2025Learning Noise-Resilient and Transferable Graph-Text Alignment via Dynamic Quality Assessment22 Oct 2025
- 2025CRoC: Context Refactoring Contrast for Graph Anomaly Detection with Limited Supervision17 Aug 2025
- 2025FreeGAD: A Training-Free yet Effective Approach for Graph Anomaly Detection14 Aug 2025
- 2025Differentiated Information Mining: A Semi-supervised Learning Framework for GNNs12 Aug 2025
- 2025Graph Prompting for Graph Learning Models: Recent Advances and Future Directions10 Jun 2025
- 2025Weak Supervision for Real World Graphs3 Jun 2025
- 2025PTCL: Pseudo-Label Temporal Curriculum Learning for Label-Limited Dynamic Graph24 Apr 2025
12 newest of 111 All 111 (JSON)