Contrastive Meta-Learning for Few-shot Node Classification
Not on the map. Why?
Abstract (arXiv)
Few-shot node classification, which aims to predict labels for nodes on graphs with only limited labeled nodes as references, is of great significance in real-world graph mining tasks. Particularly, in this paper, we refer to the task of classifying nodes in classes with a few labeled nodes as the few-shot node classification problem. To tackle such a label shortage issue, existing works generally leverage the meta-learning framework, which utilizes a number of episodes to extract transferable knowledge from classes with abundant labeled nodes and generalizes the knowledge to other classes with limited labeled nodes. In essence, the primary aim of few-shot node classification is to learn node embeddings that are generalizable across different classes. To accomplish this, the GNN encoder must be able to distinguish node embeddings between different classes, while also aligning embeddings for nodes in the same class. Thus, in this work, we propose to consider both the intra-class and inter-class generalizability of the model. We create a novel contrastive meta-learning framework on graphs, named COSMIC, with two key designs. First, we propose to enhance the intra-class generalizability by involving a contrastive two-step optimization in each episode to explicitly align node embeddings in the same classes. Second, we strengthen the inter-class generalizability by generating hard node classes via a novel similarity-sensitive mix-up strategy. Extensive experiments on few-shot node classification datasets verify the superiority of our framework over state-of-the-art baselines. Our code is provided at https://github.com/SongW-SW/COSMIC.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 43 of its 64 references that are in the map. First posted on arXiv 27 Jun 2023.
Builds on
43 of 64 references.
References · 43
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2020Supervised Contrastive Learningcited by 2,829
- 2016Matching Networks for One Shot Learningcited by 2,255
31 more
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
- 2020Contrastive Multi-View Representation Learning on Graphscited by 652
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
- 2020Graph-Bert: Only Attention is Needed for Learning Graph Representationscited by 177
- 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 164
- 2018MixUp as Locally Linear Out-Of-Manifold Regularizationcited by 158
- 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 146
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
- 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
- 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
- 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
- 2020Graph Meta Learning via Local Subgraphscited by 89
- 2021Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training Datacited by 87
- 2018One-Shot Relational Learning for Knowledge Graphscited by 78
- 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
- 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
- 2022Task-Adaptive Few-shot Node Classificationcited by 43
- 2021Graph Few-shot Class-incremental Learningcited by 41
- 2022Graph Few-shot Learning with Task-specific Structurescited by 26
- 2022Transductive Linear Probing: A Novel Framework for Few-Shot Node Classificationcited by 24
- 2022FAITH: Few-Shot Graph Classification with Hierarchical Task Graphscited by 22
- 2020Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network Embeddingcited by 19
- 2023Few-shot Node Classification with Extremely Weak Supervisioncited by 14
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 6; 2026: 2.
11 papers.
- 2023Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Interventioncited by 12
- 2024A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learningcited by 6
- 2025Enhancing Unsupervised Graph Few-shot Learning via Set Functions and Optimal Transportcited by 6
- 2025Dual-level Mixup for Graph Few-shot Learning with Fewer Taskscited by 5
- 2025Graph Few-Shot Learning via Adaptive Spectrum Experts and Cross-Set Distribution Calibrationcited by 3
- 2025Enhancing Distribution and Label Consistency for Graph Out-of-Distribution Generalizationcited by 2
- 2025Generative Risk Minimization for Out-of-Distribution Generalization on Graphscited by 2
- 2026Advancing Graph Few-Shot Learning via In-Context Learningcited by 1
- 2024Virtual Node Generation for Node Classification in Sparsely-Labeled Graphscited by 0
- 2025Constraint Multi-class Positive and Unlabeled Learning for Distantly Supervised Named Entity Recognitioncited by 0
- 2026Improving Graph Few-shot Learning with Hyperbolic Space and Denoising Diffusioncited by 0
- 2026Advancing Graph Few-Shot Learning via In-Context Learning23 May 2026
- 2026Improving Graph Few-shot Learning with Hyperbolic Space and Denoising Diffusion30 Apr 2026
- 2025Graph Few-Shot Learning via Adaptive Spectrum Experts and Cross-Set Distribution Calibration14 Oct 2025
- 2025Constraint Multi-class Positive and Unlabeled Learning for Distantly Supervised Named Entity Recognition7 Apr 2025
- 2025Dual-level Mixup for Graph Few-shot Learning with Fewer Tasks19 Feb 2025
- 2025Generative Risk Minimization for Out-of-Distribution Generalization on Graphs11 Feb 2025
- 2025Enhancing Unsupervised Graph Few-shot Learning via Set Functions and Optimal Transport10 Jan 2025
- 2025Enhancing Distribution and Label Consistency for Graph Out-of-Distribution Generalization7 Jan 2025
- 2024Virtual Node Generation for Node Classification in Sparsely-Labeled Graphs12 Sep 2024
- 2024A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learning2 Feb 2024
- 2023Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Intervention22 Dec 2023