mlsanityData to 14 Oct 2026

Contrastive Meta-Learning for Few-shot Node Classification

arXiv 2306.15154 ↗First posted 27 Jun 2023cs.LG cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Few-shot node classification, which aims to predict labels for nodes on graphs with only limited labeled nodes as references, is of great significance in real-world graph mining tasks. Particularly, in this paper, we refer to the task of classifying nodes in classes with a few labeled nodes as the few-shot node classification problem. To tackle such a label shortage issue, existing works generally leverage the meta-learning framework, which utilizes a number of episodes to extract transferable knowledge from classes with abundant labeled nodes and generalizes the knowledge to other classes with limited labeled nodes. In essence, the primary aim of few-shot node classification is to learn node embeddings that are generalizable across different classes. To accomplish this, the GNN encoder must be able to distinguish node embeddings between different classes, while also aligning embeddings for nodes in the same class. Thus, in this work, we propose to consider both the intra-class and inter-class generalizability of the model. We create a novel contrastive meta-learning framework on graphs, named COSMIC, with two key designs. First, we propose to enhance the intra-class generalizability by involving a contrastive two-step optimization in each episode to explicitly align node embeddings in the same classes. Second, we strengthen the inter-class generalizability by generating hard node classes via a novel similarity-sensitive mix-up strategy. Extensive experiments on few-shot node classification datasets verify the superiority of our framework over state-of-the-art baselines. Our code is provided at https://github.com/SongW-SW/COSMIC.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 43 of its 64 references that are in the map. First posted on arXiv 27 Jun 2023.

Builds on

43 of 64 references.

References · 43

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  7. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  8. 2018How Powerful are Graph Neural Networks?cited by 4,393
  9. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  10. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  11. 2020Supervised Contrastive Learningcited by 2,829
  12. 2016Matching Networks for One Shot Learningcited by 2,255
31 more
  1. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  2. 2019Simplifying Graph Convolutional Networkscited by 1,477
  3. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  4. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
  5. 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
  6. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  7. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
  8. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
  9. 2020Deep Graph Contrastive Representation Learningcited by 539
  10. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  11. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
  12. 2020Graph-Bert: Only Attention is Needed for Learning Graph Representationscited by 177
  13. 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 164
  14. 2018MixUp as Locally Linear Out-Of-Manifold Regularizationcited by 158
  15. 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 146
  16. 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
  17. 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
  18. 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
  19. 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
  20. 2020Graph Meta Learning via Local Subgraphscited by 89
  21. 2021Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training Datacited by 87
  22. 2018One-Shot Relational Learning for Knowledge Graphscited by 78
  23. 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
  24. 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
  25. 2022Task-Adaptive Few-shot Node Classificationcited by 43
  26. 2021Graph Few-shot Class-incremental Learningcited by 41
  27. 2022Graph Few-shot Learning with Task-specific Structurescited by 26
  28. 2022Transductive Linear Probing: A Novel Framework for Few-Shot Node Classificationcited by 24
  29. 2022FAITH: Few-Shot Graph Classification with Hierarchical Task Graphscited by 22
  30. 2020Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network Embeddingcited by 19
  31. 2023Few-shot Node Classification with Extremely Weak Supervisioncited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 6; 2026: 2.

11 papers.