mlsanityData to 7 Oct 2026

A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learning

arXiv 2402.01440 ↗First posted 2 Feb 2024cs.LG cs.AI cs.SIcited by 5

Not on the map. Why?

Abstract (arXiv)

Graph representation learning, a critical step in graph-centric tasks, has seen significant advancements. Earlier techniques often operate in an end-to-end setting, which heavily rely on the availability of ample labeled data. This constraint has spurred the emergence of few-shot learning on graphs, where only a few labels are available for each task. Given the extensive literature in this field, this survey endeavors to synthesize recent developments, provide comparative insights, and identify future directions. We systematically categorize existing studies based on two major taxonomies: (1) Problem taxonomy, which explores different types of data scarcity problems and their applications, and (2) Technique taxonomy, which details key strategies for addressing these data-scarce few-shot problems. The techniques can be broadly categorized into meta-learning, pre-training, and hybrid approaches, with a finer-grained classification in each category to aid readers in their method selection process. Within each category, we analyze the relationships among these methods and compare their strengths and limitations. Finally, we outline prospective directions for few-shot learning on graphs to catalyze continued innovation in this field. The website for this survey can be accessed by urlhttps://github.com/smufang/fewshotgraph.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 132 of its 190 references that are in the map. First posted on arXiv 2 Feb 2024.

Builds on

132 of 190 references.

References · 132

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  6. 2017Graph Attention Networkscited by 8,854
  7. 2017Inductive Representation Learning on Large Graphscited by 6,284
  8. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  9. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  10. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  11. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  12. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
38 more
  1. 2016Matching Networks for One Shot Learningcited by 2,246
  2. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  3. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  4. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  5. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  6. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  7. 2016Variational Graph Auto-Encoderscited by 1,373
  8. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  9. 2018Deep Graph Infomaxcited by 1,101
  10. 2018Link Prediction Based on Graph Neural Networkscited by 829
  11. 2019Heterogeneous Graph Attention Networkcited by 732
  12. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  13. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  14. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  15. 2015LINE: Large-scale Information Network Embeddingcited by 582
  16. 2020Deep Graph Contrastive Representation Learningcited by 535
  17. 2019Graph Transformer Networkscited by 520
  18. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  19. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  20. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  21. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  22. 2021Deep Long-Tailed Learning: A Surveycited by 416
  23. 2017Few-Shot Learning with Graph Neural Networkscited by 324
  24. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
  25. 2021Graph Contrastive Learning Automatedcited by 287
  26. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  27. 2017A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applicationscited by 260
  28. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  29. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  30. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
  31. 2023Language is All a Graph Needscited by 219
  32. 2022Pure Transformers are Powerful Graph Learnerscited by 188
  33. 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
  34. 2021Spherical Message Passing for 3D Graph Networkscited by 166
  35. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
  36. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
  37. 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
  38. 2022Protein Representation Learning by Geometric Structure Pretrainingcited by 161

50 most cited of 132 All 132 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.