A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learning
Not on the map. Why?
Abstract (arXiv)
Graph representation learning, a critical step in graph-centric tasks, has seen significant advancements. Earlier techniques often operate in an end-to-end setting, which heavily rely on the availability of ample labeled data. This constraint has spurred the emergence of few-shot learning on graphs, where only a few labels are available for each task. Given the extensive literature in this field, this survey endeavors to synthesize recent developments, provide comparative insights, and identify future directions. We systematically categorize existing studies based on two major taxonomies: (1) Problem taxonomy, which explores different types of data scarcity problems and their applications, and (2) Technique taxonomy, which details key strategies for addressing these data-scarce few-shot problems. The techniques can be broadly categorized into meta-learning, pre-training, and hybrid approaches, with a finer-grained classification in each category to aid readers in their method selection process. Within each category, we analyze the relationships among these methods and compare their strengths and limitations. Finally, we outline prospective directions for few-shot learning on graphs to catalyze continued innovation in this field. The website for this survey can be accessed by urlhttps://github.com/smufang/fewshotgraph.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 132 of its 190 references that are in the map. First posted on arXiv 2 Feb 2024.
Builds on
132 of 190 references.
References · 132
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
38 more
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2019Graph Transformer Networkscited by 520
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2021Deep Long-Tailed Learning: A Surveycited by 416
- 2017Few-Shot Learning with Graph Neural Networkscited by 324
- 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
- 2021Graph Contrastive Learning Automatedcited by 287
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
- 2017A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applicationscited by 260
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
- 2023Language is All a Graph Needscited by 219
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
- 2021Spherical Message Passing for 3D Graph Networkscited by 166
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2022Protein Representation Learning by Geometric Structure Pretrainingcited by 161
50 most cited of 132 All 132 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2024RAGraph: A General Retrieval-Augmented Graph Learning Frameworkcited by 24
- 2025Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigationcited by 11
- 2025H4G: Unlocking Faithful Inference for Zero-Shot Graph Learning in Hyperbolic Spacecited by 1
- 2025Parameter-Free Hypergraph Neural Network for Few-Shot Node Classificationcited by 1
- 2026CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoningcited by 0
- 2026CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning8 May 2026
- 2025Parameter-Free Hypergraph Neural Network for Few-Shot Node Classification24 Oct 2025
- 2025H4G: Unlocking Faithful Inference for Zero-Shot Graph Learning in Hyperbolic Space14 Oct 2025
- 2025Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigation26 Feb 2025
- 2024RAGraph: A General Retrieval-Augmented Graph Learning Framework31 Oct 2024