Advancing Graph Few-Shot Learning via In-Context Learning
Not on the map. Why?
Abstract (arXiv)
Graph few-shot learning, which aims to classify nodes from novel classes with only a few labeled examples, is a widely studied problem in graph learning. However, existing methods often face two key limitations. First, the predominant graph few-shot learning paradigm relies on supervised tasks, failing to leverage the vast number of unlabeled nodes in the graph. Second, many approaches require complex task adaptation or fine-tuning during inference, limiting their efficiency and applicability. Inspired by the powerful in-context learning capabilities of large language models, we propose a novel model named VISION for adVancIng graph few-Shot learning via In-cOntext LearNing to address these challenges. Our model reframes graph few-shot learning as a fine-tuning-free sequence reasoning problem. At its core is a context-aware network that initializes nodes with role embeddings and employs a dual-context fusion module to synergistically integrate local topological structures and global task-level dependencies. This allows our model to dynamically generate class-aware representations for the query set conditioned on the support set context in a single forward pass. To effectively train our model, we introduce an unsupervised task generator that creates structure-adaptive features and constructs diverse pseudo-tasks from abundant unlabeled data. Our method unifies unsupervised meta-learning with graph in-context learning, achieving efficient inference. Extensive experiments on multiple benchmark datasets demonstrate the superiority of our model. Our public code can be found
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 56 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
41 of 56 references.
References · 41
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
29 more
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2022A Survey on In-context Learningcited by 721
- 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
- 2022Data Distributional Properties Drive Emergent In-Context Learning in Transformerscited by 309
- 2022Visual Prompting via Image Inpaintingcited by 250
- 2015Deep Convolutional Networks on Graph-Structured Datacited by 246
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
- 2022General-Purpose In-Context Learning by Meta-Learning Transformerscited by 105
- 2023PRODIGY: Enabling In-context Learning Over Graphscited by 98
- 2023UniverSeg: Universal Medical Image Segmentationcited by 91
- 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
- 2020Graph Meta Learning via Local Subgraphscited by 89
- 2023The Transient Nature of Emergent In-Context Learning in Transformerscited by 76
- 2018Unsupervised Meta-Learning For Few-Shot Image Classificationcited by 75
- 2023Virtual Node Tuning for Few-shot Node Classificationcited by 46
- 2022Task-Adaptive Few-shot Node Classificationcited by 43
- 2022Graph Few-shot Learning with Task-specific Structurescited by 26
- 2022Transductive Linear Probing: A Novel Framework for Few-Shot Node Classificationcited by 24
- 2023Few-shot Node Classification with Extremely Weak Supervisioncited by 14
- 2023Contrastive Meta-Learning for Few-shot Node Classificationcited by 11
- 2023Task-Equivariant Graph Few-shot Learningcited by 8
- 2024Meta-GPS++: Enhancing Graph Meta-Learning with Contrastive Learning and Self-Trainingcited by 7
- 2025Dual-level Mixup for Graph Few-shot Learning with Fewer Taskscited by 5
- 2025Graph Few-Shot Learning via Adaptive Spectrum Experts and Cross-Set Distribution Calibrationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Training Graph Foundation Models on The Web Graphcited by 0
- 2026Training Graph Foundation Models on The Web Graph25 Sep 2026