mlsanityData to 14 Oct 2026

Advancing Graph Few-Shot Learning via In-Context Learning

arXiv 2605.24410 ↗First posted 23 May 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Graph few-shot learning, which aims to classify nodes from novel classes with only a few labeled examples, is a widely studied problem in graph learning. However, existing methods often face two key limitations. First, the predominant graph few-shot learning paradigm relies on supervised tasks, failing to leverage the vast number of unlabeled nodes in the graph. Second, many approaches require complex task adaptation or fine-tuning during inference, limiting their efficiency and applicability. Inspired by the powerful in-context learning capabilities of large language models, we propose a novel model named VISION for adVancIng graph few-Shot learning via In-cOntext LearNing to address these challenges. Our model reframes graph few-shot learning as a fine-tuning-free sequence reasoning problem. At its core is a context-aware network that initializes nodes with role embeddings and employs a dual-context fusion module to synergistically integrate local topological structures and global task-level dependencies. This allows our model to dynamically generate class-aware representations for the query set conditioned on the support set context in a single forward pass. To effectively train our model, we introduce an unsupervised task generator that creates structure-adaptive features and constructs diverse pseudo-tasks from abundant unlabeled data. Our method unifies unsupervised meta-learning with graph in-context learning, achieving efficient inference. Extensive experiments on multiple benchmark datasets demonstrate the superiority of our model. Our public code can be found

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 56 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

41 of 56 references.

References · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  9. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  10. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  11. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  12. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
29 more
  1. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  2. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  3. 2019Simplifying Graph Convolutional Networkscited by 1,477
  4. 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
  5. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  6. 2022A Survey on In-context Learningcited by 721
  7. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
  8. 2022Data Distributional Properties Drive Emergent In-Context Learning in Transformerscited by 309
  9. 2022Visual Prompting via Image Inpaintingcited by 250
  10. 2015Deep Convolutional Networks on Graph-Structured Datacited by 246
  11. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
  12. 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
  13. 2022General-Purpose In-Context Learning by Meta-Learning Transformerscited by 105
  14. 2023PRODIGY: Enabling In-context Learning Over Graphscited by 98
  15. 2023UniverSeg: Universal Medical Image Segmentationcited by 91
  16. 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
  17. 2020Graph Meta Learning via Local Subgraphscited by 89
  18. 2023The Transient Nature of Emergent In-Context Learning in Transformerscited by 76
  19. 2018Unsupervised Meta-Learning For Few-Shot Image Classificationcited by 75
  20. 2023Virtual Node Tuning for Few-shot Node Classificationcited by 46
  21. 2022Task-Adaptive Few-shot Node Classificationcited by 43
  22. 2022Graph Few-shot Learning with Task-specific Structurescited by 26
  23. 2022Transductive Linear Probing: A Novel Framework for Few-Shot Node Classificationcited by 24
  24. 2023Few-shot Node Classification with Extremely Weak Supervisioncited by 14
  25. 2023Contrastive Meta-Learning for Few-shot Node Classificationcited by 11
  26. 2023Task-Equivariant Graph Few-shot Learningcited by 8
  27. 2024Meta-GPS++: Enhancing Graph Meta-Learning with Contrastive Learning and Self-Trainingcited by 7
  28. 2025Dual-level Mixup for Graph Few-shot Learning with Fewer Taskscited by 5
  29. 2025Graph Few-Shot Learning via Adaptive Spectrum Experts and Cross-Set Distribution Calibrationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.