mlsanityData to 7 Oct 2026

Modality-free Graph In-context Alignment

arXiv 2603.13434 ↗First posted 13 Mar 2026cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

In-context learning (ICL) converts static encoders into task-conditioned reasoners, enabling adaptation to new data from just a few examples without updating pretrained parameters. This capability is essential for graph foundation models (GFMs) to approach LLM-level generality. Yet current GFMs struggle with cross-domain alignment, typically relying on modality-specific encoders that fail when graphs are pre-vectorized or raw data is inaccessible. In this paper, we introduce Modality-Free Graph In-context Alignment (MF-GIA), a framework that makes a pretrained graph encoder promptable for few-shot prediction across heterogeneous domains without modality assumptions. MF-GIA captures domain characteristics through gradient fingerprints, which parameterize lightweight transformations that align pre-encoded features and indexed labels into unified semantic spaces. During pretraining, a dual prompt-aware attention mechanism with episodic objective learns to match queries against aligned support examples to establish prompt-based reasoning capabilities. At inference, MF-GIA performs parameter-update-free adaptation using only a few-shot support set to trigger cross-domain alignment and enable immediate prediction on unseen domains. Experiments demonstrate that MF-GIA achieves superior few-shot performance across diverse graph domains and strong generalization to unseen domains.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 63 of its 71 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

63 of 71 references.

References · 63

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2017Graph Attention Networkscited by 8,854
  7. 2017Inductive Representation Learning on Large Graphscited by 6,284
  8. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  9. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  10. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  11. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  12. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
38 more
  1. 2016Matching Networks for One Shot Learningcited by 2,246
  2. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  3. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  4. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  5. 2018Deep Graph Infomaxcited by 1,101
  6. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  7. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  8. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
  9. 2022Transformers learn in-context by gradient descentcited by 714
  10. 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
  11. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  12. 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
  13. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  14. 2021MetaICL: Learning to Learn In Contextcited by 450
  15. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  16. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
  17. 2023Trained Transformers Learn Linear Models In-Contextcited by 331
  18. 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 328
  19. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
  20. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
  21. 2019Episodic Training for Domain Generalizationcited by 245
  22. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  23. 2022Active Example Selection for In-Context Learningcited by 195
  24. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
  25. 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 147
  26. 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
  27. 2023PRODIGY: Enabling In-context Learning Over Graphscited by 97
  28. 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
  29. 2023Towards Foundation Models for Knowledge Graph Reasoningcited by 83
  30. 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
  31. 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
  32. 2024In-context Learning with Retrieved Demonstrations for Language Models: A Surveycited by 69
  33. 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
  34. 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 60
  35. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
  36. 2016SNAP: A General Purpose Network Analysis and Graph Mining Librarycited by 56
  37. 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 56
  38. 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 47

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning
  2. 2025GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models
  3. 2026Surprisingly Simple and Effective Multi-Domain Graph Foundation Model through Graph-to-Table Alignment
  4. 2023Which Modality should I use -- Text, Motif, or Image? : Understanding Graphs with Large Language Models
  5. 2026RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation
  6. 2026Teaching LLMs to See Graphs: Unifying Text and Structural Reasoning
  7. 2026Invariant Gradient Alignment for Robust Reasoning Distillation
  8. 2026Training-Only Heterogeneous Image-Patch-Text Graph Supervision for Advancing Few-Shot Learning Adapters