Modality-free Graph In-context Alignment
Not on the map. Why?
Abstract (arXiv)
In-context learning (ICL) converts static encoders into task-conditioned reasoners, enabling adaptation to new data from just a few examples without updating pretrained parameters. This capability is essential for graph foundation models (GFMs) to approach LLM-level generality. Yet current GFMs struggle with cross-domain alignment, typically relying on modality-specific encoders that fail when graphs are pre-vectorized or raw data is inaccessible. In this paper, we introduce Modality-Free Graph In-context Alignment (MF-GIA), a framework that makes a pretrained graph encoder promptable for few-shot prediction across heterogeneous domains without modality assumptions. MF-GIA captures domain characteristics through gradient fingerprints, which parameterize lightweight transformations that align pre-encoded features and indexed labels into unified semantic spaces. During pretraining, a dual prompt-aware attention mechanism with episodic objective learns to match queries against aligned support examples to establish prompt-based reasoning capabilities. At inference, MF-GIA performs parameter-update-free adaptation using only a few-shot support set to trigger cross-domain alignment and enable immediate prediction on unseen domains. Experiments demonstrate that MF-GIA achieves superior few-shot performance across diverse graph domains and strong generalization to unseen domains.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 63 of its 71 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
63 of 71 references.
References · 63
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
38 more
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2022Transformers learn in-context by gradient descentcited by 714
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
- 2023Trained Transformers Learn Linear Models In-Contextcited by 331
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 328
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
- 2019Episodic Training for Domain Generalizationcited by 245
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2022Active Example Selection for In-Context Learningcited by 195
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 147
- 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
- 2023PRODIGY: Enabling In-context Learning Over Graphscited by 97
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
- 2023Towards Foundation Models for Knowledge Graph Reasoningcited by 83
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
- 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
- 2024In-context Learning with Retrieved Demonstrations for Language Models: A Surveycited by 69
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 60
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2016SNAP: A General Purpose Network Analysis and Graph Mining Librarycited by 56
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 56
- 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 47
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning
- 2025GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models
- 2026Surprisingly Simple and Effective Multi-Domain Graph Foundation Model through Graph-to-Table Alignment
- 2023Which Modality should I use -- Text, Motif, or Image? : Understanding Graphs with Large Language Models
- 2026RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation
- 2026Teaching LLMs to See Graphs: Unifying Text and Structural Reasoning
- 2026Invariant Gradient Alignment for Robust Reasoning Distillation
- 2026Training-Only Heterogeneous Image-Patch-Text Graph Supervision for Advancing Few-Shot Learning Adapters