mlsanityData to 7 Oct 2026

Toward a universal foundation model for graph-structured data

arXiv 2604.06391 ↗First posted 7 Apr 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Graphs are a central representation in biomedical research, capturing molecular interaction networks, gene regulatory circuits, cell--cell communication maps, and knowledge graphs. Despite their importance, currently there is not a broadly reusable foundation model available for graph analysis comparable to those that have transformed language and vision. Existing graph neural networks are typically trained on a single dataset and learn representations specific only to that graph's node features, topology, and label space, limiting their ability to transfer across domains. This lack of generalization is particularly problematic in biology and medicine, where networks vary substantially across cohorts, assays, and institutions. Here we introduce a graph foundation model designed to learn transferable structural representations that are not specific to specific node identities or feature schemes. Our approach leverages feature-agnostic graph properties, including degree statistics, centrality measures, community structure indicators, and diffusion-based signatures, and encodes them as structural prompts. These prompts are integrated with a message-passing backbone to embed diverse graphs into a shared representation space. The model is pretrained once on heterogeneous graphs and subsequently reused on unseen datasets with minimal adaptation. Across multiple benchmarks, our pretrained model matches or exceeds strong supervised baselines while demonstrating superior zero-shot and few-shot generalization on held-out graphs. On the SagePPI benchmark, supervised fine-tuning of the pretrained backbone achieves a mean ROC-AUC of 95.5%, a gain of 21.8% over the best supervised message-passing baseline. The proposed technique thus provides a unique approach toward reusable, foundation-scale models for graph-structured data in biomedical and network science applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 48 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

24 of 48 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2017Graph Attention Networkscited by 8,854
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  8. 2017Inductive Representation Learning on Large Graphscited by 6,284
  9. 2018How Powerful are Graph Neural Networks?cited by 4,355
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  11. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  12. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
12 more
  1. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  2. 2017Mixed Precision Trainingcited by 1,135
  3. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  4. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  5. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  6. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  7. 2020Deep Graph Contrastive Representation Learningcited by 535
  8. 2020Transfer Learning in Deep Reinforcement Learning: A Surveycited by 259
  9. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
  10. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
  11. 2020Graph Meta Learning via Local Subgraphscited by 89
  12. 2017A linear streaming algorithm for community detection in very large networkscited by 1

Built on by

Not cited yet.