mlsanityData to 7 Oct 2026

RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation

arXiv 2601.15124 ↗First posted 21 Jan 2026cs.LG cs.AIcited by 4

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode knowledge into model parameters, which limits semantic capacity, introduces heavy lossy compression with conflicts, and entangles graph representation with the knowledge in ways that hinder efficient adaptation, undermining scalability and interpretability. In this work,we propose RAG-GFM, a Retrieval-Augmented Generation aided Graph Foundation Model that offloads knowledge from parameters and complements parameterized learning. To externalize graph knowledge, we build a dual-modal unified retrieval module, where a semantic store from prefix-structured text and a structural store from centrality-based motif. To preserve heterogeneous information, we design a dual-view alignment objective that contrasts both modalities to capture both content and relational patterns. To enable efficient downstream adaptation, we perform in-context augmentation to enrich supporting instances with retrieved texts and motifs as contextual evidence. Extensive experiments on five benchmark graph datasets demonstrate that RAG-GFM consistently outperforms 13 state-of-the-art baselines in both cross-domain node and graph classification, achieving superior effectiveness and efficiency.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 57 of its 94 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

57 of 94 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025DyG-RAG: Dynamic Graph Retrieval-Augmented Generation with Event-Centric Reasoning16 Jul
  2. 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation3 Feb
  3. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec
  4. 2024Graph Retrieval-Augmented Generation: A Survey15 Aug

Other references · 53

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2017Graph Attention Networkscited by 8,854
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  6. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  7. 2018Deep Graph Infomaxcited by 1,101
  8. 2015Deep Learning and the Information Bottleneck Principlecited by 793
  9. 2019Graph Neural Networks for Social Recommendationcited by 711
  10. 2023In-Context Retrieval-Augmented Language Modelscited by 694
  11. 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
  12. 2023Active Retrieval Augmented Generationcited by 506
38 more
  1. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  2. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  3. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
  4. 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
  5. 2023Can Language Models Solve Graph Problems in Natural Language?cited by 249
  6. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  7. 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 211
  8. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
  9. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  10. 2021Graph Learning: A Surveycited by 140
  11. 2019Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systemscited by 107
  12. 2022Not too little, not too much: a theoretical analysis of graph (over)smoothingcited by 106
  13. 2021Knowledge Graph Reasoning with Relational Digraphcited by 91
  14. 2024Position: Graph Foundation Models are Already Herecited by 84
  15. 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
  16. 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 83
  17. 2023Graph Neural Prompting with Large Language Modelscited by 64
  18. 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
  19. 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 60
  20. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
  21. 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
  22. 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
  23. 2023HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learningcited by 45
  24. 2024HiGPT: Heterogeneous Graph Language Modelcited by 44
  25. 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 41
  26. 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 41
  27. 2022Self-supervised Heterogeneous Graph Pre-training Based on Structural Clusteringcited by 30
  28. 2024Continual Forgetting for Pre-trained Vision Modelscited by 29
  29. 2023Environment-Aware Dynamic Graph Learning for Out-of-Distribution Generalizationcited by 26
  30. 2023Structure-Aware Language Model Pretraining Improves Dense Retrieval on Structured Datacited by 23
  31. 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
  32. 2023When to Pre-Train Graph Neural Networks? From Data Generation Perspective!cited by 17
  33. 2025GRAVER: Generative Graph Vocabularies for Robust Graph Foundation Models Fine-tuningcited by 13
  34. 2024One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphscited by 12
  35. 2021Pre-Training on Dynamic Graph Neural Networkscited by 11
  36. 2024Cross-Domain Graph Data Scaling: A Showcase with Diffusion Modelscited by 8
  37. 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centralitycited by 5
  38. 2025SA2GFM: Enhancing Robust Graph Foundation Models with Structure-Aware Semantic Augmentationcited by 5

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Generalizing Graph Foundation Models via Hyperbolic Retrieval-Augmented Generation
  2. 2024RAGraph: A General Retrieval-Augmented Graph Learning Framework
  3. 2025Are Large Language Models In-Context Graph Learners?
  4. 2026T-Retriever: Tree-based Hierarchical Retrieval Augmented Generation for Textual Graphs
  5. 2025GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models
  6. 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generation
  7. 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation
  8. 2025RGL: A Graph-Centric, Modular Framework for Efficient Retrieval-Augmented Generation on Graphs