RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode knowledge into model parameters, which limits semantic capacity, introduces heavy lossy compression with conflicts, and entangles graph representation with the knowledge in ways that hinder efficient adaptation, undermining scalability and interpretability. In this work,we propose RAG-GFM, a Retrieval-Augmented Generation aided Graph Foundation Model that offloads knowledge from parameters and complements parameterized learning. To externalize graph knowledge, we build a dual-modal unified retrieval module, where a semantic store from prefix-structured text and a structural store from centrality-based motif. To preserve heterogeneous information, we design a dual-view alignment objective that contrasts both modalities to capture both content and relational patterns. To enable efficient downstream adaptation, we perform in-context augmentation to enrich supporting instances with retrieved texts and motifs as contextual evidence. Extensive experiments on five benchmark graph datasets demonstrate that RAG-GFM consistently outperforms 13 state-of-the-art baselines in both cross-domain node and graph classification, achieving superior effectiveness and efficiency.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 57 of its 94 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
57 of 94 references.
Closest ancestors · 4
Same direction, newest first
- 2025DyG-RAG: Dynamic Graph Retrieval-Augmented Generation with Event-Centric Reasoning16 Jul
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation3 Feb
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec
- 2024Graph Retrieval-Augmented Generation: A Survey15 Aug
Other references · 53
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Graph Attention Networkscited by 8,854
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2023In-Context Retrieval-Augmented Language Modelscited by 694
- 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
- 2023Active Retrieval Augmented Generationcited by 506
38 more
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
- 2018Session-based Recommendation with Graph Neural Networkscited by 312
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
- 2023Can Language Models Solve Graph Problems in Natural Language?cited by 249
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 211
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2021Graph Learning: A Surveycited by 140
- 2019Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systemscited by 107
- 2022Not too little, not too much: a theoretical analysis of graph (over)smoothingcited by 106
- 2021Knowledge Graph Reasoning with Relational Digraphcited by 91
- 2024Position: Graph Foundation Models are Already Herecited by 84
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
- 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 83
- 2023Graph Neural Prompting with Large Language Modelscited by 64
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 60
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
- 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
- 2023HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learningcited by 45
- 2024HiGPT: Heterogeneous Graph Language Modelcited by 44
- 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 41
- 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 41
- 2022Self-supervised Heterogeneous Graph Pre-training Based on Structural Clusteringcited by 30
- 2024Continual Forgetting for Pre-trained Vision Modelscited by 29
- 2023Environment-Aware Dynamic Graph Learning for Out-of-Distribution Generalizationcited by 26
- 2023Structure-Aware Language Model Pretraining Improves Dense Retrieval on Structured Datacited by 23
- 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
- 2023When to Pre-Train Graph Neural Networks? From Data Generation Perspective!cited by 17
- 2025GRAVER: Generative Graph Vocabularies for Robust Graph Foundation Models Fine-tuningcited by 13
- 2024One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphscited by 12
- 2021Pre-Training on Dynamic Graph Neural Networkscited by 11
- 2024Cross-Domain Graph Data Scaling: A Showcase with Diffusion Modelscited by 8
- 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centralitycited by 5
- 2025SA2GFM: Enhancing Robust Graph Foundation Models with Structure-Aware Semantic Augmentationcited by 5
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Structure-Centric Graph Foundation Model via Geometric Basescited by 5
- 2026SCGFM-ART: Amortized Relational Transport for Structure-Centric Graph Foundation Modelscited by 1
- 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuningcited by 0
- 2026Training Graph Foundation Models on The Web Graphcited by 0
- 2026Training Graph Foundation Models on The Web Graph25 Sep 2026
- 2026SCGFM-ART: Amortized Relational Transport for Structure-Centric Graph Foundation Models17 Sep 2026
- 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning12 May 2026
- 2026Structure-Centric Graph Foundation Model via Geometric Bases9 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Generalizing Graph Foundation Models via Hyperbolic Retrieval-Augmented Generation
- 2024RAGraph: A General Retrieval-Augmented Graph Learning Framework
- 2025Are Large Language Models In-Context Graph Learners?
- 2026T-Retriever: Tree-based Hierarchical Retrieval Augmented Generation for Textual Graphs
- 2025GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models
- 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generation
- 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation
- 2025RGL: A Graph-Centric, Modular Framework for Efficient Retrieval-Augmented Generation on Graphs