Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligence
Not on the map. Why?
Abstract (arXiv)
Graphs provide a natural description of the complex relationships among objects, and play a pivotal role in communications, transportation, social computing, the life sciences, etc. Currently, there is strong agreement that Graph Foundation Models (GFMs) are essential for advancing graph learning, yet considerable disagreement persists on how to build a powerful, general-purpose GFM analogous to Large Language Models (LLMs). Graph Neural Networks (GNNs) exhibit limitations in memory retention and principled interpretability when confronted with multi-domain pretraining and adaptation. The challenge of graph serialization hinders the direct application of LLMs, as the words struggle to capture the structural complexity and diversity inherent in graphs. In contrast, Riemannian geometry offers an elegant mathematical framework for modeling structures, while remaining compatible with graph semantic learning, even with LLMs. In this paper, we argue that, for graphs, Riemannian geometry speaks louder than words, and lay out the foundational principles for GFM. Reimagining with Riemannian geometry, we introduce a blue sky idea-Riemannian Foundation Model (RFM)-that opens a new pathway for capturing complex structural patterns and uncovering cross-domain generalities. RFM emphasizes intrinsic graph geometry and embodies endogenous capacities for structural inference and generation, moving beyond mere representation-space switching. Accordingly, we outline a progressive agenda that begins with universal structural understanding through intrinsic geometry, and then rebuilds LLM with a Riemannian engine for general-purpose graph modeling and beyond. Thus, RFM enables a paradigm shift from designing graph models to solving graph-structured applications with RFM agents, unlocking the next-generation graph intelligence.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 54 of its 77 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
54 of 77 references.
References · 54
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018World Modelscited by 1,444
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2019Hyperbolic Graph Neural Networkscited by 244
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
- 2023Language is All a Graph Needscited by 219
- 2024LLaGA: Large Language and Graph Assistantcited by 177
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
38 more
- 2023GraphText: Graph Reasoning in Text Spacecited by 110
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
- 2023Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPTcited by 78
- 2024OpenGraph: Towards Open Graph Foundation Modelscited by 75
- 2024GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Taskscited by 63
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
- 2024AnyGraph: Graph Foundation Model in the Wildcited by 51
- 2021Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphscited by 49
- 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 41
- 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 41
- 2024On the Scalability of GNNs for Molecular Graphscited by 36
- 2024Fully-inductive Node Classification on Arbitrary Graphscited by 36
- 2022Self-Supervised Continual Graph Learning in Adaptive Riemannian Spacescited by 32
- 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 32
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 30
- 2023Beyond Text: A Deep Dive into Large Language Models' Ability on Understanding Graph Datacited by 25
- 2022A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learningcited by 24
- 2024Motif-aware Riemannian Graph Neural Network with Generative-Contrastive Learningcited by 23
- 2024UniMoT: Unified Molecule-Text Language Model with Discrete Token Representationcited by 23
- 2025GraphICL: Unlocking Graph Learning Potential in LLMs through Structured Prompt Designcited by 21
- 2024LSEnet: Lorentz Structural Entropy Neural Network for Deep Graph Clusteringcited by 20
- 2024textttMiniMol: A Parameter-Efficient Foundation Model for Molecular Learningcited by 19
- 2023Contrastive Graph Clustering in Curvature Spacescited by 15
- 2024DeepRicci: Self-supervised Graph Structure-Feature Co-Refinement for Alleviating Over-squashingcited by 15
- 2024Spiking Graph Neural Network on Riemannian Manifoldscited by 15
- 2025Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglementcited by 14
- 2025GRAVER: Generative Graph Vocabularies for Robust Graph Foundation Models Fine-tuningcited by 13
- 2024One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphscited by 12
- 2025Are Large Language Models In-Context Graph Learners?cited by 12
- 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walkscited by 8
- 2025FedBook: A Unified Federated Graph Foundation Codebook with Intra-domain and Inter-domain Knowledge Modelingcited by 8
- 2024Generalizing Graph Transformers Across Diverse Graphs and Tasks via Pre-trainingcited by 7
- 2025Deeper with Riemannian Geometry: Overcoming Oversmoothing and Oversquashing for Graph Foundation Modelscited by 6
- 2025SA2GFM: Enhancing Robust Graph Foundation Models with Structure-Aware Semantic Augmentationcited by 5
- 2025Pioneer: Physics-informed Riemannian Graph ODE for Entropy-increasing Dynamicscited by 4
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.