mlsanityData to 7 Oct 2026

Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligence

arXiv 2603.21601 ↗First posted 23 Mar 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Graphs provide a natural description of the complex relationships among objects, and play a pivotal role in communications, transportation, social computing, the life sciences, etc. Currently, there is strong agreement that Graph Foundation Models (GFMs) are essential for advancing graph learning, yet considerable disagreement persists on how to build a powerful, general-purpose GFM analogous to Large Language Models (LLMs). Graph Neural Networks (GNNs) exhibit limitations in memory retention and principled interpretability when confronted with multi-domain pretraining and adaptation. The challenge of graph serialization hinders the direct application of LLMs, as the words struggle to capture the structural complexity and diversity inherent in graphs. In contrast, Riemannian geometry offers an elegant mathematical framework for modeling structures, while remaining compatible with graph semantic learning, even with LLMs. In this paper, we argue that, for graphs, Riemannian geometry speaks louder than words, and lay out the foundational principles for GFM. Reimagining with Riemannian geometry, we introduce a blue sky idea-Riemannian Foundation Model (RFM)-that opens a new pathway for capturing complex structural patterns and uncovering cross-domain generalities. RFM emphasizes intrinsic graph geometry and embodies endogenous capacities for structural inference and generation, moving beyond mere representation-space switching. Accordingly, we outline a progressive agenda that begins with universal structural understanding through intrinsic geometry, and then rebuilds LLM with a Riemannian engine for general-purpose graph modeling and beyond. Thus, RFM enables a paradigm shift from designing graph models to solving graph-structured applications with RFM agents, unlocking the next-generation graph intelligence.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 54 of its 77 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

54 of 77 references.

References · 54

  1. 2017Graph Attention Networkscited by 8,854
  2. 2017Inductive Representation Learning on Large Graphscited by 6,284
  3. 2018World Modelscited by 1,444
  4. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  5. 2020Simple and Deep Graph Convolutional Networkscited by 857
  6. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  7. 2019Hyperbolic Graph Neural Networkscited by 244
  8. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  9. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
  10. 2023Language is All a Graph Needscited by 219
  11. 2024LLaGA: Large Language and Graph Assistantcited by 177
  12. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
38 more
  1. 2023GraphText: Graph Reasoning in Text Spacecited by 110
  2. 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
  3. 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
  4. 2023Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPTcited by 78
  5. 2024OpenGraph: Towards Open Graph Foundation Modelscited by 75
  6. 2024GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Taskscited by 63
  7. 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
  8. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
  9. 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
  10. 2024AnyGraph: Graph Foundation Model in the Wildcited by 51
  11. 2021Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphscited by 49
  12. 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 41
  13. 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 41
  14. 2024On the Scalability of GNNs for Molecular Graphscited by 36
  15. 2024Fully-inductive Node Classification on Arbitrary Graphscited by 36
  16. 2022Self-Supervised Continual Graph Learning in Adaptive Riemannian Spacescited by 32
  17. 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 32
  18. 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 30
  19. 2023Beyond Text: A Deep Dive into Large Language Models' Ability on Understanding Graph Datacited by 25
  20. 2022A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learningcited by 24
  21. 2024Motif-aware Riemannian Graph Neural Network with Generative-Contrastive Learningcited by 23
  22. 2024UniMoT: Unified Molecule-Text Language Model with Discrete Token Representationcited by 23
  23. 2025GraphICL: Unlocking Graph Learning Potential in LLMs through Structured Prompt Designcited by 21
  24. 2024LSEnet: Lorentz Structural Entropy Neural Network for Deep Graph Clusteringcited by 20
  25. 2024textttMiniMol: A Parameter-Efficient Foundation Model for Molecular Learningcited by 19
  26. 2023Contrastive Graph Clustering in Curvature Spacescited by 15
  27. 2024DeepRicci: Self-supervised Graph Structure-Feature Co-Refinement for Alleviating Over-squashingcited by 15
  28. 2024Spiking Graph Neural Network on Riemannian Manifoldscited by 15
  29. 2025Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglementcited by 14
  30. 2025GRAVER: Generative Graph Vocabularies for Robust Graph Foundation Models Fine-tuningcited by 13
  31. 2024One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphscited by 12
  32. 2025Are Large Language Models In-Context Graph Learners?cited by 12
  33. 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walkscited by 8
  34. 2025FedBook: A Unified Federated Graph Foundation Codebook with Intra-domain and Inter-domain Knowledge Modelingcited by 8
  35. 2024Generalizing Graph Transformers Across Diverse Graphs and Tasks via Pre-trainingcited by 7
  36. 2025Deeper with Riemannian Geometry: Overcoming Oversmoothing and Oversquashing for Graph Foundation Modelscited by 6
  37. 2025SA2GFM: Enhancing Robust Graph Foundation Models with Structure-Aware Semantic Augmentationcited by 5
  38. 2025Pioneer: Physics-informed Riemannian Graph ODE for Entropy-increasing Dynamicscited by 4

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.