mlsanityData to 14 Oct 2026

Towards Non-Euclidean Foundation Models: Advancing AI Beyond Euclidean Frameworks

arXiv 2505.14417 ↗First posted 20 May 2025cs.CG cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In the era of foundation models and Large Language Models (LLMs), Euclidean space is the de facto geometric setting of our machine learning architectures. However, recent literature has demonstrated that this choice comes with fundamental limitations. To that end, non-Euclidean learning is quickly gaining traction, particularly in web-related applications where complex relationships and structures are prevalent. Non-Euclidean spaces, such as hyperbolic, spherical, and mixed-curvature spaces, have been shown to provide more efficient and effective representations for data with intrinsic geometric properties, including web-related data like social network topology, query-document relationships, and user-item interactions. Integrating foundation models with non-Euclidean geometries has great potential to enhance their ability to capture and model the underlying structures, leading to better performance in search, recommendations, and content understanding. This workshop focuses on the intersection of Non-Euclidean Foundation Models and Geometric Learning (NEGEL), exploring its potential benefits, including the potential benefits for advancing web-related technologies, challenges, and future directions. Workshop page: [https://hyperboliclearning.github.io/events/www2025workshop](https://hyperboliclearning.github.io/events/www2025workshop)

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 45 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

32 of 45 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
  4. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 677
  5. 2019Hyperbolic Graph Convolutional Neural Networkscited by 402
  6. 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 265
  7. 2019Hyperbolic Graph Neural Networkscited by 244
  8. 2019Hyperbolic Image Embeddingscited by 221
  9. 2018Hyperbolic Entailment Cones for Learning Hierarchical Embeddingscited by 162
  10. 2021Equivariant Subgraph Aggregation Networkscited by 154
  11. 2021Hyperbolic Deep Neural Networks: A Surveycited by 139
  12. 2019Constant Curvature Graph Convolutional Networkscited by 108
20 more
  1. 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
  2. 2021Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Spacecited by 67
  3. 2020Graph Geometry Interaction Learningcited by 55
  4. 2019Spherical Text Embeddingcited by 49
  5. 2022The Numerical Stability of Hyperbolic Representation Learningcited by 47
  6. 2024Hypformer: Exploring Efficient Transformer Fully in Hyperbolic Spacecited by 43
  7. 2021Modeling Scale-free Graphs with Hyperbolic Geometry for Knowledge-aware Recommendationcited by 38
  8. 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 35
  9. 2022HRCF: Enhancing Collaborative Filtering via Hyperbolic Geometric Regularizationcited by 34
  10. 2020Deep Metric Learning with Spherical Embeddingcited by 25
  11. 2021Where are we in embedding spaces? A Comprehensive Analysis on Network Embedding Approaches for Recommender Systemscited by 24
  12. 2017Hyperbolic Representation Learning for Fast and Efficient Neural Question Answeringcited by 23
  13. 2020Robust Large-Margin Learning in Hyperbolic Spacecited by 21
  14. 2024Hardness of Learning Neural Networks under the Manifold Hypothesiscited by 18
  15. 2020Ultrahyperbolic Representation Learningcited by 17
  16. 2024On the hardness of learning under symmetriescited by 13
  17. 2021Generalization Error Bound for Hyperbolic Ordinal Embeddingcited by 12
  18. 2021Directed Graph Embeddings in Pseudo-Riemannian Manifoldscited by 9
  19. 2019Neighborhood Growth Determines Geometric Priors for Relational Representation Learningcited by 7
  20. 2023Tight and fast generalization error bound of graph embedding in metric spacecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.