Intrinsic Associative Memory on Riemannian Manifolds: Curvature, Capacity, and Emergent Modes
Not on the map. Why?
Abstract (arXiv)
Geometry does more than constrain an associative memory: curvature determines what it remembers and which states it creates. We develop intrinsic dense associative memories on Riemannian manifolds by casting memory as Epanechnikov kernel-density mode seeking. We compare geodesic and volume-corrected energies and show that curvature separates their behavior. We prove that geodesic memory always retains an isolated pattern, while corrected memory obeys a sharp Ricci-curvature threshold: positive curvature can erase memories in high dimensions, while negative curvature reinforces them. We derive geodesic capacity scalings of qβ-1/2 for retaining every pattern and qβ-1 for a typical one, where qβ is the pairwise kernel-overlap probability. We show how overlap creates novel memories: designed N-pattern configurations realize all 2N-1 subset modes, but random data at the storage threshold yield only a Poisson number. We establish exact one-step recall using Riemannian mean shift. In simulations, we recover the predicted curvature transition and every designed mode. On WordNet's full noun hierarchy, we demonstrate that volume correction improves low-capacity retrieval. Together, our work shows that curvature is a design variable for associative memory, not merely a property of the data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 41 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
6 of 41 references.
References · 6
- 2016Dense Associative Memory for Pattern Recognitioncited by 236
- 2023On Sparse Modern Hopfield Modelcited by 42
- 2025Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometriescited by 18
- 2025Dense Associative Memory with Epanechnikov Energycited by 11
- 2026Text Has Curvaturecited by 2
- 2025Towards Non-Euclidean Foundation Models: Advancing AI Beyond Euclidean Frameworkscited by 1
Built on by
Not cited yet.