mlsanityData to 14 Oct 2026

Geometric Learning Dynamics

arXiv 2504.14728 ↗First posted 20 Apr 2025cs.LG q-bio.PE quant-phcited by 2

Not on the map. Why?

Abstract (arXiv)

We present a unified geometric framework for modeling learning dynamics in physical, biological, and machine learning systems. The theory reveals three fundamental regimes, each emerging from the power-law relationship g propto kappaα between the metric tensor g in the space of trainable variables and the noise covariance matrix kappa. The quantum regime corresponds to α = 1 and describes Schr"odinger-like dynamics that emerges from a discrete shift symmetry. The efficient learning regime corresponds to α = tfrac12 and describes very fast machine learning algorithms. The equilibration regime corresponds to α = 0 and describes classical models of biological evolution. We argue that the emergence of the intermediate regime α = tfrac12 is a key mechanism underlying the emergence of biological complexity.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 20 Apr 2025.

Builds on

13 of 31 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2014Deep Learning in Neural Networks: An Overviewcited by 770
  3. 2020AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradientscited by 283
  4. 2020The world as a neural networkcited by 18
  5. 2021Towards a Theory of Evolution as Multilevel Learningcited by 18
  6. 2020Towards a theory of machine learningcited by 14
  7. 2020Emergent Quantumness in Neural Networkscited by 10
  8. 2021Towards a theory of quantum gravity from neural networkscited by 8
  9. 2021Thermodynamics of Evolution and the Origin of Lifecited by 7
  10. 2024Dataset-learning duality and emergent criticalitycited by 5
  11. 2024Emergent field theories from neural networkscited by 4
  12. 2025Covariant Gradient Descentcited by 3
1 more
  1. 2025Molecular Learning Dynamicscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.