mlsanityData to 14 Oct 2026

Dynamic Manifold Hopfield Networks for Context-Dependent Associative Memory

arXiv 2506.01303 ↗First posted 2 Jun 2025cs.LG q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural population activity in cortical and hippocampal circuits can be flexibly reorganized by context, suggesting that cognition relies on dynamic manifolds rather than static representations. However, how such dynamic organization can be realized mechanistically within a unified dynamical system remains unclear. Continuous Hopfield networks provide a classical attractor framework in which neural dynamics follow gradient descent on a fixed energy landscape, constraining retrieval within a static attractor manifold geometry. Extending this approach, we introduce Dynamic Manifold Hopfield Networks (DMHN), continuous dynamical models in which contextual modulation dynamically reshapes attractor geometry, transforming a static attractor manifold into a context-dependent family of neural manifolds. In DMHN, network interactions are learned in a data-driven manner, to intrinsically deform the geometry of its attractor manifold across cues without explicit context-specific parameterization. As a result, in associative retrieval, DMHN achieve substantially higher capacity and robustness than classical and modern Hopfield networks: when storing 2N patterns in a network of N neurons, DMHN attain reliable retrieval with an average accuracy of 64%, compared with 1% and 13% for classical and modern variants, respectively. Together, these results establish dynamic reorganization of attractor manifold geometry as a principled mechanism for context-dependent remapping in neural associative memory.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 53 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

12 of 53 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Hopfield Networks is All You Needcited by 475
  3. 2016Dense Associative Memory for Pattern Recognitioncited by 236
  4. 2020Large Associative Memory Problem in Neurobiology and Machine Learningcited by 112
  5. 2021Attractor and integrator networks in the braincited by 61
  6. 2017Linking connectivity, dynamics and computations in low-rank recurrent neural networkscited by 51
  7. 2017LDMNet: Low Dimensional Manifold Regularized Neural Networkscited by 21
  8. 2023Neuron-Astrocyte Associative Memorycited by 9
  9. 2024Back to the Continuous Attractorcited by 6
  10. 2019Hopfield Neural Network Flow: A Geometric Viewpointcited by 5
  11. 2024Input-Driven Dynamics for Robust Memory Retrieval in Hopfield Networkscited by 5
  12. 2021Emergence of robust memory manifoldscited by 4

Built on by

Not cited yet.