mlsanityData to 14 Oct 2026

Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adversarial Robustness

arXiv 2604.12811 ↗First posted 14 Apr 2026cs.LG cs.AI cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Dense Associative Memory (DAM) generalizes Hopfield networks through higher-order interactions and achieves storage capacity that scales as O(Nn-1) under suitable pattern separation conditions. Existing dynamical analyses primarily study the thermodynamic limit N→∞ with randomly sampled patterns and therefore do not provide finite-size guarantees or explicit convergence rates. We develop an algorithmic analysis of DAM retrieval dynamics that yields finite-N guarantees under explicit, verifiable pattern conditions. Under a separation assumption and a bounded-interference condition at high loading, we prove geometric convergence of asynchronous retrieval dynamics, which implies O(log N) convergence time once the trajectory enters the basin of attraction. We further establish adversarial robustness bounds expressed through an explicit margin condition that quantifies the number of corrupted bits tolerable per sweep, and derive capacity guarantees that scale as Theta(Nn-1) up to polylogarithmic factors in the worst case, while recovering the classical Theta(Nn-1) scaling for random pattern ensembles. Finally, we show that DAM retrieval dynamics admit a potential-game interpretation that ensures convergence to pure Nash equilibria under asynchronous updates. Complete proofs are provided in the appendices, together with preliminary experiments that illustrate the predicted convergence, robustness, and capacity scaling behavior.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 26 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

12 of 26 references.

References · 12

  1. 2021Convex optimizationcited by 2,515
  2. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
  3. 2018Gradient Descent Finds Global Minima of Deep Neural Networkscited by 574
  4. 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 243
  5. 2016Dense Associative Memory for Pattern Recognitioncited by 236
  6. 2020Large Associative Memory Problem in Neurobiology and Machine Learningcited by 112
  7. 2023Energy Transformercited by 71
  8. 2025Modern Methods in Associative Memorycited by 15
  9. 2026A Biologically Plausible Dense Associative Memory with Exponential Capacitycited by 6
  10. 2025Dense Associative Memories with Analog Circuitscited by 3
  11. 2025Saddle Hierarchy in Dense Associative Memorycited by 1
  12. 2025On the Role of Hidden States of Modern Hopfield Network in Transformercited by 1

Built on by

Not cited yet.