mlsanityData to 7 Oct 2026

BRACE: Differential Privacy for Dense Associative Memory with LSR Energy

arXiv 2610.11218 ↗First posted 8 Oct 2026cs.CR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Dense associative memory (DAM) provides an energy-based framework for memory retrieval with close connections to attention mechanisms in modern artificial intelligence. Despite growing interest in differential privacy for AI, the privacy of DAM retrieval dynamics remains relatively unexplored. In this paper, we develop a differential privacy framework for log-sum-ReLU (LSR) dense associative memory, whose finite-support retrieval dynamics pose distinctive challenges for privacy-preserving computation. We propose the Boundary-Responsive Adaptive Correction Evolution (BRACE) algorithm, a differentially private retrieval mechanism for LSR-DAM that adaptively corrects boundary-sensitive perturbations to control their cumulative effect over the retrieval trajectory. In theory, we prove that our method is minimax optimal by deriving dimension-independent terminal and full-trajectory retrieval error rates, with optimal dependence on the inverse temperature and, in the growing-horizon regime, the retrieval horizon. We further establish central limit theorems that enable uncertainty quantification for private retrieval by characterizing its asymptotic distribution and the additional variability introduced by privacy. Numerical experiments compare our proposed method with baseline differential privacy approaches and evaluate its retrieval accuracy. Together, our results provide a theoretical foundation for optimal privacy-preserving retrieval and uncertainty quantification in energy-based associative memory systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 28 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

10 of 28 references.

References · 10

  1. 2013Auto-Encoding Variational Bayescited by 3,980
  2. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  3. 2020Hopfield Networks is All You Needcited by 461
  4. 2021Differentially Private Fine-tuning of Language Modelscited by 392
  5. 2016Dense Associative Memory for Pattern Recognitioncited by 230
  6. 2020Large Associative Memory Problem in Neurobiology and Machine Learningcited by 110
  7. 2023Differentially Private Synthetic Data via Foundation Model APIs 1: Imagescited by 63
  8. 2023Memory Augmented Large Language Models are Computationally Universalcited by 45
  9. 2023Personalized Large Language Model Assistant with Evolving Conditional Memorycited by 24
  10. 2026Sparse Attention as Compact Kernel Regressioncited by 2

Built on by

Not cited yet.