mlsanityData to 7 Oct 2026

Explosive neural networks via higher-order interactions in curved statistical manifolds

arXiv 2408.02326 ↗First posted 5 Aug 2024cond-mat.dis-nn cond-mat.stat-mech cs.ITcited by 3

Not on the map. Why?

Abstract (arXiv)

Higher-order interactions underlie complex phenomena in systems such as biological and artificial neural networks, but their study is challenging due to the scarcity of tractable models. By leveraging a generalisation of the maximum entropy principle, we introduce curved neural networks as a class of models with a limited number of parameters that are particularly well-suited for studying higher-order phenomena. Through exact mean-field descriptions, we show that these curved neural networks implement a self-regulating annealing process that can accelerate memory retrieval, leading to explosive order-disorder phase transitions with multi-stability and hysteresis effects. Moreover, by analytically exploring their memory-retrieval capacity using the replica trick, we demonstrate that these networks can enhance memory capacity and robustness of retrieval over classical associative-memory networks. Overall, the proposed framework provides parsimonious models amenable to analytical study, revealing higher-order phenomena in complex networks.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 8 of its 71 references that are in the map. First posted on arXiv 5 Aug 2024.

Builds on

8 of 71 references.

References · 8

  1. 2016Dense Associative Memory for Pattern Recognitioncited by 230
  2. 2021The physics of higher-order interactions in complex systemscited by 63
  3. 2023In search of dispersed memories: Generative diffusion models are associative memory networkscited by 44
  4. 2023The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instabilitycited by 37
  5. 2022Dense Hebbian neural networks: a replica symmetric picture of unsupervised learningcited by 10
  6. 2022Efficient Optimization with Higher-Order Ising Machinescited by 10
  7. 2013Searching for collective behavior in a network of real neuronscited by 9
  8. 2019Explosive higher-order Kuramoto dynamics on simplicial complexescited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.