Energy-Based Dynamical Models for Neurocomputation, Learning, and Optimization
Not on the map. Why?
Abstract (arXiv)
Recent advances at the intersection of control theory, neuroscience, and machine learning have revealed novel mechanisms by which dynamical systems perform computation. These advances encompass a wide range of conceptual, mathematical, and computational ideas, with applications for model learning and training, memory retrieval, data-driven control, and optimization. This tutorial focuses on neuro-inspired approaches to computation that aim to improve scalability, robustness, and energy efficiency across such tasks, bridging the gap between artificial and biological systems. Particular emphasis is placed on energy-based dynamical models that encode information through gradient flows and energy landscapes. We begin by reviewing classical formulations, such as continuous-time Hopfield networks and Boltzmann machines, and then extend the framework to modern developments. These include dense associative memory models for high-capacity storage, oscillator-based networks for large-scale optimization, and proximal-descent dynamics for composite and constrained reconstruction. The tutorial demonstrates how control-theoretic principles can guide the design of next-generation neurocomputing systems, steering the discussion beyond conventional feedforward and backpropagation-based approaches to artificial intelligence.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 53 of its 142 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
53 of 142 references.
References · 53
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016Concrete Problems in AI Safetycited by 1,582
- 2016The Mythos of Model Interpretabilitycited by 716
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
- 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 251
- 2016Dense Associative Memory for Pattern Recognitioncited by 230
- 2013Ising formulations of many NP problemscited by 204
- 2020Large Associative Memory Problem in Neurobiology and Machine Learningcited by 110
- 2020Generalized Energy Based Modelscited by 73
- 2023Energy Transformercited by 69
- 2020Modern Hopfield Networks and Attention for Immune Repertoire Classificationcited by 52
38 more
- 2022Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Modelscited by 52
- 2017Dense Associative Memory is Robust to Adversarial Inputscited by 45
- 2018Unsupervised Learning by Competing Hidden Unitscited by 44
- 2025Memorization to Generalization: Emergence of Diffusion Models from Associative Memorycited by 35
- 2021Hierarchical Associative Memorycited by 34
- 2017Equivalence of Equilibrium Propagation and Recurrent Backpropagationcited by 31
- 2015A Hebbian/Anti-Hebbian Neural Network for Linear Subspace Learning: A Derivation from Multidimensional Scaling of Streaming Datacited by 26
- 2019Local Unsupervised Learning for Image Analysiscited by 16
- 2023Simplicial Hopfield networkscited by 16
- 2024Training Coupled Phase Oscillators as a Neuromorphic Platform using Equilibrium Propagationcited by 16
- 2023End-to-end Differentiable Clustering with Associative Memoriescited by 15
- 2023Long Sequence Hopfield Memorycited by 15
- 2025AI Safety for Everyonecited by 14
- 2025Operator Learning for Reconstructing Flow Fields from Sparse Measurements: an Energy Transformer Approachcited by 11
- 2025Dense Associative Memory with Epanechnikov Energycited by 10
- 2023Neuron-Astrocyte Associative Memorycited by 9
- 2017Dynamics over Signed Networkscited by 8
- 2026A Biologically Plausible Dense Associative Memory with Exponential Capacitycited by 6
- 2013Realistic Control of Network Dynamicscited by 5
- 2021Spiking Control Systemscited by 5
- 2022Control Barrier Function Based Design of Gradient Flows for Constrained Nonlinear Programmingcited by 5
- 2024Input-Driven Dynamics for Robust Memory Retrieval in Hopfield Networkscited by 5
- 2023Positive Competitive Networks for Sparse Reconstructioncited by 4
- 2024Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimizationcited by 4
- 2024Proximal Gradient Dynamics: Monotonicity, Exponential Convergence, and Applicationscited by 4
- 2025Distributionally Robust Free Energy Principle for Decision-Makingcited by 4
- 2025NRGPT: An Energy-based Alternative for GPTcited by 4
- 2025Dense Associative Memories with Analog Circuitscited by 3
- 2023Stability of Oscillator Ising Machines: Not All Solutions Are Created Equalcited by 2
- 2024The Neuron as a Direct Data-Driven Controllercited by 2
- 2024Firing Rate Models as Associative Memory: Excitatory-Inhibitory Balance for Robust Retrievalcited by 2
- 2025Analyzing Parametric Oscillator Ising Machines through the Kuramoto Lenscited by 2
- 2025An Energy-Based Mechanism for Compositional Behaviorcited by 2
- 2025Competition, stability, and functionality in excitatory-inhibitory neural circuitscited by 2
- 2026Provably Safe Generative Sampling with Constricting Barrier Functionscited by 2
- 2025Tunable Thresholds and Frequency Encoding in a Spiking NOD Controllercited by 1
- 2025Oscillatory Associative Memory with Exponential Capacitycited by 1
- 2025Optimal flock formation induced by agent heterogeneitycited by 1
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.