Attractor and integrator networks in the brain
Not on the map. Why?
Abstract (arXiv)
In this review, we describe the singular success of attractor neural network models in describing how the brain maintains persistent activity states for working memory, error-corrects, and integrates noisy cues. We consider the mechanisms by which simple and forgetful units can organize to collectively generate dynamics on the long time-scales required for such computations. We discuss the myriad potential uses of attractor dynamics for computation in the brain, and showcase notable examples of brain systems in which inherently low-dimensional continuous attractor dynamics have been concretely and rigorously identified. Thus, it is now possible to conclusively state that the brain constructs and uses such systems for computation. Finally, we look ahead by highlighting recent theoretical advances in understanding how the fundamental tradeoffs between robustness and capacity and between structure and flexibility can be overcome by reusing and recombining the same set of modular attractors for multiple functions, so they together produce representations that are structurally constrained and robust but exhibit high capacity and are flexible.
Key facts. Cited by 61 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Dec 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 11; 2024: 14; 2025: 18; 2026: 17.
61 papers.
Sort:
By area:
- 2024Out-of-Domain Generalization in Dynamical Systems Reconstructioncited by 33
- 2026Do Sparse Autoencoders Capture Concept Manifolds?cited by 31
- 2023Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysiscited by 23
- 2024Representation Shattering in Transformers: A Synthetic Study with Knowledge Editingcited by 19
- 2023Interpretable statistical representations of neural population dynamics and geometrycited by 12
- 2025Probing Latent Subspaces in LLM for AI Security: Identifying and Manipulating Adversarial Statescited by 9
- 2023Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cellscited by 8
- 2023Sources of Richness and Ineffability for Phenomenally Conscious Statescited by 7
- 2022Expressive architectures enhance interpretability of dynamics-based neural population modelscited by 6
- 2023Persistent learning signals and working memory without continuous attractorscited by 6
- 2023Implicit Gaussian process representation of vector fields over arbitrary latent manifoldscited by 6
- 2024Time Makes Space: Emergence of Place Fields in Networks Encoding Temporally Continuous Sensory Experiencescited by 4
38 more
- 2024Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equationscited by 4
- 2024DFORM: Diffeomorphic vector field alignment for assessing dynamics across learned modelscited by 3
- 2024Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardwarecited by 3
- 2024Neural timescales from a computational perspectivecited by 3
- 2024Associative memory inspires improvements for in-context learning using a novel attention residual stream architecturecited by 3
- 2025Neural Langevin Machine: a local asymmetric learning rule can be creativecited by 3
- 2026Geometry-aware similarity metrics for neural representations on Riemannian and statistical manifoldscited by 3
- 2023Trainability, Expressivity and Interpretability in Gated Neural ODEscited by 2
- 2023Discrete, compositional, and symbolic representations through attractor dynamicscited by 2
- 2023Let's do the time-warp-attend: Learning topological invariants of dynamical systemscited by 2
- 2024Learning in Wilson-Cowan model for metapopulationcited by 2
- 2024Augmenting learning in neuro-embodied systems through neurobiological first principlescited by 2
- 2025Learning Dynamics of RNNs in Closed-Loop Environmentscited by 2
- 2025Sufficient conditions for offline reactivation in recurrent neural networkscited by 2
- 2025Self-orthogonalizing attractor neural networks emerging from the free energy principlecited by 2
- 2023Emergence of Adaptive Circadian Rhythms in Deep Reinforcement Learningcited by 1
- 2023Astrocytes as a mechanism for meta-plasticity and contextually-guided network functioncited by 1
- 2024Learning Sequence Attractors in Recurrent Networks with Hidden Neuronscited by 1
- 2024Computational Dynamical Systemscited by 1
- 2025RNNs perform task computations by dynamically warping neural representationscited by 1
- 2026Cortex-Inspired Continual Learning: Unsupervised Instantiation and Recovery of Functional Task Networkscited by 1
- 2026SILVA Networks as Structured Implicit Layers and Vector Attractors via Dynamic Interaction Fieldscited by 1
- 2024What is Intelligence? A Cycle Closure Perspectivecited by 0
- 2024Spatial-Aware Decision-Making with Ring Attractors in Reinforcement Learning Systemscited by 0
- 2025Allostatic Control of Persistent States in Spiking Neural Networks for perception and computationcited by 0
- 2025Improving World Models using Deep Supervision with Linear Probescited by 0
- 2025Dynamic Manifold Hopfield Networks for Context-Dependent Associative Memorycited by 0
- 2025High-resolution spatial memory requires grid-cell-like neural codescited by 0
- 2025What Neuroscience Can Teach AI About Learning in Continuously Changing Environmentscited by 0
- 2025Dynamical stability for dense patterns in attractor neural networkscited by 0
- 2025State Space Models Naturally Produce Time Cell and Oscillatory Behaviors and Scale to Abstract Cognitive Functionscited by 0
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?cited by 0
- 2025Cycle is All You Need: More Is Differentcited by 0
- 2025MODE: Learning compositional representations of complex systems with Mixtures Of Dynamical Expertscited by 0
- 2025Emergence of hybrid computational dynamics through reinforcement learningcited by 0
- 2025Random matrix theory of sparse neuronal networks with heterogeneous timescalescited by 0
- 2026Paradoxical noise preference in RNNscited by 0
- 2026Learning Discrete Successor Transitions in Continuous Attractor Networks: Emergence, Limits, and Topological Constraintscited by 0
50 most cited of 61 All 61 (JSON)
- 2026Language Model Activations Inhabit Privileged Error-Correcting Basins3 Oct 2026
- 2026BIDETA: Brain-Inspired Data-Efficient Tactile Adaptation for Unseen Sensors8 Sep 2026
- 2026Divisive Normalization Shapes Low-Rank Slow Manifolds for Continuous Working Memory3 Aug 2026
- 2026SILVA Networks as Structured Implicit Layers and Vector Attractors via Dynamic Interaction Fields31 Jul 2026
- 2026HybridCodec: Modeling Discrete and Continuous Representations for Efficient Speech Language Models26 Jun 2026
- 2026Abstract representational geometry supports inference in large language models22 Jun 2026
- 2026Updating the standard neuron model in artificial neural networks19 May 2026
- 2026Do Sparse Autoencoders Capture Concept Manifolds?30 Apr 2026
- 2026Cortex-Inspired Continual Learning: Unsupervised Instantiation and Recovery of Functional Task Networks27 Apr 2026
- 2026Ordinary Least Squares is a Special Case of Transformer15 Apr 2026
- 2026Geometry-aware similarity metrics for neural representations on Riemannian and statistical manifolds30 Mar 2026
- 2026When and Where: A Model Hippocampal Network Unifies Formation of Time Cells and Place Cells22 Mar 2026
38 more
- 2026Neural Functional Alignment Space: Brain-Referenced Representation of Artificial Neural Networks28 Feb 2026
- 2026Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks16 Feb 2026
- 2026Embedding of Low-Dimensional Sensory Dynamics in Recurrent Networks: Implications for the Geometry of Neural Representation26 Jan 2026
- 2026Learning Discrete Successor Transitions in Continuous Attractor Networks: Emergence, Limits, and Topological Constraints20 Jan 2026
- 2026Paradoxical noise preference in RNNs8 Jan 2026
- 2025Random matrix theory of sparse neuronal networks with heterogeneous timescales14 Dec 2025
- 2025RNNs perform task computations by dynamically warping neural representations3 Dec 2025
- 2025Emergence of hybrid computational dynamics through reinforcement learning13 Oct 2025
- 2025MODE: Learning compositional representations of complex systems with Mixtures Of Dynamical Experts10 Oct 2025
- 2025Cycle is All You Need: More Is Different15 Sep 2025
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?13 Sep 2025
- 2025State Space Models Naturally Produce Time Cell and Oscillatory Behaviors and Scale to Abstract Cognitive Functions18 Jul 2025
- 2025Dynamical stability for dense patterns in attractor neural networks14 Jul 2025
- 2025What Neuroscience Can Teach AI About Learning in Continuously Changing Environments2 Jul 2025
- 2025High-resolution spatial memory requires grid-cell-like neural codes1 Jul 2025
- 2025Neural Langevin Machine: a local asymmetric learning rule can be creative30 Jun 2025
- 2025Dynamic Manifold Hopfield Networks for Context-Dependent Associative Memory2 Jun 2025
- 2025Self-orthogonalizing attractor neural networks emerging from the free energy principle28 May 2025
- 2025Sufficient conditions for offline reactivation in recurrent neural networks22 May 2025
- 2025Learning Dynamics of RNNs in Closed-Loop Environments19 May 2025
- 2025Improving World Models using Deep Supervision with Linear Probes4 Apr 2025
- 2025Allostatic Control of Persistent States in Spiking Neural Networks for perception and computation20 Mar 2025
- 2025Probing Latent Subspaces in LLM for AI Security: Identifying and Manipulating Adversarial States12 Mar 2025
- 2024Associative memory inspires improvements for in-context learning using a novel attention residual stream architecture19 Dec 2024
- 2024Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations1 Dec 2024
- 2024Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing22 Oct 2024
- 2024Spatial-Aware Decision-Making with Ring Attractors in Reinforcement Learning Systems4 Oct 2024
- 2024Computational Dynamical Systems18 Sep 2024
- 2024Neural timescales from a computational perspective4 Sep 2024
- 2024Time Makes Space: Emergence of Place Fields in Networks Encoding Temporally Continuous Sensory Experiences11 Aug 2024
- 2024Augmenting learning in neuro-embodied systems through neurobiological first principles5 Jul 2024
- 2024Learning in Wilson-Cowan model for metapopulation24 Jun 2024
- 2024Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardware2 May 2024
- 2024What is Intelligence? A Cycle Closure Perspective8 Apr 2024
- 2024Learning Sequence Attractors in Recurrent Networks with Hidden Neurons3 Apr 2024
- 2024Out-of-Domain Generalization in Dynamical Systems Reconstruction28 Feb 2024
- 2024DFORM: Diffeomorphic vector field alignment for assessing dynamics across learned models15 Feb 2024
- 2023Let's do the time-warp-attend: Learning topological invariants of dynamical systems14 Dec 2023
50 newest of 61 All 61 (JSON)
- 2026Do Sparse Autoencoders Capture Concept Manifolds?cited by 31
- 2026Do Sparse Autoencoders Capture Concept Manifolds?30 Apr 2026
- 2024Out-of-Domain Generalization in Dynamical Systems Reconstructioncited by 33
- 2023Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysiscited by 23
- 2024Representation Shattering in Transformers: A Synthetic Study with Knowledge Editingcited by 19
- 2023Interpretable statistical representations of neural population dynamics and geometrycited by 12
- 2023Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cellscited by 8
- 2023Sources of Richness and Ineffability for Phenomenally Conscious Statescited by 7
- 2022Expressive architectures enhance interpretability of dynamics-based neural population modelscited by 6
- 2023Persistent learning signals and working memory without continuous attractorscited by 6
- 2023Implicit Gaussian process representation of vector fields over arbitrary latent manifoldscited by 6
- 2024Time Makes Space: Emergence of Place Fields in Networks Encoding Temporally Continuous Sensory Experiencescited by 4
- 2024Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equationscited by 4
- 2024DFORM: Diffeomorphic vector field alignment for assessing dynamics across learned modelscited by 3
12 most cited of 54 All 54 (JSON)
- 2026Language Model Activations Inhabit Privileged Error-Correcting Basins3 Oct 2026
- 2026BIDETA: Brain-Inspired Data-Efficient Tactile Adaptation for Unseen Sensors8 Sep 2026
- 2026Divisive Normalization Shapes Low-Rank Slow Manifolds for Continuous Working Memory3 Aug 2026
- 2026SILVA Networks as Structured Implicit Layers and Vector Attractors via Dynamic Interaction Fields31 Jul 2026
- 2026HybridCodec: Modeling Discrete and Continuous Representations for Efficient Speech Language Models26 Jun 2026
- 2026Abstract representational geometry supports inference in large language models22 Jun 2026
- 2026Updating the standard neuron model in artificial neural networks19 May 2026
- 2026Ordinary Least Squares is a Special Case of Transformer15 Apr 2026
- 2026Geometry-aware similarity metrics for neural representations on Riemannian and statistical manifolds30 Mar 2026
- 2026When and Where: A Model Hippocampal Network Unifies Formation of Time Cells and Place Cells22 Mar 2026
- 2026Neural Functional Alignment Space: Brain-Referenced Representation of Artificial Neural Networks28 Feb 2026
- 2026Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks16 Feb 2026
12 newest of 54 All 54 (JSON)