Recurrent Network Models Of Sequence Generation And Memory
Not on the map. Why?
Abstract (arXiv)
Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in which a principled mechanism is pre-wired into their connectivity. Here we demonstrate that, starting from random connectivity and modifying a small fraction of connections, a largely disordered recur- rent network can produce sequences and implement working memory efficiently. We use this process, called Partial In-Network Training (PINning), to model and match cellular resolution imaging data from the posterior parietal cortex during a virtual memory- guided two-alternative forced-choice task. Analysis of the connectivity reveals that sequences propagate by the cooperation between recurrent synaptic interactions and external inputs, rather than through feedforward or asymmetric connections. Together our results suggest that neural sequences may emerge through learning from largely unstructured network architectures.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 1; 2023: 2; 2024: 4; 2025: 3; 2026: 5.
21 papers.
Sort:
By area:
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardwarecited by 19
- 2023Long Sequence Hopfield Memorycited by 16
- 2021DeepSITH: Efficient Learning via Decomposition of What and When Across Time Scalescited by 5
- 2024Multilevel Interpretability Of Artificial Neural Networks: Leveraging Framework And Methods From Neurosciencecited by 5
- 2025Uncovering the Computational Roles of Nonlinearity in Sequence Modeling Using Almost-Linear RNNscited by 5
- 2021Efficient and robust multi-task learning in the brain with modular latent primitivescited by 4
- 2022Spectrum of non-Hermitian deep-Hebbian neural networkscited by 4
- 2021Episodic memory governs choices: An RNN-based reinforcement learning model for decision-making taskcited by 2
- 2024Deep Continuous Networkscited by 2
- 2021Slow manifolds in recurrent networks encode working memory efficiently and robustlycited by 1
- 2024Learning Sequence Attractors in Recurrent Networks with Hidden Neuronscited by 1
- 2025A ghost mechanism: An analytical model of abrupt learning in recurrent networkscited by 1
9 more
- 2021Bubblewrap: Online tiling and real-time flow prediction on neural manifoldscited by 0
- 2023A Versatile Hub Model For Efficient Information Propagation And Feature Selectioncited by 0
- 2024Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networkscited by 0
- 2025Dissecting Larval Zebrafish Hunting using Deep Reinforcement Learning Trained RNN Agentscited by 0
- 2026Hierarchical temporal receptive windows and zero-shot timescale generalization in biologically constrained scale-invariant deep networkscited by 0
- 2026Systems Explaining Systems: A Framework for Intelligence and Consciousnesscited by 0
- 2026Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networkscited by 0
- 2026Identifying Connectivity Distributions from Neural Dynamics Using Flowscited by 0
- 2026When and Where: A Model Hippocampal Network Unifies Formation of Time Cells and Place Cellscited by 0
- 2026Identifying Connectivity Distributions from Neural Dynamics Using Flows27 Mar 2026
- 2026When and Where: A Model Hippocampal Network Unifies Formation of Time Cells and Place Cells22 Mar 2026
- 2026Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks16 Feb 2026
- 2026Systems Explaining Systems: A Framework for Intelligence and Consciousness7 Jan 2026
- 2026Hierarchical temporal receptive windows and zero-shot timescale generalization in biologically constrained scale-invariant deep networks6 Jan 2026
- 2025Dissecting Larval Zebrafish Hunting using Deep Reinforcement Learning Trained RNN Agents4 Oct 2025
- 2025Uncovering the Computational Roles of Nonlinearity in Sequence Modeling Using Almost-Linear RNNs9 Jun 2025
- 2025A ghost mechanism: An analytical model of abrupt learning in recurrent networks4 Jan 2025
- 2024Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks4 Oct 2024
- 2024Multilevel Interpretability Of Artificial Neural Networks: Leveraging Framework And Methods From Neuroscience22 Aug 2024
- 2024Learning Sequence Attractors in Recurrent Networks with Hidden Neurons3 Apr 2024
- 2024Deep Continuous Networks2 Feb 2024
9 more
- 2023A Versatile Hub Model For Efficient Information Propagation And Feature Selection5 Jul 2023
- 2023Long Sequence Hopfield Memory7 Jun 2023
- 2022Spectrum of non-Hermitian deep-Hebbian neural networks24 Aug 2022
- 2021Bubblewrap: Online tiling and real-time flow prediction on neural manifolds31 Aug 2021
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware13 Jun 2021
- 2021Efficient and robust multi-task learning in the brain with modular latent primitives28 May 2021
- 2021DeepSITH: Efficient Learning via Decomposition of What and When Across Time Scales9 Apr 2021
- 2021Episodic memory governs choices: An RNN-based reinforcement learning model for decision-making task24 Jan 2021
- 2021Slow manifolds in recurrent networks encode working memory efficiently and robustly8 Jan 2021
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardwarecited by 19
- 2023Long Sequence Hopfield Memorycited by 16
- 2021DeepSITH: Efficient Learning via Decomposition of What and When Across Time Scalescited by 5
- 2024Multilevel Interpretability Of Artificial Neural Networks: Leveraging Framework And Methods From Neurosciencecited by 5
- 2025Uncovering the Computational Roles of Nonlinearity in Sequence Modeling Using Almost-Linear RNNscited by 5
- 2021Efficient and robust multi-task learning in the brain with modular latent primitivescited by 4
- 2022Spectrum of non-Hermitian deep-Hebbian neural networkscited by 4
- 2021Episodic memory governs choices: An RNN-based reinforcement learning model for decision-making taskcited by 2
- 2024Deep Continuous Networkscited by 2
- 2021Slow manifolds in recurrent networks encode working memory efficiently and robustlycited by 1
- 2024Learning Sequence Attractors in Recurrent Networks with Hidden Neuronscited by 1
- 2025A ghost mechanism: An analytical model of abrupt learning in recurrent networkscited by 1
12 most cited of 20 All 20 (JSON)
- 2026Identifying Connectivity Distributions from Neural Dynamics Using Flows27 Mar 2026
- 2026When and Where: A Model Hippocampal Network Unifies Formation of Time Cells and Place Cells22 Mar 2026
- 2026Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks16 Feb 2026
- 2026Systems Explaining Systems: A Framework for Intelligence and Consciousness7 Jan 2026
- 2026Hierarchical temporal receptive windows and zero-shot timescale generalization in biologically constrained scale-invariant deep networks6 Jan 2026
- 2025Uncovering the Computational Roles of Nonlinearity in Sequence Modeling Using Almost-Linear RNNs9 Jun 2025
- 2025A ghost mechanism: An analytical model of abrupt learning in recurrent networks4 Jan 2025
- 2024Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks4 Oct 2024
- 2024Multilevel Interpretability Of Artificial Neural Networks: Leveraging Framework And Methods From Neuroscience22 Aug 2024
- 2024Learning Sequence Attractors in Recurrent Networks with Hidden Neurons3 Apr 2024
- 2024Deep Continuous Networks2 Feb 2024
- 2023A Versatile Hub Model For Efficient Information Propagation And Feature Selection5 Jul 2023
12 newest of 20 All 20 (JSON)