Linking connectivity, dynamics and computations in low-rank recurrent neural networks
Not on the map. Why?
Abstract (arXiv)
Large scale neural recordings have established that the transformation of sensory stimuli into motor outputs relies on low-dimensional dynamics at the population level, while individual neurons exhibit complex selectivity. Understanding how low-dimensional computations on mixed, distributed representations emerge from the structure of the recurrent connectivity and inputs to cortical networks is a major challenge. Here, we study a class of recurrent network models in which the connectivity is a sum of a random part and a minimal, low-dimensional structure. We show that, in such networks, the dynamics are low dimensional and can be directly inferred from connectivity using a geometrical approach. We exploit this understanding to determine minimal connectivity required to implement specific computations, and find that the dynamical range and computational capacity quickly increase with the dimensionality of the connectivity structure. This framework produces testable experimental predictions for the relationship between connectivity, low-dimensional dynamics and computational features of recorded neurons.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 2; 2023: 10; 2024: 7; 2025: 10; 2026: 18.
51 papers.
Sort:
By area:
- 2023How connectivity structure shapes rich and lazy learning in neural circuitscited by 15
- 2024Inferring stochastic low-rank recurrent neural networks from neural datacited by 15
- 2023Interpretable statistical representations of neural population dynamics and geometrycited by 12
- 2023Low Tensor Rank Learning of Neural Dynamicscited by 12
- 2022Input correlations impede suppression of chaos and learning in balanced rate networkscited by 3
- 2024DFORM: Diffeomorphic vector field alignment for assessing dynamics across learned modelscited by 3
- 2024Neural timescales from a computational perspectivecited by 3
- 2021Ensemble perspective for understanding temporal credit assignmentcited by 2
- 2021Bayesian reconstruction of memories stored in neural networks from their connectivitycited by 2
- 2023Trainability, Expressivity and Interpretability in Gated Neural ODEscited by 2
- 2023Fading memory as inductive bias in residual recurrent networkscited by 2
- 2023Characterising representation dynamics in recurrent neural networks for object recognitioncited by 2
38 more
- 2023Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Controlcited by 2
- 2024Deep Continuous Networkscited by 2
- 2025Ultralow-dimensionality reduction for identifying critical transitions by spatial-temporal PCAcited by 2
- 2025Learning Dynamics of RNNs in Closed-Loop Environmentscited by 2
- 2026Diagnosing Generalization Failures from Representational Geometry Markerscited by 2
- 2026The Global Empirical NTK: Self-Referential Bias and Dimensionality of Gradient Descent Learningcited by 2
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modelingcited by 2
- 2021Slow manifolds in recurrent networks encode working memory efficiently and robustlycited by 1
- 2021A brain basis of dynamical intelligence for AI and computational neurosciencecited by 1
- 2022The impact of memory on learning sequence-to-sequence taskscited by 1
- 2023Spiking mode-based neural networkscited by 1
- 2023Astrocytes as a mechanism for meta-plasticity and contextually-guided network functioncited by 1
- 2025A ghost mechanism: An analytical model of abrupt learning in recurrent networkscited by 1
- 2025Category learning in deep neural networks: Information content and geometry of internal representationscited by 1
- 2025A Factorized Low-Rank RNN Framework for Uncovering Independent Neural Latent Dynamics and Connectivitycited by 1
- 2025RNNs perform task computations by dynamically warping neural representationscited by 1
- 2026Learning reveals invisible structure in low-rank RNNscited by 1
- 2026Extracting Governing Equations from Latent Dynamics via Multi-View Contrastive Learningcited by 1
- 2023Decoding Neuronal Networks: A Reservoir Computing Approach for Predicting Connectivity and Functionalitycited by 0
- 2024Synergistic pathways of modulation enable robust task packing within neural dynamicscited by 0
- 2024Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networkscited by 0
- 2024Storing overlapping associative memories on latent manifolds in low-rank spiking networkscited by 0
- 2025Dynamic Manifold Hopfield Networks for Context-Dependent Associative Memorycited by 0
- 2025High-resolution spatial memory requires grid-cell-like neural codescited by 0
- 2025Dynamical stability for dense patterns in attractor neural networkscited by 0
- 2025Mechanistic Interpretability of RNNs emulating Hidden Markov Modelscited by 0
- 2026Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networkscited by 0
- 2026JEDI: Jointly Embedded Inference of Neural Dynamicscited by 0
- 2026Identifying Connectivity Distributions from Neural Dynamics Using Flowscited by 0
- 2026Center-Manifold Reduction of Learning at Bifurcations: Interference and Rich Learning in Recurrent Neural Networkscited by 0
- 2026Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundationscited by 0
- 2026Dynamics and Representation Structure of Local Approximations to Gradient-Based Learning in Linear Recurrent Neural Networkscited by 0
- 2026Finite-Lag Operator Geometry of Recurrent Representationscited by 0
- 2026Motif-Mamba: network motif improved mamba for long-range sequence modelingcited by 0
- 2026Divisive Normalization Shapes Low-Rank Slow Manifolds for Continuous Working Memorycited by 0
- 2026Certified Inference and Training for Deep Equilibrium Networks: A Continuation Framework with Polynomial Complexity Guaranteescited by 0
- 2026Learning-Induced Dynamical Transition in Recurrent Neural Networkscited by 0
- 2026A neural network that maintains and retrieves memories based on contextcited by 0
50 most cited of 51 All 51 (JSON)
- 2026Linear Recurrent Memory Suffices to Distil a World-Model Policy for Robot Air Hockey30 Sep 2026
- 2026A neural network that maintains and retrieves memories based on context29 Sep 2026
- 2026Learning-Induced Dynamical Transition in Recurrent Neural Networks16 Sep 2026
- 2026Certified Inference and Training for Deep Equilibrium Networks: A Continuation Framework with Polynomial Complexity Guarantees15 Sep 2026
- 2026Divisive Normalization Shapes Low-Rank Slow Manifolds for Continuous Working Memory3 Aug 2026
- 2026Motif-Mamba: network motif improved mamba for long-range sequence modeling14 Jul 2026
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling5 Jul 2026
- 2026Finite-Lag Operator Geometry of Recurrent Representations2 Jul 2026
- 2026Extracting Governing Equations from Latent Dynamics via Multi-View Contrastive Learning11 Jun 2026
- 2026Dynamics and Representation Structure of Local Approximations to Gradient-Based Learning in Linear Recurrent Neural Networks29 May 2026
- 2026Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations25 May 2026
- 2026Center-Manifold Reduction of Learning at Bifurcations: Interference and Rich Learning in Recurrent Neural Networks12 May 2026
38 more
- 2026The Global Empirical NTK: Self-Referential Bias and Dimensionality of Gradient Descent Learning9 May 2026
- 2026Learning reveals invisible structure in low-rank RNNs5 May 2026
- 2026Identifying Connectivity Distributions from Neural Dynamics Using Flows27 Mar 2026
- 2026JEDI: Jointly Embedded Inference of Neural Dynamics11 Mar 2026
- 2026Diagnosing Generalization Failures from Representational Geometry Markers2 Mar 2026
- 2026Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks16 Feb 2026
- 2025RNNs perform task computations by dynamically warping neural representations3 Dec 2025
- 2025A Factorized Low-Rank RNN Framework for Uncovering Independent Neural Latent Dynamics and Connectivity17 Nov 2025
- 2025Mechanistic Interpretability of RNNs emulating Hidden Markov Models29 Oct 2025
- 2025Category learning in deep neural networks: Information content and geometry of internal representations21 Oct 2025
- 2025Dynamical stability for dense patterns in attractor neural networks14 Jul 2025
- 2025High-resolution spatial memory requires grid-cell-like neural codes1 Jul 2025
- 2025Dynamic Manifold Hopfield Networks for Context-Dependent Associative Memory2 Jun 2025
- 2025Learning Dynamics of RNNs in Closed-Loop Environments19 May 2025
- 2025Ultralow-dimensionality reduction for identifying critical transitions by spatial-temporal PCA22 Jan 2025
- 2025A ghost mechanism: An analytical model of abrupt learning in recurrent networks4 Jan 2025
- 2024Storing overlapping associative memories on latent manifolds in low-rank spiking networks26 Nov 2024
- 2024Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks4 Oct 2024
- 2024Neural timescales from a computational perspective4 Sep 2024
- 2024Synergistic pathways of modulation enable robust task packing within neural dynamics2 Aug 2024
- 2024Inferring stochastic low-rank recurrent neural networks from neural data24 Jun 2024
- 2024DFORM: Diffeomorphic vector field alignment for assessing dynamics across learned models15 Feb 2024
- 2024Deep Continuous Networks2 Feb 2024
- 2023Astrocytes as a mechanism for meta-plasticity and contextually-guided network function6 Nov 2023
- 2023Decoding Neuronal Networks: A Reservoir Computing Approach for Predicting Connectivity and Functionality6 Nov 2023
- 2023Spiking mode-based neural networks23 Oct 2023
- 2023How connectivity structure shapes rich and lazy learning in neural circuits12 Oct 2023
- 2023Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control5 Oct 2023
- 2023Characterising representation dynamics in recurrent neural networks for object recognition23 Aug 2023
- 2023Low Tensor Rank Learning of Neural Dynamics22 Aug 2023
- 2023Fading memory as inductive bias in residual recurrent networks27 Jul 2023
- 2023Trainability, Expressivity and Interpretability in Gated Neural ODEs12 Jul 2023
- 2023Interpretable statistical representations of neural population dynamics and geometry6 Apr 2023
- 2022The impact of memory on learning sequence-to-sequence tasks29 May 2022
- 2022Input correlations impede suppression of chaos and learning in balanced rate networks24 Jan 2022
- 2021Bayesian reconstruction of memories stored in neural networks from their connectivity16 May 2021
- 2021A brain basis of dynamical intelligence for AI and computational neuroscience15 May 2021
- 2021Ensemble perspective for understanding temporal credit assignment7 Feb 2021
50 newest of 51 All 51 (JSON)
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modelingcited by 2
- 2026Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundationscited by 0
- 2026Linear Recurrent Memory Suffices to Distil a World-Model Policy for Robot Air Hockeycited by 0
- 2026Linear Recurrent Memory Suffices to Distil a World-Model Policy for Robot Air Hockey30 Sep 2026
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling5 Jul 2026
- 2026Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations25 May 2026
- 2023How connectivity structure shapes rich and lazy learning in neural circuitscited by 15
- 2024Inferring stochastic low-rank recurrent neural networks from neural datacited by 15
- 2023Interpretable statistical representations of neural population dynamics and geometrycited by 12
- 2023Low Tensor Rank Learning of Neural Dynamicscited by 12
- 2022Input correlations impede suppression of chaos and learning in balanced rate networkscited by 3
- 2024DFORM: Diffeomorphic vector field alignment for assessing dynamics across learned modelscited by 3
- 2024Neural timescales from a computational perspectivecited by 3
- 2021Ensemble perspective for understanding temporal credit assignmentcited by 2
- 2021Bayesian reconstruction of memories stored in neural networks from their connectivitycited by 2
- 2023Trainability, Expressivity and Interpretability in Gated Neural ODEscited by 2
- 2023Fading memory as inductive bias in residual recurrent networkscited by 2
- 2023Characterising representation dynamics in recurrent neural networks for object recognitioncited by 2
12 most cited of 47 All 47 (JSON)
- 2026A neural network that maintains and retrieves memories based on context29 Sep 2026
- 2026Learning-Induced Dynamical Transition in Recurrent Neural Networks16 Sep 2026
- 2026Certified Inference and Training for Deep Equilibrium Networks: A Continuation Framework with Polynomial Complexity Guarantees15 Sep 2026
- 2026Divisive Normalization Shapes Low-Rank Slow Manifolds for Continuous Working Memory3 Aug 2026
- 2026Finite-Lag Operator Geometry of Recurrent Representations2 Jul 2026
- 2026Extracting Governing Equations from Latent Dynamics via Multi-View Contrastive Learning11 Jun 2026
- 2026Dynamics and Representation Structure of Local Approximations to Gradient-Based Learning in Linear Recurrent Neural Networks29 May 2026
- 2026Center-Manifold Reduction of Learning at Bifurcations: Interference and Rich Learning in Recurrent Neural Networks12 May 2026
- 2026The Global Empirical NTK: Self-Referential Bias and Dimensionality of Gradient Descent Learning9 May 2026
- 2026Learning reveals invisible structure in low-rank RNNs5 May 2026
- 2026Identifying Connectivity Distributions from Neural Dynamics Using Flows27 Mar 2026
- 2026JEDI: Jointly Embedded Inference of Neural Dynamics11 Mar 2026
12 newest of 47 All 47 (JSON)