Synergistic pathways of modulation enable robust task packing within neural dynamics
Not on the map. Why?
Abstract (arXiv)
Understanding how brain networks learn and manage multiple tasks simultaneously is of interest in both neuroscience and artificial intelligence. In this regard, a recent research thread in theoretical neuroscience has focused on how recurrent neural network models and their internal dynamics enact multi-task learning. To manage different tasks requires a mechanism to convey information about task identity or context into the model, which from a biological perspective may involve mechanisms of neuromodulation. In this study, we use recurrent network models to probe the distinctions between two forms of contextual modulation of neural dynamics, at the level of neuronal excitability and at the level of synaptic strength. We characterize these mechanisms in terms of their functional outcomes, focusing on their robustness to context ambiguity and, relatedly, their efficiency with respect to packing multiple tasks into finite size networks. We also demonstrate distinction between these mechanisms at the level of the neuronal dynamics they induce. Together, these characterizations indicate complementarity and synergy in how these mechanisms act, potentially over multiple time-scales, toward enhancing robustness of multi-task learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 28 references that are in the map. First posted on arXiv 2 Aug 2024.
Builds on
6 of 28 references.
References · 6
- 2016Using Fast Weights to Attend to the Recent Pastcited by 170
- 2018Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilizationcited by 104
- 2017Linking connectivity, dynamics and computations in low-rank recurrent neural networkscited by 51
- 2020Theory of gating in recurrent neural networkscited by 19
- 2019Gated Embeddings in End-to-End Speech Recognition for Conversational-Context Fusioncited by 14
- 2022Contextual guidance: An integrated theory for astrocytes function in brain circuits and behaviorcited by 6
Built on by
Not cited yet.