The brain as an efficient and robust adaptive learner
Not on the map. Why?
Abstract (arXiv)
Understanding how the brain learns to compute functions reliably, efficiently and robustly with noisy spiking activity is a fundamental challenge in neuroscience. Most sensory and motor tasks can be described as dynamical systems and could presumably be learned by adjusting connection weights in a recurrent biological neural network. However, this is greatly complicated by the credit assignment problem for learning in recurrent network, e.g. the contribution of each connection to the global output error cannot be determined based only on locally accessible quantities to the synapse. Combining tools from adaptive control theory and efficient coding theories, we propose that neural circuits can indeed learn complex dynamic tasks with local synaptic plasticity rules as long as they associate two experimentally established neural mechanisms. First, they should receive top-down feedbacks driving both their activity and their synaptic plasticity. Second, inhibitory interneurons should maintain a tight balance between excitation and inhibition in the circuit. The resulting networks could learn arbitrary dynamical systems and produce irregular spike trains as variable as those observed experimentally. Yet, this variability in single neurons may hide an extremely efficient and robust computation at the population level.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 0; 2024: 1.
11 papers.
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2021Credit Assignment in Neural Networks through Deep Feedback Controlcited by 28
- 2022The least-control principle for local learning at equilibriumcited by 16
- 2022Minimizing Control for Credit Assignment with Strong Feedbackcited by 10
- 2024Do Large Language Models Mirror Cognitive Language Processing?cited by 9
- 2021A Normative and Biologically Plausible Algorithm for Independent Component Analysiscited by 8
- 2021Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processorscited by 7
- 2022A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformerscited by 7
- 2022An Extension to Basis-Hypervectors for Learning from Circular Data in Hyperdimensional Computingcited by 4
- 2022Closed-form control with spike coding networkscited by 4
- 2021BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networkscited by 3
- 2024Do Large Language Models Mirror Cognitive Language Processing?28 Feb 2024
- 2022Closed-form control with spike coding networks25 Dec 2022
- 2022The least-control principle for local learning at equilibrium4 Jul 2022
- 2022A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformers20 May 2022
- 2022An Extension to Basis-Hypervectors for Learning from Circular Data in Hyperdimensional Computing16 May 2022
- 2022Minimizing Control for Credit Assignment with Strong Feedback14 Apr 2022
- 2021A Normative and Biologically Plausible Algorithm for Independent Component Analysis17 Nov 2021
- 2021BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks14 Nov 2021
- 2021Training Spiking Neural Networks Using Lessons From Deep Learning27 Sep 2021
- 2021Credit Assignment in Neural Networks through Deep Feedback Control15 Jun 2021
- 2021Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors12 Feb 2021