mlsanityData to 14 Oct 2026

Cortico-cerebellar networks as decoupling neural interfaces

arXiv 2110.11501 ↗First posted 21 Oct 2021q-bio.NC cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

The brain solves the credit assignment problem remarkably well. For credit to be assigned across neural networks they must, in principle, wait for specific neural computations to finish. How the brain deals with this inherent locking problem has remained unclear. Deep learning methods suffer from similar locking constraints both on the forward and feedback phase. Recently, decoupled neural interfaces (DNIs) were introduced as a solution to the forward and feedback locking problems in deep networks. Here we propose that a specialised brain region, the cerebellum, helps the cerebral cortex solve similar locking problems akin to DNIs. To demonstrate the potential of this framework we introduce a systems-level model in which a recurrent cortical network receives online temporal feedback predictions from a cerebellar module. We test this cortico-cerebellar recurrent neural network (ccRNN) model on a number of sensorimotor (line and digit drawing) and cognitive tasks (pattern recognition and caption generation) that have been shown to be cerebellar-dependent. In all tasks, we observe that ccRNNs facilitates learning while reducing ataxia-like behaviours, consistent with classical experimental observations. Moreover, our model also explains recent behavioural and neuronal observations while making several testable predictions across multiple levels. Overall, our work offers a novel perspective on the cerebellum as a brain-wide decoupling machine for efficient credit assignment and opens a new avenue between deep learning and neuroscience.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 18 of its 80 references that are in the map. First posted on arXiv 21 Oct 2021.

Builds on

18 of 80 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  5. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  6. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 824
  7. 2014Difference Target Propagationcited by 148
  8. 2016Decoupled Neural Interfaces using Synthetic Gradientscited by 137
  9. 2015A Simple Way to Initialize Recurrent Networks of Rectified Linear Unitscited by 130
  10. 2018Dendritic cortical microcircuits approximate the backpropagation algorithmcited by 97
  11. 2016Towards an integration of deep learning and neurosciencecited by 78
  12. 2019Decoupled Greedy Learning of CNNscited by 78
6 more
  1. 2016Towards deep learning with segregated dendritescited by 71
  2. 2019Biologically inspired alternatives to backpropagation through time for learning in recurrent neural netscited by 20
  3. 2020GAIT-prop: A biologically plausible learning rule derived from backpropagation of errorcited by 15
  4. 2019Fully Decoupled Neural Network Learning Using Delayed Gradientscited by 12
  5. 2017Cortical microcircuits as gated-recurrent neural networkscited by 6
  6. 2018Local Critic Training of Deep Neural Networkscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 0; 2024: 1; 2025: 0; 2026: 2.

4 papers.