Dendritic cortical microcircuits approximate the backpropagation algorithm
Not on the map. Why?
Abstract (arXiv)
Deep learning has seen remarkable developments over the last years, many of them inspired by neuroscience. However, the main learning mechanism behind these advances - error backpropagation - appears to be at odds with neurobiology. Here, we introduce a multilayer neuronal network model with simplified dendritic compartments in which error-driven synaptic plasticity adapts the network towards a global desired output. In contrast to previous work our model does not require separate phases and synaptic learning is driven by local dendritic prediction errors continuously in time. Such errors originate at apical dendrites and occur due to a mismatch between predictive input from lateral interneurons and activity from actual top-down feedback. Through the use of simple dendritic compartments and different cell-types our model can represent both error and normal activity within a pyramidal neuron. We demonstrate the learning capabilities of the model in regression and classification tasks, and show analytically that it approximates the error backpropagation algorithm. Moreover, our framework is consistent with recent observations of learning between brain areas and the architecture of cortical microcircuits. Overall, we introduce a novel view of learning on dendritic cortical circuits and on how the brain may solve the long-standing synaptic credit assignment problem.
Key facts. Cited by 97 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 20; 2023: 22; 2024: 13; 2025: 12; 2026: 10.
97 papers.
Sort:
By area:
- 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 77
- 2022Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillationscited by 42
- 2021Accurate online training of dynamical spiking neural networks through Forward Propagation Through Timecited by 34
- 2022Learning on Arbitrary Graph Topologies via Predictive Codingcited by 33
- 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
- 2021Credit Assignment in Neural Networks through Deep Feedback Controlcited by 29
- 2021Self-learning Machines based on Hamiltonian Echo Backpropagationcited by 28
- 2021Reverse Differentiation via Predictive Codingcited by 23
- 2022A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networkscited by 22
- 2021Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligencecited by 21
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardwarecited by 19
- 2022Single-phase deep learning in cortico-cortical networkscited by 19
38 more
- 2022The least-control principle for local learning at equilibriumcited by 16
- 2021Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neuronscited by 15
- 2023How connectivity structure shapes rich and lazy learning in neural circuitscited by 15
- 2021A contrastive rule for meta-learningcited by 14
- 2022Meta-Learning Biologically Plausible Plasticity Rules with Random Feedback Pathwayscited by 14
- 2023Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neuronscited by 14
- 2022Learning by non-interfering feedback chemical signaling in physical networkscited by 11
- 2021The Yin-Yang datasetcited by 10
- 2021Learning cortical representations through perturbed and adversarial dreamingcited by 10
- 2022Minimizing Control for Credit Assignment with Strong Feedbackcited by 10
- 2024Backpropagation through space, time, and the braincited by 10
- 2022Constrained Parameter Inference as a Principle for Learningcited by 9
- 2023Improving equilibrium propagation without weight symmetry through Jacobian homeostasiscited by 9
- 2021A Normative and Biologically Plausible Algorithm for Independent Component Analysiscited by 8
- 2022Learning efficient backprojections across cortical hierarchies in real timecited by 8
- 2023Predictive Coding as a Neuromorphic Alternative to Backpropagation: A Critical Evaluationcited by 8
- 2023A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functionscited by 8
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Surveycited by 8
- 2021Learning through structure: towards deep neuromorphic knowledge graph embeddingscited by 7
- 2023Leveraging dendritic properties to advance machine learning and neuro-inspired computingcited by 6
- 2024Gradient-Free Training of Recurrent Neural Networks using Random Perturbationscited by 6
- 2021How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorizationcited by 5
- 2022DELAUNAY: a dataset of abstract art for psychophysical and machine learning researchcited by 5
- 2022Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processingcited by 5
- 2022Unlocking the potential of two-point cells for energy-efficient and resilient training of deep netscited by 5
- 2023A Sparse Quantized Hopfield Network for Online-Continual Memorycited by 5
- 2021Assemblies of neurons learn to classify well-separated distributionscited by 4
- 2021Cortico-cerebellar networks as decoupling neural interfacescited by 4
- 2023Hebbian and Gradient-based Plasticity Enables Robust Memory and Rapid Learning in RNNscited by 4
- 2023Normative framework for deriving neural networks with multi-compartmental neurons and non-Hebbian plasticitycited by 4
- 2021A New Look at Spike-Timing-Dependent Plasticity Networks for Spatio-Temporal Feature Learningcited by 3
- 2021BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networkscited by 3
- 2022Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rulescited by 3
- 2023Multi-compartment Neuron and Population Encoding Powered Spiking Neural Network for Deep Distributional Reinforcement Learningcited by 3
- 2023Computation with Sequences in a Model of the Braincited by 3
- 2023Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetrycited by 3
- 2024LightFF: Lightweight Inference for Forward-Forward Algorithmcited by 3
- 2024An Overlooked Role of Context-Sensitive Dendritescited by 3
50 most cited of 97 All 97 (JSON)
- 2026Increasing Width Allows Greedy Layer-wise Training to Rival End-to-End Backpropagation in Self-Supervised Learning30 Sep 2026
- 2026Learning in Deep Networks under Dale's Constraint7 Aug 2026
- 2026Dendritic In-Context Learning in a Single-Layer Spiking Neural Network2 Jul 2026
- 2026Diffusing Blame: Task-Dependent Credit Assignment in Biologically Plausible Dual-Stream Networks30 Jun 2026
- 2026Ontology-constrained multi-LLM scoring of hypothesis support in the predictive processing literature23 May 2026
- 2026Self-supervised local learning rules learn the hidden hierarchical structure of high-dimensional data18 May 2026
- 2026Mistake gating leads to energy and memory efficient continual learning15 Apr 2026
- 2026Scalable Machines with Intrinsic Higher Mental-State Dynamics13 Mar 2026
- 2026A feedback control optimizer for online and hardware-aware training of Spiking Neural Networks3 Feb 2026
- 2026Can Local Learning Match Self-Supervised Backpropagation?29 Jan 2026
- 2025Dopamine-driven synaptic credit assignment in neural networks25 Oct 2025
- 2025A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation21 Oct 2025
38 more
- 2025Does Feedback Alignment Work at Biological Timescales?21 Oct 2025
- 2025Single layer tiny Co4 outpaces GPT-2 and GPT-BERT9 Oct 2025
- 2025Toward Practical Equilibrium Propagation: Brain-inspired Recurrent Neural Network with Feedback Regulation and Residual Connections5 Aug 2025
- 2025Edge Intelligence with Spiking Neural Networks18 Jul 2025
- 2025The role of gain neuromodulation in layer-5 pyramidal neurons3 Jul 2025
- 2025Can Biologically Plausible Temporal Credit Assignment Rules Match BPTT for Neural Similarity? E-prop as an Example7 Jun 2025
- 2025Stochastic Layer-wise Learning: Scalable and Efficient Alternative to Backpropagation8 May 2025
- 2025Beyond Attention: Toward Machines with Intrinsic Higher Mental States2 May 2025
- 2025Spike-based alignment learning solves the weight transport problem4 Mar 2025
- 2025Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics12 Jan 2025
- 2024From Worms to Mice: Homeostasis Maybe All You Need28 Dec 2024
- 2024What should a neuron aim for? Designing local objective functions based on information theory3 Dec 2024
- 2024A Unified Framework for Neural Computation and Learning Over Time18 Sep 2024
- 2024An Overlooked Role of Context-Sensitive Dendrites20 Aug 2024
- 2024Augmenting learning in neuro-embodied systems through neurobiological first principles5 Jul 2024
- 2024Deep Learning without Weight Symmetry31 May 2024
- 2024EchoSpike Predictive Plasticity: An Online Local Learning Rule for Spiking Neural Networks22 May 2024
- 2024Gradient-Free Training of Recurrent Neural Networks using Random Perturbations14 May 2024
- 2024LightFF: Lightweight Inference for Forward-Forward Algorithm8 Apr 2024
- 2024Backpropagation through space, time, and the brain25 Mar 2024
- 2024ELiSe: Efficient Learning of Sequences in Structured Recurrent Networks26 Feb 2024
- 2024Two Tales of Single-Phase Contrastive Hebbian Learning13 Feb 2024
- 2024Nature-Inspired Local Propagation4 Feb 2024
- 2023Dis-inhibitory neuronal circuits can control the sign of synaptic plasticity30 Oct 2023
- 2023How connectivity structure shapes rich and lazy learning in neural circuits12 Oct 2023
- 2023Intrinsic Biologically Plausible Adversarial Robustness29 Sep 2023
- 2023Meta predictive learning model of languages in neural circuits8 Sep 2023
- 2023Improving equilibrium propagation without weight symmetry through Jacobian homeostasis5 Sep 2023
- 2023Brain-inspired Computational Intelligence via Predictive Coding15 Aug 2023
- 2023Duality Principle and Biologically Plausible Learning: Connecting the Representer Theorem and Hebbian Learning2 Aug 2023
- 2023Unlocking the Potential of Similarity Matching: Scalability, Supervision and Pre-training2 Aug 2023
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey30 Jul 2023
- 2023A Sparse Quantized Hopfield Network for Online-Continual Memory27 Jul 2023
- 2023UIT-Saviors at MEDVQA-GI 2023: Improving Multimodal Learning with Image Enhancement for Gastrointestinal Visual Question Answering6 Jul 2023
- 2023Leveraging dendritic properties to advance machine learning and neuro-inspired computing13 Jun 2023
- 2023Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetry7 Jun 2023
- 2023Computation with Sequences in a Model of the Brain6 Jun 2023
- 2023A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions3 Jun 2023
50 newest of 97 All 97 (JSON)
- 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 77
- 2022Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillationscited by 42
- 2021Accurate online training of dynamical spiking neural networks through Forward Propagation Through Timecited by 34
- 2022Learning on Arbitrary Graph Topologies via Predictive Codingcited by 33
- 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
- 2021Credit Assignment in Neural Networks through Deep Feedback Controlcited by 29
- 2021Self-learning Machines based on Hamiltonian Echo Backpropagationcited by 28
- 2021Reverse Differentiation via Predictive Codingcited by 23
- 2022A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networkscited by 22
- 2021Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligencecited by 21
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardwarecited by 19
- 2022Single-phase deep learning in cortico-cortical networkscited by 19
12 most cited of 95 All 95 (JSON)
- 2026Increasing Width Allows Greedy Layer-wise Training to Rival End-to-End Backpropagation in Self-Supervised Learning30 Sep 2026
- 2026Learning in Deep Networks under Dale's Constraint7 Aug 2026
- 2026Dendritic In-Context Learning in a Single-Layer Spiking Neural Network2 Jul 2026
- 2026Ontology-constrained multi-LLM scoring of hypothesis support in the predictive processing literature23 May 2026
- 2026Self-supervised local learning rules learn the hidden hierarchical structure of high-dimensional data18 May 2026
- 2026Mistake gating leads to energy and memory efficient continual learning15 Apr 2026
- 2026A feedback control optimizer for online and hardware-aware training of Spiking Neural Networks3 Feb 2026
- 2026Can Local Learning Match Self-Supervised Backpropagation?29 Jan 2026
- 2025Dopamine-driven synaptic credit assignment in neural networks25 Oct 2025
- 2025A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation21 Oct 2025
- 2025Does Feedback Alignment Work at Biological Timescales?21 Oct 2025
- 2025Single layer tiny Co4 outpaces GPT-2 and GPT-BERT9 Oct 2025
12 newest of 95 All 95 (JSON)