Towards deep learning with segregated dendrites
Not on the map. Why?
Abstract (arXiv)
Deep learning has led to significant advances in artificial intelligence, in part, by adopting strategies motivated by neurophysiology. However, it is unclear whether deep learning could occur in the real brain. Here, we show that a deep learning algorithm that utilizes multi-compartment neurons might help us to understand how the brain optimizes cost functions. Like neocortical pyramidal neurons, neurons in our model receive sensory information and higher-order feedback in electrotonically segregated compartments. Thanks to this segregation, the neurons in different layers of the network can coordinate synaptic weight updates. As a result, the network can learn to categorize images better than a single layer network. Furthermore, we show that our algorithm takes advantage of multilayer architectures to identify useful representations---the hallmark of deep learning. This work demonstrates that deep learning can be achieved using segregated dendritic compartments, which may help to explain the dendritic morphology of neocortical pyramidal neurons.
Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 17; 2023: 10; 2024: 8; 2025: 11; 2026: 7.
71 papers.
Sort:
By area:
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
- 2021Credit Assignment in Neural Networks through Deep Feedback Controlcited by 29
- 2022Signal Propagation: A Framework for Learning and Inference In a Forward Passcited by 24
- 2021Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligencecited by 21
- 2021Capturing the objects of vision with neural networkscited by 21
- 2022Single-phase deep learning in cortico-cortical networkscited by 19
- 2022The least-control principle for local learning at equilibriumcited by 16
- 2021Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neuronscited by 15
- 2021A contrastive rule for meta-learningcited by 14
- 2023Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neuronscited by 14
38 more
- 2021Backprop-Free Reinforcement Learning with Active Neural Generative Codingcited by 12
- 2024Is artificial consciousness achievable? Lessons from the human braincited by 11
- 2021The Yin-Yang datasetcited by 10
- 2021Learning cortical representations through perturbed and adversarial dreamingcited by 10
- 2021A Normative and Biologically Plausible Algorithm for Independent Component Analysiscited by 8
- 2022A Rubric for Human-like Agents and NeuroAIcited by 8
- 2022Learning efficient backprojections across cortical hierarchies in real timecited by 8
- 2023SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networkscited by 8
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Surveycited by 8
- 2021Learning through structure: towards deep neuromorphic knowledge graph embeddingscited by 7
- 2022Active Predicting Coding: Brain-Inspired Reinforcement Learning for Sparse Reward Robotic Control Problemscited by 6
- 2022Fixed-Weight Difference Target Propagationcited by 6
- 2023Leveraging dendritic properties to advance machine learning and neuro-inspired computingcited by 6
- 2024Gradient-Free Training of Recurrent Neural Networks using Random Perturbationscited by 6
- 2021How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorizationcited by 5
- 2022DELAUNAY: a dataset of abstract art for psychophysical and machine learning researchcited by 5
- 2022Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processingcited by 5
- 2022Unlocking the potential of two-point cells for energy-efficient and resilient training of deep netscited by 5
- 2025Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithmcited by 5
- 2021Assemblies of neurons learn to classify well-separated distributionscited by 4
- 2021Cortico-cerebellar networks as decoupling neural interfacescited by 4
- 2022Building Human-like Communicative Intelligence: A Grounded Perspectivecited by 4
- 2023Learning Reservoir Dynamics with Temporal Self-Modulationcited by 4
- 2023Normative framework for deriving neural networks with multi-compartmental neurons and non-Hebbian plasticitycited by 4
- 2024Novel Saliency Analysis for the Forward Forward Algorithmcited by 4
- 2023Computation with Sequences in a Model of the Braincited by 3
- 2023Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetrycited by 3
- 2024LightFF: Lightweight Inference for Forward-Forward Algorithmcited by 3
- 2024An Overlooked Role of Context-Sensitive Dendritescited by 3
- 2024Temporal-Difference Learning Using Distributed Error Signalscited by 3
- 2025Three-Factor Learning in Spiking Neural Networks: An Overview of Methods and Trends from a Machine Learning Perspectivecited by 3
- 2025Beyond Attention: Toward Machines with Intrinsic Higher Mental Statescited by 3
- 2026A Physical Theory of Backpropagation: Exact Gradients from the Least-Action Principlecited by 3
- 2026Equilibrium Propagation for Non-Conservative Systemscited by 3
- 2021BioGrad: Biologically Plausible Gradient-Based Learning for Spiking Neural Networkscited by 2
- 2022Deep Layer-wise Networks Have Closed-Form Weightscited by 2
- 2022A Robust Backpropagation-Free Framework for Imagescited by 2
- 2023Duality Principle and Biologically Plausible Learning: Connecting the Representer Theorem and Hebbian Learningcited by 2
50 most cited of 71 All 71 (JSON)
- 2026Learning in Deep Networks under Dale's Constraint7 Aug 2026
- 2026Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning11 May 2026
- 2026Inhibitory normalization of error signals improves learning in neural circuits18 Mar 2026
- 2026Scalable Machines with Intrinsic Higher Mental-State Dynamics13 Mar 2026
- 2026Continual Learning through Control Minimization4 Feb 2026
- 2026Equilibrium Propagation for Non-Conservative Systems3 Feb 2026
- 2026A Physical Theory of Backpropagation: Exact Gradients from the Least-Action Principle2 Feb 2026
- 2025NetworkFF: Unified Layer Optimization in Forward-Only Neural Networks19 Dec 2025
- 2025Meta-learning three-factor plasticity rules for structured credit assignment with sparse feedback10 Dec 2025
- 2025Curl Descent: Non-Gradient Learning Dynamics with Sign-Diverse Plasticity3 Oct 2025
- 2025Forward Target Propagation: A Forward-Only Approach to Global Error Credit Assignment via Local Losses20 May 2025
- 2025Stochastic Layer-wise Learning: Scalable and Efficient Alternative to Backpropagation8 May 2025
38 more
- 2025Beyond Attention: Toward Machines with Intrinsic Higher Mental States2 May 2025
- 2025Three-Factor Learning in Spiking Neural Networks: An Overview of Methods and Trends from a Machine Learning Perspective6 Apr 2025
- 2025Harnessing uncertainty when learning through Equilibrium Propagation in neural networks28 Mar 2025
- 2025Spike-based alignment learning solves the weight transport problem4 Mar 2025
- 2025Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm19 Feb 2025
- 2025Perforated Backpropagation: A Neuroscience Inspired Extension to Artificial Neural Networks29 Jan 2025
- 2024Temporal-Difference Learning Using Distributed Error Signals6 Nov 2024
- 2024Novel Saliency Analysis for the Forward Forward Algorithm18 Sep 2024
- 2024An Overlooked Role of Context-Sensitive Dendrites20 Aug 2024
- 2024Towards Efficient Formal Verification of Spiking Neural Network20 Aug 2024
- 2024Gradient-Free Training of Recurrent Neural Networks using Random Perturbations14 May 2024
- 2024Is artificial consciousness achievable? Lessons from the human brain18 Apr 2024
- 2024LightFF: Lightweight Inference for Forward-Forward Algorithm8 Apr 2024
- 2024Two Tales of Single-Phase Contrastive Hebbian Learning13 Feb 2024
- 2023Dis-inhibitory neuronal circuits can control the sign of synaptic plasticity30 Oct 2023
- 2023Duality Principle and Biologically Plausible Learning: Connecting the Representer Theorem and Hebbian Learning2 Aug 2023
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey30 Jul 2023
- 2023Leveraging dendritic properties to advance machine learning and neuro-inspired computing13 Jun 2023
- 2023Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetry7 Jun 2023
- 2023Computation with Sequences in a Model of the Brain6 Jun 2023
- 2023Normative framework for deriving neural networks with multi-compartmental neurons and non-Hebbian plasticity20 Feb 2023
- 2023Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neurons2 Feb 2023
- 2023SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networks1 Feb 2023
- 2023Learning Reservoir Dynamics with Temporal Self-Modulation23 Jan 2023
- 2022The Forward-Forward Algorithm: Some Preliminary Investigations27 Dec 2022
- 2022Learning efficient backprojections across cortical hierarchies in real time20 Dec 2022
- 2022Fixed-Weight Difference Target Propagation19 Dec 2022
- 2022Emergent Computations in Trained Artificial Neural Networks and Real Brains9 Dec 2022
- 2022A Rubric for Human-like Agents and NeuroAI8 Dec 2022
- 2022Synaptic Dynamics Realize First-order Adaptive Learning and Weight Symmetry1 Dec 2022
- 2022Unlocking the potential of two-point cells for energy-efficient and resilient training of deep nets24 Oct 2022
- 2022Active Predicting Coding: Brain-Inspired Reinforcement Learning for Sparse Reward Robotic Control Problems19 Sep 2022
- 2022Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processing15 Jul 2022
- 2022The least-control principle for local learning at equilibrium4 Jul 2022
- 2022Single-phase deep learning in cortico-cortical networks23 Jun 2022
- 2022A Robust Backpropagation-Free Framework for Images3 Jun 2022
- 2022A Computational Framework of Cortical Microcircuits Approximates Sign-concordant Random Backpropagation15 May 2022
- 2022Signal Propagation: A Framework for Learning and Inference In a Forward Pass4 Apr 2022
50 newest of 71 All 71 (JSON)
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
- 2021Credit Assignment in Neural Networks through Deep Feedback Controlcited by 29
- 2022Signal Propagation: A Framework for Learning and Inference In a Forward Passcited by 24
- 2021Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligencecited by 21
- 2021Capturing the objects of vision with neural networkscited by 21
- 2022Single-phase deep learning in cortico-cortical networkscited by 19
- 2022The least-control principle for local learning at equilibriumcited by 16
- 2021Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neuronscited by 15
- 2021A contrastive rule for meta-learningcited by 14
- 2023Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neuronscited by 14
12 most cited of 69 All 69 (JSON)
- 2026Learning in Deep Networks under Dale's Constraint7 Aug 2026
- 2026Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning11 May 2026
- 2026Inhibitory normalization of error signals improves learning in neural circuits18 Mar 2026
- 2026Continual Learning through Control Minimization4 Feb 2026
- 2026Equilibrium Propagation for Non-Conservative Systems3 Feb 2026
- 2026A Physical Theory of Backpropagation: Exact Gradients from the Least-Action Principle2 Feb 2026
- 2025NetworkFF: Unified Layer Optimization in Forward-Only Neural Networks19 Dec 2025
- 2025Meta-learning three-factor plasticity rules for structured credit assignment with sparse feedback10 Dec 2025
- 2025Curl Descent: Non-Gradient Learning Dynamics with Sign-Diverse Plasticity3 Oct 2025
- 2025Forward Target Propagation: A Forward-Only Approach to Global Error Credit Assignment via Local Losses20 May 2025
- 2025Stochastic Layer-wise Learning: Scalable and Efficient Alternative to Backpropagation8 May 2025
- 2025Beyond Attention: Toward Machines with Intrinsic Higher Mental States2 May 2025
12 newest of 69 All 69 (JSON)