mlsanityData to 14 Oct 2026

Towards deep learning with segregated dendrites

arXiv 1610.00161 ↗First posted 1 Oct 2016q-bio.NCcited by 71

Not on the map. Why?

Abstract (arXiv)

Deep learning has led to significant advances in artificial intelligence, in part, by adopting strategies motivated by neurophysiology. However, it is unclear whether deep learning could occur in the real brain. Here, we show that a deep learning algorithm that utilizes multi-compartment neurons might help us to understand how the brain optimizes cost functions. Like neocortical pyramidal neurons, neurons in our model receive sensory information and higher-order feedback in electrotonically segregated compartments. Thanks to this segregation, the neurons in different layers of the network can coordinate synaptic weight updates. As a result, the network can learn to categorize images better than a single layer network. Furthermore, we show that our algorithm takes advantage of multilayer architectures to identify useful representations---the hallmark of deep learning. This work demonstrates that deep learning can be achieved using segregated dendritic compartments, which may help to explain the dendritic morphology of neocortical pyramidal neurons.

Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Oct 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 18; 2022: 17; 2023: 10; 2024: 8; 2025: 11; 2026: 7.

71 papers.

Sort:

By area:

  1. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  2. 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
  3. 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
  4. 2021Credit Assignment in Neural Networks through Deep Feedback Controlcited by 29
  5. 2022Signal Propagation: A Framework for Learning and Inference In a Forward Passcited by 24
  6. 2021Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligencecited by 21
  7. 2021Capturing the objects of vision with neural networkscited by 21
  8. 2022Single-phase deep learning in cortico-cortical networkscited by 19
  9. 2022The least-control principle for local learning at equilibriumcited by 16
  10. 2021Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neuronscited by 15
  11. 2021A contrastive rule for meta-learningcited by 14
  12. 2023Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neuronscited by 14
38 more
  1. 2021Backprop-Free Reinforcement Learning with Active Neural Generative Codingcited by 12
  2. 2024Is artificial consciousness achievable? Lessons from the human braincited by 11
  3. 2021The Yin-Yang datasetcited by 10
  4. 2021Learning cortical representations through perturbed and adversarial dreamingcited by 10
  5. 2021A Normative and Biologically Plausible Algorithm for Independent Component Analysiscited by 8
  6. 2022A Rubric for Human-like Agents and NeuroAIcited by 8
  7. 2022Learning efficient backprojections across cortical hierarchies in real timecited by 8
  8. 2023SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networkscited by 8
  9. 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Surveycited by 8
  10. 2021Learning through structure: towards deep neuromorphic knowledge graph embeddingscited by 7
  11. 2022Active Predicting Coding: Brain-Inspired Reinforcement Learning for Sparse Reward Robotic Control Problemscited by 6
  12. 2022Fixed-Weight Difference Target Propagationcited by 6
  13. 2023Leveraging dendritic properties to advance machine learning and neuro-inspired computingcited by 6
  14. 2024Gradient-Free Training of Recurrent Neural Networks using Random Perturbationscited by 6
  15. 2021How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorizationcited by 5
  16. 2022DELAUNAY: a dataset of abstract art for psychophysical and machine learning researchcited by 5
  17. 2022Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processingcited by 5
  18. 2022Unlocking the potential of two-point cells for energy-efficient and resilient training of deep netscited by 5
  19. 2025Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithmcited by 5
  20. 2021Assemblies of neurons learn to classify well-separated distributionscited by 4
  21. 2021Cortico-cerebellar networks as decoupling neural interfacescited by 4
  22. 2022Building Human-like Communicative Intelligence: A Grounded Perspectivecited by 4
  23. 2023Learning Reservoir Dynamics with Temporal Self-Modulationcited by 4
  24. 2023Normative framework for deriving neural networks with multi-compartmental neurons and non-Hebbian plasticitycited by 4
  25. 2024Novel Saliency Analysis for the Forward Forward Algorithmcited by 4
  26. 2023Computation with Sequences in a Model of the Braincited by 3
  27. 2023Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetrycited by 3
  28. 2024LightFF: Lightweight Inference for Forward-Forward Algorithmcited by 3
  29. 2024An Overlooked Role of Context-Sensitive Dendritescited by 3
  30. 2024Temporal-Difference Learning Using Distributed Error Signalscited by 3
  31. 2025Three-Factor Learning in Spiking Neural Networks: An Overview of Methods and Trends from a Machine Learning Perspectivecited by 3
  32. 2025Beyond Attention: Toward Machines with Intrinsic Higher Mental Statescited by 3
  33. 2026A Physical Theory of Backpropagation: Exact Gradients from the Least-Action Principlecited by 3
  34. 2026Equilibrium Propagation for Non-Conservative Systemscited by 3
  35. 2021BioGrad: Biologically Plausible Gradient-Based Learning for Spiking Neural Networkscited by 2
  36. 2022Deep Layer-wise Networks Have Closed-Form Weightscited by 2
  37. 2022A Robust Backpropagation-Free Framework for Imagescited by 2
  38. 2023Duality Principle and Biologically Plausible Learning: Connecting the Representer Theorem and Hebbian Learningcited by 2

50 most cited of 71 All 71 (JSON)