Augmenting learning in neuro-embodied systems through neurobiological first principles
Not on the map. Why?
Abstract (arXiv)
Recent progress in artificial intelligence (AI) has been driven by insights from physics and neuroscience, particularly through the development of artificial neural networks (ANNs) capable of complex cognitive tasks such as vision and language processing. Despite these advances, they struggle with continual learning, adaptable knowledge transfer, robustness, and resource efficiency -- capabilities that biological systems handle seamlessly. Specifically, neuromorphic systems and artificial neural networks often overlook two key biophysical properties of neural circuits: neuronal diversity and cell-specific neuromodulation. These mechanisms, essential for regulating dynamic learning across brain scales, allow neuromodulators to introduce degeneracy in biological neural networks, ensuring stability and adaptability under changing conditions. In this article, we summarize recent bioinspired models, learning rules, and architectures, and propose a framework for augmenting ANNs, which has the potential to bridge the gap between neuroscience and AI through neurobiological first principles. Our proposed dual-framework approach leverages spiking neural networks to emulate diverse spiking behaviors and dendritic compartmental dynamics, thereby simulating the morphological and functional diversity of neuronal computations. Finally, we outline how integrating these biophysical principles into task-driven spiking neural networks and neuromorphic systems provides scalable solutions for continual learning, adaptability, robustness, and resource-efficiency. Additionally, this approach will not only provide insights into how emergent behaviors arise in neural networks but also catalyze the development of more efficient, reliable, and intelligent neuromorphic systems and robotic agents.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 46 of its 208 references that are in the map. First posted on arXiv 5 Jul 2024.
Builds on
46 of 208 references.
References · 46
- 2017Attention Is All You Needcited by 59,932
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2016Progressive Neural Networkscited by 1,332
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
- 2019Three scenarios for continual learningcited by 610
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
- 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
34 more
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2018Continual Learning of Context-dependent Processing in Neural Networkscited by 178
- 2020A Large Scale Event-based Detection Dataset for Automotivecited by 108
- 2018Dendritic cortical microcircuits approximate the backpropagation algorithmcited by 96
- 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
- 2020Learning to Continually Learncited by 82
- 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 82
- 2016Towards an integration of deep learning and neurosciencecited by 77
- 2021Attractor and integrator networks in the braincited by 60
- 2023Brain-inspired learning in artificial neural networks: a reviewcited by 26
- 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environmentscited by 24
- 2017First-spike based visual categorization using reward-modulated STDPcited by 19
- 2022Single-phase deep learning in cortico-cortical networkscited by 19
- 2020Online Few-shot Gesture Learning on a Neuromorphic Processorcited by 18
- 2017full-FORCE: A Target-Based Method for Training Recurrent Networkscited by 16
- 2018Introducing Neuromodulation in Deep Neural Networks to Learn Adaptive Behaviourscited by 16
- 2021Drawing Inspiration from Biological Dendrites to Empower Artificial Neural Networkscited by 15
- 2021Increasing Liquid State Machine Performance with Edge-of-Chaos Dynamics Organized by Astrocyte-modulated Plasticitycited by 12
- 2022Neuromorphic Artificial Intelligence Systemscited by 12
- 2017Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networkscited by 9
- 2023The Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primatescited by 8
- 2014Short-term plasticity as cause-effect hypothesis testing in distal reward learningcited by 6
- 2022Simple and complex spiking neurons: perspectives and analysis in a simple STDP scenariocited by 6
- 2022Contextual guidance: An integrated theory for astrocytes function in brain circuits and behaviorcited by 6
- 2023Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networkscited by 6
- 2023Leveraging dendritic properties to advance machine learning and neuro-inspired computingcited by 6
- 2021Spiking Control Systemscited by 5
- 2020Reinforcement Learning with Feedback-modulated TD-STDPcited by 4
- 2020Neuromorphic Controlcited by 4
- 2021Learning to acquire novel cognitive tasks with evolution, plasticity and meta-meta-learningcited by 4
- 2017Acetylcholine-modulated plasticity in reward-driven navigation: a computational studycited by 3
- 2018Neuromodulated Learning in Deep Neural Networkscited by 3
- 2024Neuromorphic Control of a Pendulumcited by 3
- 2023Neuromorphic Neuromodulation: Towards the next generation of on-device AI-revolution in electroceuticalscited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.