Optimality of short-term synaptic plasticity in modelling certain dynamic environments
Not on the map. Why?
Abstract (arXiv)
Biological neurons and their in-silico emulations for neuromorphic artificial intelligence (AI) use extraordinarily energy-efficient mechanisms, such as spike-based communication and local synaptic plasticity. It remains unclear whether these neuronal mechanisms only offer efficiency or also underlie the superiority of biological intelligence. Here, we prove rigorously that, indeed, the Bayes-optimal prediction and inference of randomly but continuously transforming environments, a common natural setting, relies on short-term spike-timing-dependent plasticity, a hallmark of biological synapses. Further, this dynamic Bayesian inference through plasticity enables circuits of the cerebral cortex in simulations to recognize previously unseen, highly distorted dynamic stimuli. Strikingly, this also introduces a biologically-modelled AI, the first to overcome multiple limitations of deep learning and outperform artificial neural networks in a visual task. The cortical-like network is spiking and event-based, trained only with unsupervised and local plasticity, on a small, narrow, and static training dataset, but achieves recognition of unseen, transformed, and dynamic data better than deep neural networks with continuous activations, trained with supervised backpropagation on the transforming data. These results link short-term plasticity to high-level cortical function, suggest optimality of natural intelligence for natural environments, and repurpose neuromorphic AI from mere efficiency to computational supremacy altogether.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 0; 2024: 1.
4 papers.
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 29
- 2024Self-Contrastive Forward-Forward Algorithmcited by 15
- 2021Spike-inspired Rank Coding for Fast and Accurate Recurrent Neural Networkscited by 5
- 2022Short-Term Plasticity Neurons Learning to Learn and Forgetcited by 5
- 2024Self-Contrastive Forward-Forward Algorithm17 Sep 2024
- 2022Short-Term Plasticity Neurons Learning to Learn and Forget28 Jun 2022
- 2021Spike-inspired Rank Coding for Fast and Accurate Recurrent Neural Networks6 Oct 2021
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networks12 Jul 2021