Architecture of a Cortex Inspired Hierarchical Event Recaller
Not on the map. Why?
Abstract (arXiv)
This paper proposes a new approach to Machine Learning (ML) that focuses on unsupervised continuous context-dependent learning of complex patterns. Although the proposal is partly inspired by some of the current knowledge about the structural and functional properties of the mammalian brain, we do not claim that biological systems work in an analogous way (nor the opposite). Based on some properties of the cerebellar cortex and adjacent structures, a proposal suitable for practical problems is presented. A synthetic structure capable of identifying and predicting complex temporal series will be defined and experimentally tested. The system relies heavily on prediction to help identify and learn patterns based on previously acquired contextual knowledge. As a proof of concept, the proposed system is shown to be able to learn, identify and predict a remarkably complex temporal series such as human speech, with no prior knowledge. From raw data, without any adaptation in the core algorithm, the system is able to identify certain speech structures from a set of Spanish sentences. Unlike conventional ML, the proposal can learn with a reduced training set. Although the idea can be applied to a constrained problem, such as the detection of unknown vocabulary in a speech, it could be used in more applications, such as vision, or (by incorporating the missing biological periphery) fit into other ML techniques. Given the trivial computational primitives used, a potential hardware implementation will be remarkably frugal. Coincidentally, the proposed model not only conforms to a plausible functional framework for biological systems but may also explain many elusive cognitive phenomena.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 190 references that are in the map. First posted on arXiv 3 May 2024.
Builds on
9 of 190 references.
References · 9
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Dynamic Routing Between Capsulescited by 689
- 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
- 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 451
- 2019Orthogonal Gradient Descent for Continual Learningcited by 369
- 2019Compositionality decomposed: how do neural networks generalise?cited by 265
- 2015Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortexcited by 45
- 2015Continuous online sequence learning with an unsupervised neural network modelcited by 18
- 2015Properties of Sparse Distributed Representations and their Application to Hierarchical Temporal Memorycited by 14
Built on by
Not cited yet.