Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardware
Not on the map. Why?
Abstract (arXiv)
Programming recurrent spiking neural networks (RSNNs) to robustly perform multi-timescale computation remains a difficult challenge. To address this, we describe a single-shot weight learning scheme to embed robust multi-timescale dynamics into attractor-based RSNNs, by exploiting the properties of high-dimensional distributed representations. We embed finite state machines into the RSNN dynamics by superimposing a symmetric autoassociative weight matrix and asymmetric transition terms, which are each formed by the vector binding of an input and heteroassociative outer-products between states. Our approach is validated through simulations with highly nonideal weights; an experimental closed-loop memristive hardware setup; and on Loihi 2, where it scales seamlessly to large state machines. This work introduces a scalable approach to embed robust symbolic computation through recurrent dynamics into neuromorphic hardware, without requiring parameter fine-tuning or significant platform-specific optimisation. Moreover, it demonstrates that distributed symbolic representations serve as a highly capable representation-invariant language for cognitive algorithms in neuromorphic hardware.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 30 of its 108 references that are in the map. First posted on arXiv 2 May 2024.
Builds on
30 of 108 references.
References · 30
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
- 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challengescited by 68
- 2018Stable Recurrent Modelscited by 65
- 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
- 2021Attractor and integrator networks in the braincited by 60
- 2019In-memory hyperdimensional computingcited by 47
- 2020A Theoretical Perspective on Hyperdimensional Computingcited by 43
- 2021Computing on Functions Using Randomized Vector Representationscited by 41
- 2020Surrogate gradients for analog neuromorphic computingcited by 38
- 2021Vector Symbolic Architectures as a Computing Framework for Emerging Hardwarecited by 35
18 more
- 2020Variable Binding for Sparse Distributed Representations: Theory and Applicationscited by 27
- 2023Neuromorphic Intermediate Representation: A Unified Instruction Set for Interoperable Brain-Inspired Computingcited by 22
- 2019Robust computation with rhythmic spike patternscited by 21
- 2014Neuromorphic electronic circuits for building autonomous cognitive systemscited by 19
- 2017Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale Systemcited by 19
- 2022Neuromorphic Visual Scene Understanding with Resonator Networkscited by 17
- 2023DenRAM: Neuromorphic Dendritic Architecture with RRAM for Efficient Temporal Processing with Delayscited by 16
- 2017Neural Distributed Autoassociative Memories: A Surveycited by 12
- 2021Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processorscited by 7
- 2019Composing Neural Algorithms with Fugucited by 6
- 2021Online Training of Spiking Recurrent Neural Networks with Phase-Change Memory Synapsescited by 5
- 2022Vector Symbolic Finite State Machines in Attractor Neural Networkscited by 4
- 2023Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processorscited by 4
- 2024Linear Codes for Hyperdimensional Computingcited by 4
- 2023Capacity Analysis of Vector Symbolic Architecturescited by 3
- 2015Rhythmic inhibition allows neural networks to search for maximally consistent statescited by 2
- 2020Visual Pattern Recognition with on On-chip Learning: towards a Fully Neuromorphic Approachcited by 2
- 2023Scaling Limits of Memristor-Based Routers for Asynchronous Neuromorphic Systemscited by 2
Built on by
Citing papers per year: 2025: 3.
3 papers.