mlsanityData to 7 Oct 2026

Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardware

arXiv 2405.01305 ↗First posted 2 May 2024cs.NE cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Programming recurrent spiking neural networks (RSNNs) to robustly perform multi-timescale computation remains a difficult challenge. To address this, we describe a single-shot weight learning scheme to embed robust multi-timescale dynamics into attractor-based RSNNs, by exploiting the properties of high-dimensional distributed representations. We embed finite state machines into the RSNN dynamics by superimposing a symmetric autoassociative weight matrix and asymmetric transition terms, which are each formed by the vector binding of an input and heteroassociative outer-products between states. Our approach is validated through simulations with highly nonideal weights; an experimental closed-loop memristive hardware setup; and on Loihi 2, where it scales seamlessly to large state machines. This work introduces a scalable approach to embed robust symbolic computation through recurrent dynamics into neuromorphic hardware, without requiring parameter fine-tuning or significant platform-specific optimisation. Moreover, it demonstrates that distributed symbolic representations serve as a highly capable representation-invariant language for cognitive algorithms in neuromorphic hardware.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 30 of its 108 references that are in the map. First posted on arXiv 2 May 2024.

Builds on

30 of 108 references.

References · 30

  1. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  2. 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
  3. 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
  4. 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challengescited by 68
  5. 2018Stable Recurrent Modelscited by 65
  6. 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
  7. 2021Attractor and integrator networks in the braincited by 60
  8. 2019In-memory hyperdimensional computingcited by 47
  9. 2020A Theoretical Perspective on Hyperdimensional Computingcited by 43
  10. 2021Computing on Functions Using Randomized Vector Representationscited by 41
  11. 2020Surrogate gradients for analog neuromorphic computingcited by 38
  12. 2021Vector Symbolic Architectures as a Computing Framework for Emerging Hardwarecited by 35
18 more
  1. 2020Variable Binding for Sparse Distributed Representations: Theory and Applicationscited by 27
  2. 2023Neuromorphic Intermediate Representation: A Unified Instruction Set for Interoperable Brain-Inspired Computingcited by 22
  3. 2019Robust computation with rhythmic spike patternscited by 21
  4. 2014Neuromorphic electronic circuits for building autonomous cognitive systemscited by 19
  5. 2017Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale Systemcited by 19
  6. 2022Neuromorphic Visual Scene Understanding with Resonator Networkscited by 17
  7. 2023DenRAM: Neuromorphic Dendritic Architecture with RRAM for Efficient Temporal Processing with Delayscited by 16
  8. 2017Neural Distributed Autoassociative Memories: A Surveycited by 12
  9. 2021Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processorscited by 7
  10. 2019Composing Neural Algorithms with Fugucited by 6
  11. 2021Online Training of Spiking Recurrent Neural Networks with Phase-Change Memory Synapsescited by 5
  12. 2022Vector Symbolic Finite State Machines in Attractor Neural Networkscited by 4
  13. 2023Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processorscited by 4
  14. 2024Linear Codes for Hyperdimensional Computingcited by 4
  15. 2023Capacity Analysis of Vector Symbolic Architecturescited by 3
  16. 2015Rhythmic inhibition allows neural networks to search for maximally consistent statescited by 2
  17. 2020Visual Pattern Recognition with on On-chip Learning: towards a Fully Neuromorphic Approachcited by 2
  18. 2023Scaling Limits of Memristor-Based Routers for Asynchronous Neuromorphic Systemscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.