mlsanityData to 7 Oct 2026

Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits

arXiv 2303.18187 ↗First posted 30 Mar 2023cs.NE cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Brain-inspired machine intelligence research seeks to develop computational models that emulate the information processing and adaptability that distinguishes biological systems of neurons. This has led to the development of spiking neural networks, a class of models that promisingly addresses the biological implausibility and {the lack of energy efficiency} inherent to modern-day deep neural networks. In this work, we address the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks and propose contrastive-signal-dependent plasticity, a process which generalizes ideas behind self-supervised learning to facilitate local adaptation in architectures of event-based neuronal layers that operate in parallel. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks, crucially side-stepping the need for extra structure such as feedback synapses.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 17 of its 62 references that are in the map. First posted on arXiv 30 Mar 2023.

Builds on

17 of 62 references.

References · 17

  1. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  2. 2019Green AIcited by 620
  3. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  4. 2018Deep Learning for Classical Japanese Literaturecited by 415
  5. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 262
  6. 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
  7. 2016Decoupled Neural Interfaces using Synthetic Gradientscited by 135
  8. 2017Deep supervised learning using local errorscited by 41
  9. 2018A Biologically Plausible Supervised Learning Method for Spiking Neural Networks Using the Symmetric STDP Rulecited by 36
  10. 2023The Predictive Forward-Forward Algorithmcited by 35
  11. 2022Signal Propagation: A Framework for Learning and Inference In a Forward Passcited by 24
  12. 2019Spiking Neural Predictive Coding for Continual Learning from Data Streamscited by 17
5 more
  1. 2023The Cascaded Forward Algorithm for Neural Network Trainingcited by 17
  2. 2018Error Forward-Propagation: Reusing Feedforward Connections to Propagate Errors in Deep Learningcited by 16
  3. 2018Unsupervised Learning with Self-Organizing Spiking Neural Networkscited by 11
  4. 2017Algorithm and Hardware Design of Discrete-Time Spiking Neural Networks Based on Back Propagation with Binary Activationscited by 7
  5. 2019Learning without feedback: Fixed random learning signals allow for feedforward training of deep neural networkscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 3; 2026: 2.

10 papers.