mlsanityData to 14 Oct 2026

Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm

arXiv 2502.20411 ↗First posted 19 Feb 2025cs.NE cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP) remains challenging due to computational inefficiencies and a lack of biological plausibility. This study explores the Forward-Forward (FF) algorithm as an alternative learning framework for SNNs. Unlike backpropagation, which relies on forward and backward passes, the FF algorithm employs two forward passes, enabling layer-wise localized learning, enhanced computational efficiency, and improved compatibility with neuromorphic hardware. We introduce an FF-based SNN training framework and evaluate its performance across both non-spiking (MNIST, Fashion-MNIST, Kuzushiji-MNIST) and spiking (Neuro-MNIST, SHD) datasets. Experimental results demonstrate that our model surpasses existing FF-based SNNs on evaluated static datasets with a much lighter architecture while achieving accuracy comparable to state-of-the-art backpropagation-trained SNNs. On more complex spiking tasks such as SHD, our approach outperforms other SNN models and remains competitive with leading backpropagation-trained SNNs. These findings highlight the FF algorithm's potential to advance SNN training methodologies by addressing some key limitations of backpropagation.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 34 of its 59 references that are in the map. First posted on arXiv 19 Feb 2025.

Builds on

34 of 59 references.

References · 34

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  4. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  5. 2018Deep Learning for Classical Japanese Literaturecited by 422
  6. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
  7. 2021Deep Residual Learning in Spiking Neural Networkscited by 331
  8. 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
  9. 2018SLAYER: Spike Layer Error Reassignment in Timecited by 266
  10. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  11. 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
  12. 2016Training Deep Spiking Neural Networks using Backpropagationcited by 205
22 more
  1. 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 182
  2. 2017Searching for Activation Functionscited by 169
  3. 2019The Heidelberg spiking datasets for the systematic evaluation of spiking neural networkscited by 137
  4. 2016Towards deep learning with segregated dendritescited by 71
  5. 2015Towards Biologically Plausible Deep Learningcited by 66
  6. 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
  7. 2015How Important is Weight Symmetry in Backpropagation?cited by 58
  8. 2019S4NN: temporal backpropagation for spiking neural networks with one spike per neuroncited by 49
  9. 2019Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagationcited by 45
  10. 2022Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?cited by 45
  11. 2021Sparse Spiking Gradient Descentcited by 41
  12. 2023The Predictive Forward-Forward Algorithmcited by 35
  13. 2023SymBa: Symmetric Backpropagation-Free Contrastive Learning with Forward-Forward Algorithm for Optimizing Convergencecited by 28
  14. 2023Emergent representations in networks trained with the Forward-Forward algorithmcited by 11
  15. 2023Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuitscited by 10
  16. 2024Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networkscited by 10
  17. 2023Extending the Forward Forward Algorithmcited by 6
  18. 2024Inference-Scale Complexity in ANN-SNN Conversion for High-Performance and Low-Power Applicationscited by 5
  19. 2022Robust and accelerated single-spike spiking neural network training with applicability to challenging temporal taskscited by 4
  20. 2023The Integrated Forward-Forward Algorithm: Integrating Forward-Forward and Shallow Backpropagation With Local Lossescited by 4
  21. 2023A Study of Forward-Forward Algorithm for Self-Supervised Learningcited by 4
  22. 2024LightFF: Lightweight Inference for Forward-Forward Algorithmcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.