mlsanityData to 7 Oct 2026

STAER: Temporal Aligned Rehearsal for Continual Spiking Neural Network

arXiv 2601.20870 ↗First posted 16 Jan 2026cs.NE cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Spiking Neural Networks (SNNs) are inherently suited for continuous learning due to their event-driven temporal dynamics; however, their application to Class-Incremental Learning (CIL) has been hindered by catastrophic forgetting and the temporal misalignment of spike patterns. In this work, we introduce Spiking Temporal Alignment with Experience Replay (STAER), a novel framework that explicitly preserves temporal structure to bridge the performance gap between SNNs and ANNs. Our approach integrates a differentiable Soft-DTW alignment loss to maintain spike timing fidelity and employs a temporal expansion and contraction mechanism on output logits to enforce robust representation learning. Implemented on a deep ResNet19 spiking backbone, STAER achieves state-of-the-art performance on Sequential-MNIST and Sequential-CIFAR10. Empirical results demonstrate that our method matches or outperforms strong ANN baselines (ER, DER++) while preserving biologically plausible dynamics. Ablation studies further confirm that explicit temporal alignment is critical for representational stability, positioning STAER as a scalable solution for spike-native lifelong learning. Code is available at https://github.com/matteogianferrari/staer.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

29 of 51 references.

References · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Learning without Forgettingcited by 2,465
  3. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  4. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  5. 2022Editing Models with Task Arithmeticcited by 1,076
  6. 2021Learning to Prompt for Continual Learningcited by 938
  7. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  8. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  9. 2019Three scenarios for continual learningcited by 610
  10. 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 511
  11. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  12. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
17 more
  1. 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
  2. 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 268
  3. 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 265
  4. 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
  5. 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 192
  6. 2023Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Modelscited by 112
  7. 2022GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networkscited by 63
  8. 2020Differentiable Divergences Between Time Seriescited by 26
  9. 2024A Second-Order Perspective on Model Compositionality and Incremental Learningcited by 18
  10. 2024CLIP with Generative Latent Replay: a Strong Baseline for Incremental Learningcited by 17
  11. 2016Supervised Learning in Spiking Neural Networks with FORCE Trainingcited by 13
  12. 2019Controlled Forgetting: Targeted Stimulation and Dopaminergic Plasticity Modulation for Unsupervised Lifelong Learning in Spiking Neural Networkscited by 13
  13. 2019Technical report: supervised training of convolutional spiking neural networks with PyTorchcited by 13
  14. 2025Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networkscited by 10
  15. 2021Learning offline: memory replay in biological and artificial reinforcement learningcited by 4
  16. 2025LoRA-Loop: Closing the Synthetic Replay Cycle for Continual VLM Learningcited by 2
  17. 2024The impact of model size on catastrophic forgetting in Online Continual Learningcited by 1

Built on by

Not cited yet.