STAER: Temporal Aligned Rehearsal for Continual Spiking Neural Network
Not on the map. Why?
Abstract (arXiv)
Spiking Neural Networks (SNNs) are inherently suited for continuous learning due to their event-driven temporal dynamics; however, their application to Class-Incremental Learning (CIL) has been hindered by catastrophic forgetting and the temporal misalignment of spike patterns. In this work, we introduce Spiking Temporal Alignment with Experience Replay (STAER), a novel framework that explicitly preserves temporal structure to bridge the performance gap between SNNs and ANNs. Our approach integrates a differentiable Soft-DTW alignment loss to maintain spike timing fidelity and employs a temporal expansion and contraction mechanism on output logits to enforce robust representation learning. Implemented on a deep ResNet19 spiking backbone, STAER achieves state-of-the-art performance on Sequential-MNIST and Sequential-CIFAR10. Empirical results demonstrate that our method matches or outperforms strong ANN baselines (ER, DER++) while preserving biologically plausible dynamics. Ablation studies further confirm that explicit temporal alignment is critical for representational stability, positioning STAER as a scalable solution for spike-native lifelong learning. Code is available at https://github.com/matteogianferrari/staer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
29 of 51 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2022Editing Models with Task Arithmeticcited by 1,076
- 2021Learning to Prompt for Continual Learningcited by 938
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2019Three scenarios for continual learningcited by 610
- 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 511
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
17 more
- 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
- 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 268
- 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 265
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 192
- 2023Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Modelscited by 112
- 2022GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networkscited by 63
- 2020Differentiable Divergences Between Time Seriescited by 26
- 2024A Second-Order Perspective on Model Compositionality and Incremental Learningcited by 18
- 2024CLIP with Generative Latent Replay: a Strong Baseline for Incremental Learningcited by 17
- 2016Supervised Learning in Spiking Neural Networks with FORCE Trainingcited by 13
- 2019Controlled Forgetting: Targeted Stimulation and Dopaminergic Plasticity Modulation for Unsupervised Lifelong Learning in Spiking Neural Networkscited by 13
- 2019Technical report: supervised training of convolutional spiking neural networks with PyTorchcited by 13
- 2025Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networkscited by 10
- 2021Learning offline: memory replay in biological and artificial reinforcement learningcited by 4
- 2025LoRA-Loop: Closing the Synthetic Replay Cycle for Continual VLM Learningcited by 2
- 2024The impact of model size on catastrophic forgetting in Online Continual Learningcited by 1
Built on by
Not cited yet.