mlsanityData to 7 Oct 2026

SAFA-SNN: Sparsity-Aware On-Device Few-Shot Class-Incremental Learning with Fast-Adaptive Structure of Spiking Neural Network

arXiv 2510.03648 ↗First posted 4 Oct 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Continuous learning of novel classes is crucial for edge devices to preserve data privacy and maintain reliable performance in dynamic environments. However, the scenario becomes particularly challenging when data samples are insufficient, requiring on-device few-shot class-incremental learning (FSCIL). Although existing work has explored parameter-efficient FSCIL frameworks based on artificial neural networks (ANNs), their deployment is still fundamentally constrained by limited device resources. Spiking neural networks (SNNs) process spatiotemporal information efficiently, offering lower energy consumption, greater biological plausibility, and compatibility with neuromorphic hardware than ANNs. In this work, we propose an SNN-based method containing Sparsity-Aware neuronal dynamics and Fast Adaptive structure (SAFA-SNN) for on-device FSCIL. By threshold regulation, most neurons exhibit stable spikes and others exhibit adaptive spikes. As a result, synaptic traces that encode base-class knowledge are naturally preserved, thereby alleviating catastrophic forgetting. To cope with spike non-differentiability in backpropagation, we employ a gradient-free technique, i.e., zeroth-order optimization. Moreover, class prototypes can limit overfitting on few-shot data but introduce bias. We enhance prototype discriminability by orthogonal subspace projection. Extensive experiments conducted on two standard benchmark datasets (CIFAR-100 and Mini-ImageNet) and three neuromorphic datasets (CIFAR10-DVS, DVS128 Gesture, and N-Caltech101) demonstrate that SAFA-SNN outperforms baselines, specifically achieving at least 4.01% improvement at the last incremental session on Mini-ImageNet and 20% lower energy cost on CIFAR-100 over baselines with practical implementation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 59 of its 88 references that are in the map. First posted on arXiv 4 Oct 2025.

Builds on

59 of 88 references.

References · 59

  1. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  2. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  3. 2019Introduction to Online Convex Optimizationcited by 793
  4. 2019A Closer Look at Few-shot Classificationcited by 679
  5. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  6. 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
  7. 2021Deep Residual Learning in Spiking Neural Networkscited by 326
  8. 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 308
  9. 2020Few-Shot Class-Incremental Learningcited by 249
  10. 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 192
  11. 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 184
  12. 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 178
38 more
  1. 2020A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learningcited by 160
  2. 2013Mini-batch Stochastic Approximation Methods for Nonconvex Stochastic Composite Optimizationcited by 142
  3. 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 125
  4. 2021Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minimacited by 118
  5. 2018Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimizationcited by 109
  6. 2022Attention Spiking Neural Networkscited by 103
  7. 2019Prototype Rectification for Few-Shot Learningcited by 96
  8. 2019A Theoretical and Empirical Comparison of Gradient Approximations in Derivative-Free Optimizationcited by 66
  9. 2020MgSvF: Multi-Grained Slow vs. Fast Framework for Few-Shot Class-Incremental Learningcited by 61
  10. 2021Few-Shot Lifelong Learningcited by 58
  11. 2022SparCL: Sparse Continual Learning on the Edgecited by 55
  12. 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
  13. 2021Subspace Regularizers for Few-Shot Class Incremental Learningcited by 54
  14. 2024QKFormer: Hierarchical Spiking Transformer using Q-K Attentioncited by 46
  15. 2023Few-Shot Class-Incremental Learning via Training-Free Prototype Calibrationcited by 44
  16. 2021A TinyML Platform for On-Device Continual Learning with Quantized Latent Replayscited by 37
  17. 2022On the Soft-Subnetwork for Few-shot Class Incremental Learningcited by 37
  18. 2023Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networkscited by 37
  19. 2024Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learnerscited by 35
  20. 2019Few-Shot Learning with Localization in Realistic Settingscited by 34
  21. 2022Exploring Lottery Ticket Hypothesis in Spiking Neural Networkscited by 25
  22. 2023Few-shot Class-incremental Learning for Classification and Object Detection: A Surveycited by 25
  23. 2023S3C: Self-Supervised Stochastic Classifiers for Few-Shot Class-Incremental Learningcited by 23
  24. 2024SFOD: Spiking Fusion Object Detectorcited by 19
  25. 2022Biologically Inspired Dynamic Thresholds for Spiking Neural Networkscited by 18
  26. 2024Few-Shot Class Incremental Learning with Attention-Aware Self-Adaptive Promptcited by 15
  27. 2024Rethinking Few-shot Class-incremental Learning: Learning from Yourselfcited by 13
  28. 2022Learnable Distribution Calibration for Few-Shot Class-Incremental Learningcited by 12
  29. 2023A Unified Framework for Soft Threshold Pruningcited by 12
  30. 2024Efficient and Effective Time-Series Forecasting with Spiking Neural Networkscited by 12
  31. 2025Quantized Spike-driven Transformercited by 12
  32. 2025QP-SNN: Quantized and Pruned Spiking Neural Networkscited by 12
  33. 2024CLOSER: Towards Better Representation Learning for Few-Shot Class-Incremental Learningcited by 11
  34. 2023Cost-effective On-device Continual Learning over Memory Hierarchy with Mirocited by 10
  35. 2024LM-HT SNN: Enhancing the Performance of SNN to ANN Counterpart through Learnable Multi-hierarchical Threshold Modelcited by 10
  36. 2019Latent Space Factorisation and Manipulation via Matrix Subspace Projectioncited by 9
  37. 2024LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimizationcited by 7
  38. 2024Delta: A Cloud-assisted Data Enrichment Framework for On-Device Continual Learningcited by 6

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.