mlsanityData to 14 Oct 2026

Towards Robust Spiking Neural Networks:Mitigating Heterogeneous Training Vulnerability via Dominant Eigencomponent Projection

arXiv 2505.11134 ↗First posted 16 May 2025cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Spiking Neural Networks (SNNs) process information via discrete spikes, enabling them to operate at remarkably low energy levels. However, our experimental observations reveal a striking vulnerability when SNNs are trained using the mainstream method--direct encoding combined with backpropagation through time (BPTT): even a single backward pass on data drawn from a slightly different distribution can lead to catastrophic network collapse. Our theoretical analysis attributes this vulnerability to the repeated inputs inherent in direct encoding and the gradient accumulation characteristic of BPTT, which together produce an exceptional large Hessian spectral radius. To address this challenge, we develop a hyperparameter-free method called Dominant Eigencomponent Projection (DEP). By orthogonally projecting gradients to precisely remove their dominant components, DEP effectively reduces the Hessian spectral radius, thereby preventing SNNs from settling into sharp minima. Extensive experiments demonstrate that DEP not only mitigates the vulnerability of SNNs to heterogeneous data poisoning, but also significantly enhances overall robustness compared to key baselines, providing strong support for safer and more reliable SNN deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). First posted on arXiv 16 May 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training
  2. 2026Controllable Stochastic Quantization Encoding for Adversarially Robust Spiking Neural Networks
  3. 2026BASC : Behavior-Aligned Quantization and Pruning for Low-Bit Spiking Neural Networks
  4. 2025Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deployment
  5. 2025Synergy Between the Strong and the Weak: Spiking Neural Networks are Inherently Self-Distillers
  6. 2023High-performance deep spiking neural networks with 0.3 spikes per neuron
  7. 2025All in one timestep: Enhancing Sparsity and Energy efficiency in Multi-level Spiking Neural Networks
  8. 2024SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models