# Distillation for spiking neural networks

Area: [Knowledge distillation](https://mlsanity.com/distill/index.md). HTML: https://mlsanity.com/distill/distillation-for-spiking-neural-networks/

## Key facts

- Distillation for spiking neural networks: 23 papers on arXiv since 2021 (data through 14 Oct 2026).
- 11 of its 23 mapped papers (48%) cite “Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation” (2023, arXiv 2304.05627).
- 8 of its 23 mapped papers (35%) cite “Joint A-SNN: Joint Training of Artificial and Spiking Neural Networks via Self-Distillation and Weight Factorization” (2023, arXiv 2305.02099).

## Most cited here

- [Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation](https://mlsanity.com/paper/2304.05627/) (2023), cited by 11 papers here
- [Joint A-SNN: Joint Training of Artificial and Spiking Neural Networks via Self-Distillation and Weight Factorization](https://mlsanity.com/paper/2305.02099/) (2023), cited by 8 papers here
- [BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation](https://mlsanity.com/paper/2407.09083/) (2024), cited by 7 papers here
- [Energy-efficient Knowledge Distillation for Spiking Neural Networks](https://mlsanity.com/paper/2106.07172/) (2021), cited by 5 papers here
- [Biologically inspired structure learning with reverse knowledge distillation for spiking neural networks](https://mlsanity.com/paper/2304.09500/) (2023), cited by 4 papers here
- [Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks](https://mlsanity.com/paper/2406.07862/) (2024), cited by 3 papers here
- [Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks](https://mlsanity.com/paper/2503.03144/) (2025), cited by 3 papers here
- [SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation](https://mlsanity.com/paper/2308.15122/) (2023), cited by 2 papers here
- [BLEND: Behavior-guided Neural Population Dynamics Modeling via Privileged Knowledge Distillation](https://mlsanity.com/paper/2410.13872/) (2024), cited by 1 papers here
- [Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deployment](https://mlsanity.com/paper/2501.15925/) (2025), cited by 1 papers here