mlsanityData to 7 Oct 2026

Brain-inspired Evolutionary Architectures for Spiking Neural Networks

arXiv 2309.05263 ↗First posted 11 Sep 2023cs.NE cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The complex and unique neural network topology of the human brain formed through natural evolution enables it to perform multiple cognitive functions simultaneously. Automated evolutionary mechanisms of biological network structure inspire us to explore efficient architectural optimization for Spiking Neural Networks (SNNs). Instead of manually designed fixed architectures or hierarchical Network Architecture Search (NAS), this paper evolves SNNs architecture by incorporating brain-inspired local modular structure and global cross-module connectivity. Locally, the brain region-inspired module consists of multiple neural motifs with excitatory and inhibitory connections; Globally, we evolve free connections among modules, including long-term cross-module feedforward and feedback connections. We further introduce an efficient multi-objective evolutionary algorithm based on a few-shot performance predictor, endowing SNNs with high performance, efficiency and low energy consumption. Extensive experiments on static datasets (CIFAR10, CIFAR100) and neuromorphic datasets (CIFAR10-DVS, DVS128-Gesture) demonstrate that our proposed model boosts energy efficiency, archiving consistent and remarkable performance. This work explores brain-inspired neural architectures suitable for SNNs and also provides preliminary insights into the evolutionary mechanisms of biological neural networks in the human brain.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 58 of its 98 references that are in the map. First posted on arXiv 11 Sep 2023.

Builds on

58 of 98 references.

References · 58

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Densely Connected Convolutional Networkscited by 6,691
  3. 2014Going Deeper with Convolutionscited by 4,231
  4. 2019Searching for MobileNetV3cited by 1,984
  5. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
  6. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  7. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
  8. 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
  9. 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 666
  10. 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 515
  11. 2017Progressive Neural Architecture Searchcited by 483
  12. 2018FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Searchcited by 480
38 more
  1. 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 412
  2. 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 411
  3. 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
  4. 2017Large-Scale Evolution of Image Classifierscited by 348
  5. 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 340
  6. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
  7. 2019NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detectioncited by 289
  8. 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 268
  9. 2018SLAYER: Spike Layer Error Reassignment in Timecited by 257
  10. 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 253
  11. 2020Neural Architecture Search without Trainingcited by 241
  12. 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 222
  13. 2021Zero-Cost Proxies for Lightweight NAScited by 194
  14. 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 192
  15. 2018Efficient Multi-objective Neural Architecture Search via Lamarckian Evolutioncited by 151
  16. 2020Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagationcited by 142
  17. 2020A Survey on Evolutionary Neural Architecture Searchcited by 142
  18. 2020RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Networkcited by 141
  19. 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 134
  20. 2019FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Searchcited by 129
  21. 2019Enabling Spike-based Backpropagation for Training Deep Neural Network Architecturescited by 119
  22. 2019Neural Predictor for Neural Architecture Searchcited by 116
  23. 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 111
  24. 2020Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networkscited by 98
  25. 2019CARS: Continuous Evolution for Efficient Neural Architecture Searchcited by 79
  26. 2020NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Searchcited by 75
  27. 2021Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognitioncited by 71
  28. 2020DIET-SNN: Direct Input Encoding With Leakage and Threshold Optimization in Deep Spiking Neural Networkscited by 70
  29. 2020LIAF-Net: Leaky Integrate and Analog Fire Network for Lightweight and Efficient Spatiotemporal Information Processingcited by 56
  30. 2022Neural Architecture Search for Spiking Neural Networkscited by 52
  31. 2022Online Training Through Time for Spiking Neural Networkscited by 48
  32. 2020T2FSNN: Deep Spiking Neural Networks with Time-to-first-spike Codingcited by 45
  33. 2017Simple And Efficient Architecture Search for Convolutional Neural Networkscited by 40
  34. 2022AutoSNN: Towards Energy-Efficient Spiking Neural Networkscited by 40
  35. 2020Exploring the Connection Between Binary and Spiking Neural Networkscited by 33
  36. 2021KNAS: Green Neural Architecture Searchcited by 33
  37. 2022BrainCog: A Spiking Neural Network based Brain-inspired Cognitive Intelligence Engine for Brain-inspired AI and Brain Simulationcited by 32
  38. 2022Exploring Temporal Information Dynamics in Spiking Neural Networkscited by 23

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025LightSNN: Lightweight Architecture Search for Sparse and Accurate Spiking Neural Networkscited by 1