mlsanityData to 14 Oct 2026

Spiking and neuromorphic RL

34 papers0 this weekHigh confidence in this grouping: the papers form one clear topicHigh confidence in this grouping: the papers form one clear topic · About

Keywords: spiking, neuromorphic, snns, spiking neural, snn

Key facts. Spiking and neuromorphic RL: 34 papers on arXiv since 2024 (data through 14 Oct 2026). 5 of its 34 mapped papers (15%) cite “Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learning” (2024, arXiv 2401.05444). 1 new paper 30 Sep–14 Oct.

What’s new

30 Sep – 14 Oct 2026

1 new since 30 Sep

  1. Common-Mode Errors Limit Low-Timestep Deep Spiking Q-Networks

Foundations

Most cited by papers here

  1. Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learning2024cited by 5 here
  2. Noisy Spiking Actor Network for Exploration2024cited by 2 here
  3. Biologically-Plausible Topology Improved Spiking Actor Network for Efficient Deep Reinforcement Learning2024cited by 2 here
  4. Proxy Target: Bridging the Gap Between Discrete Spiking Neural Networks and Continuous Control2025cited by 2 here
  5. Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learning2025cited by 1 here

Lineage

The papers this direction builds on, oldest first.

Each paper on the line cites the one before.

  1. 2024Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learningcited by 5 here
  2. 2024Noisy Spiking Actor Network for Explorationcited by 2 here
  3. 2025Proxy Target: Bridging the Gap Between Discrete Spiking Neural Networks and Continuous Controlcited by 2 here
15 more it builds on, not in this chain
  1. 2024Sharing Knowledge in Multi-Task Deep Reinforcement Learningcited by 1 here
  2. 2024Biologically-Plausible Topology Improved Spiking Actor Network for Efficient Deep Reinforcement Learningcited by 2 here
  3. 2024Neural Network Compression for Reinforcement Learning Taskscited by 1 here
  4. 2024Reinforcement learningcited by 2 here
  5. 2024Toward Enhanced Reinforcement Learning-Based Resource Management via Digital Twin: Opportunities, Applications, and Challengescited by 1 here
  6. 2024Safe Reinforcement Learning for Power System Control: A Reviewcited by 1 here
  7. 2024The Impact of Quantization and Pruning on Deep Reinforcement Learning Modelscited by 1 here
  8. 2024Gymnasium: A Standard Interface for Reinforcement Learning Environmentscited by 5 here
  9. 2024RL-Pruner: Structured Pruning Using Reinforcement Learning for CNN Compression and Accelerationcited by 1 here
  10. 2025Synthesis of Model Predictive Control and Reinforcement Learning: Survey and Classificationcited by 1 here
  11. 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 1 here
  12. 2025Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learningcited by 1 here
  13. 2025Network Sparsity Unlocks the Scaling Potential of Deep Reinforcement Learningcited by 1 here
  14. 2025Sim-to-Real Transfer in Deep Reinforcement Learning for Bipedal Locomotioncited by 1 here
  15. 2025New Spiking Architecture for Multi-Modal Decision-Making in Autonomous Vehiclescited by 1 here

Browse

29 of 34, ranked 6–34

  1. 6Training slow silicon neurons to control extremely fast robots with spiking reinforcement learning20260
  2. 7Signal-Adaptive Trust Regions for Gradient-Free Optimization of Recurrent Spiking Neural Networks20260
  3. 8Fuzzy Encoding-Decoding to Improve Spiking Q-Learning Performance in Autonomous Driving20260
  4. 9Application of Deep Reinforcement Learning to Event-Triggered Control for Networked Artificial Pancreas Systems20260
  5. 10A Neuromorphic Reinforcement Learning Framework for Efficient Pathfinding in Robotic Mobile Fulfillment Systems20260
  6. 11Spiking Neural Networks for Continuous Control: Neuromorphic Reinforcement Learning in Conventional Computing20260
  7. 12Spiking Neural Network Predicting Sequence of the External Worlds States in Model-Based Reinforcement Learning20260
  8. 13All On-Board: Fully On-Chip Neuromorphic Q-Learning with Embedded CartPole Simulation20260
  9. 14Massively Parallel Reinforcement Learning with a Chaotic Reconfigurable Clockless Chip20260
  10. 15SpikeRL: A Scalable and Energy-efficient Framework for Deep Spiking Reinforcement Learning20250
All 29
  1. 16A PyTorch-Compatible Spike Encoding Framework for Energy-Efficient Neuromorphic Applications20250
  2. 17Energy-Efficient Deep Reinforcement Learning with Spiking Transformers20250
  3. 18SPEAR: Structured Pruning for Spiking Neural Networks via Synaptic Operation Estimation and Reinforcement Learning20250
  4. 19Learning to Control Dynamical Agents via Spiking Neural Networks and Metropolis-Hastings Sampling20250
  5. 20Hardware-Aware Fine-Tuning of Spiking Q-Networks on the SpiNNaker2 Neuromorphic Platform20250
  6. 21Fully Spiking Actor-Critic Neural Network for Robotic Manipulation20250
  7. 22CaRe-BN: Precise Moving Statistics for Stabilizing Spiking Neural Networks in Reinforcement Learning20250
  8. 23Adaptive Surrogate Gradients for Sequential Reinforcement Learning in Spiking Neural Networks20250
  9. 24Learning Quantized Continuous Controllers for Integer Hardware20250
  10. 25Bellman Memory Units: A neuromorphic framework for synaptic reinforcement learning with an evolving network topology20250
  11. 26Hardware-Software Collaborative Computing of Photonic Spiking Reinforcement Learning for Robotic Continuous Control20250
  12. 27Autonomous Reinforcement Learning Robot Control with Intel's Loihi 2 Neuromorphic Hardware20250
  13. 28NeuRehab: A Reinforcement Learning and Spiking Neural Network-Based Rehab Automation Framework20250
  14. 29Control of Microrobots with Reinforcement Learning under On-Device Compute Constraints20250
  15. 30Self-training superconducting neuromorphic circuits using reinforcement learning rules20240
  16. 31Trapezoidal Gradient Descent for Effective Reinforcement Learning in Spiking Networks20240
  17. 32Robust Iterative Value Conversion: Deep Reinforcement Learning for Neurochip-driven Edge Robots20240
  18. 33Core Placement Optimization of Many-core Brain-Inspired Near-Storage Systems for Spiking Neural Network Training20240
  19. 34Enabling Energy-Efficient Simultaneous Multi-Task Reinforcement Learning through Spiking Neural Networks with Active Dendrites for Bio-inspired Generalist Agents20240