# Spiking and neuromorphic RL

Area: [Deep reinforcement learning methods](https://mlsanity.com/deeprl/index.md). HTML: https://mlsanity.com/deeprl/spiking-and-neuromorphic-rl/

## Key facts

- Spiking and neuromorphic RL: 34 papers on arXiv since 2024 (data through 14 Oct 2026).
- 5 of its 34 mapped papers (15%) cite “Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learning” (2024, arXiv 2401.05444).
- 2 of its 34 mapped papers (6%) cite “Noisy Spiking Actor Network for Exploration” (2024, arXiv 2403.04162).
- 1 new papers 30 Sep–14 Oct.

## Most cited here

- [Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learning](https://mlsanity.com/paper/2401.05444/) (2024), cited by 5 papers here
- [Noisy Spiking Actor Network for Exploration](https://mlsanity.com/paper/2403.04162/) (2024), cited by 2 papers here
- [Biologically-Plausible Topology Improved Spiking Actor Network for Efficient Deep Reinforcement Learning](https://mlsanity.com/paper/2403.20163/) (2024), cited by 2 papers here
- [Proxy Target: Bridging the Gap Between Discrete Spiking Neural Networks and Continuous Control](https://mlsanity.com/paper/2505.24161/) (2025), cited by 2 papers here
- [Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learning](https://mlsanity.com/paper/2503.00713/) (2025), cited by 1 papers here

## New (30 Sep–14 Oct)

- [Common-Mode Errors Limit Low-Timestep Deep Spiking Q-Networks](https://mlsanity.com/paper/2610.07808/) (2026-10-06)