mlsanityData to 7 Oct 2026

Error Amplification Limits ANN-to-SNN Conversion in Continuous Control

arXiv 2601.21778 ↗First posted 29 Jan 2026cs.NE cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Spiking Neural Networks (SNNs) can achieve competitive performance by converting already existing well-trained Artificial Neural Networks (ANNs), avoiding further costly training. This property is particularly attractive in Reinforcement Learning (RL), where training through environment interaction is expensive and potentially unsafe. However, existing conversion methods perform poorly in continuous control, where suitable baselines are largely absent. We identify error amplification as the key cause: small action approximation errors become temporally correlated across decision steps, inducing cumulative state distribution shift and severe performance degradation. To address this issue, we propose Cross-Step Residual Potential Initialization (CRPI), a lightweight gradient-free mechanism that carries over residual membrane potentials across decision steps to suppress temporally correlated errors. Experiments on continuous control benchmarks with both vector and visual observations demonstrate that CRPI can be integrated into existing conversion pipelines and substantially recovers lost performance. Our results highlight continuous control as a critical and challenging benchmark for ANN-to-SNN conversion, where small errors can be strongly amplified and impact performance. Code is available at https://github.com/xuzijie32/ANN2SNN-CRPI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 87 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

50 of 87 references.

References · 50

  1. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  2. 2015Continuous control with deep reinforcement learningcited by 3,279
  3. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  4. 2015Trust Region Policy Optimizationcited by 2,503
  5. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
  6. 2016OpenAI Gymcited by 1,684
  7. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  8. 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
  9. 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 573
  10. 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
  11. 2020dm_control: Software and Tasks for Continuous Controlcited by 368
  12. 2021Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learningcited by 359
38 more
  1. 2016Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updatescited by 342
  2. 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
  3. 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
  4. 2020RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Networkcited by 141
  5. 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 134
  6. 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 116
  7. 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 111
  8. 2018Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rulescited by 64
  9. 2020Deep Reinforcement Learning with Population-Coded Spiking Neural Network for Continuous Controlcited by 44
  10. 2023Fast-SNN: Fast Spiking Neural Network by Converting Quantized ANNcited by 42
  11. 2022Optimized Potential Initialization for Low-latency Spiking Neural Networkscited by 39
  12. 2023Reducing ANN-SNN Conversion Error through Residual Membrane Potentialcited by 39
  13. 2022Masked Spiking Transformercited by 38
  14. 2023Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikescited by 38
  15. 2018Fast and Efficient Information Transmission with Burst Spikes in Deep Spiking Neural Networkscited by 34
  16. 2020Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardwarecited by 32
  17. 2022Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikescited by 30
  18. 2022Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithmcited by 27
  19. 2021Human-Level Control through Directly-Trained Deep Spiking Q-Networkscited by 23
  20. 2023TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modellingcited by 21
  21. 2020Strategy and Benchmark for Converting Deep Q-Networks to Event-Driven Spiking Neural Networkscited by 20
  22. 2022General Intelligence Requires Rethinking Explorationcited by 20
  23. 2022Biologically Inspired Dynamic Thresholds for Spiking Neural Networkscited by 18
  24. 2024SpikeZIP-TF: Conversion is All You Need for Transformer-based SNNcited by 16
  25. 2022Deep Reinforcement Learning with Spiking Q-learningcited by 15
  26. 2021Efficient Spiking Neural Networks with Radix Encodingcited by 12
  27. 2022An Exact Mapping From ReLU Networks to Spiking Neural Networkscited by 12
  28. 2024Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learningcited by 10
  29. 2025Towards High-performance Spiking Transformers from ANN to SNN Conversioncited by 10
  30. 2022Solving the Spike Feature Information Vanishing Problem in Spiking Deep Q Network with Potential Based Normalizationcited by 9
  31. 2025Differential Coding for Training-Free ANN-to-SNN Conversioncited by 9
  32. 2024Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networkcited by 6
  33. 2024Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Networkcited by 5
  34. 2024Inference-Scale Complexity in ANN-SNN Conversion for High-Performance and Low-Power Applicationscited by 4
  35. 2025Proxy Target: Bridging the Gap Between Discrete Spiking Neural Networks and Continuous Controlcited by 4
  36. 2024GRSN: Gated Recurrent Spiking Neurons for POMDPs and MARLcited by 3
  37. 2025Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learningcited by 3
  38. 2025CaRe-BN: Precise Moving Statistics for Stabilizing Spiking Neural Networks in Reinforcement Learningcited by 2

Built on by

Not cited yet.