Error Amplification Limits ANN-to-SNN Conversion in Continuous Control
Not on the map. Why?
Abstract (arXiv)
Spiking Neural Networks (SNNs) can achieve competitive performance by converting already existing well-trained Artificial Neural Networks (ANNs), avoiding further costly training. This property is particularly attractive in Reinforcement Learning (RL), where training through environment interaction is expensive and potentially unsafe. However, existing conversion methods perform poorly in continuous control, where suitable baselines are largely absent. We identify error amplification as the key cause: small action approximation errors become temporally correlated across decision steps, inducing cumulative state distribution shift and severe performance degradation. To address this issue, we propose Cross-Step Residual Potential Initialization (CRPI), a lightweight gradient-free mechanism that carries over residual membrane potentials across decision steps to suppress temporally correlated errors. Experiments on continuous control benchmarks with both vector and visual observations demonstrate that CRPI can be integrated into existing conversion pipelines and substantially recovers lost performance. Our results highlight continuous control as a critical and challenging benchmark for ANN-to-SNN conversion, where small errors can be strongly amplified and impact performance. Code is available at https://github.com/xuzijie32/ANN2SNN-CRPI.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 87 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
50 of 87 references.
References · 50
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Trust Region Policy Optimizationcited by 2,503
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2016OpenAI Gymcited by 1,684
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
- 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 573
- 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
- 2020dm_control: Software and Tasks for Continuous Controlcited by 368
- 2021Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learningcited by 359
38 more
- 2016Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updatescited by 342
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2020RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Networkcited by 141
- 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 134
- 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 116
- 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 111
- 2018Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rulescited by 64
- 2020Deep Reinforcement Learning with Population-Coded Spiking Neural Network for Continuous Controlcited by 44
- 2023Fast-SNN: Fast Spiking Neural Network by Converting Quantized ANNcited by 42
- 2022Optimized Potential Initialization for Low-latency Spiking Neural Networkscited by 39
- 2023Reducing ANN-SNN Conversion Error through Residual Membrane Potentialcited by 39
- 2022Masked Spiking Transformercited by 38
- 2023Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikescited by 38
- 2018Fast and Efficient Information Transmission with Burst Spikes in Deep Spiking Neural Networkscited by 34
- 2020Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardwarecited by 32
- 2022Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikescited by 30
- 2022Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithmcited by 27
- 2021Human-Level Control through Directly-Trained Deep Spiking Q-Networkscited by 23
- 2023TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modellingcited by 21
- 2020Strategy and Benchmark for Converting Deep Q-Networks to Event-Driven Spiking Neural Networkscited by 20
- 2022General Intelligence Requires Rethinking Explorationcited by 20
- 2022Biologically Inspired Dynamic Thresholds for Spiking Neural Networkscited by 18
- 2024SpikeZIP-TF: Conversion is All You Need for Transformer-based SNNcited by 16
- 2022Deep Reinforcement Learning with Spiking Q-learningcited by 15
- 2021Efficient Spiking Neural Networks with Radix Encodingcited by 12
- 2022An Exact Mapping From ReLU Networks to Spiking Neural Networkscited by 12
- 2024Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learningcited by 10
- 2025Towards High-performance Spiking Transformers from ANN to SNN Conversioncited by 10
- 2022Solving the Spike Feature Information Vanishing Problem in Spiking Deep Q Network with Potential Based Normalizationcited by 9
- 2025Differential Coding for Training-Free ANN-to-SNN Conversioncited by 9
- 2024Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networkcited by 6
- 2024Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Networkcited by 5
- 2024Inference-Scale Complexity in ANN-SNN Conversion for High-Performance and Low-Power Applicationscited by 4
- 2025Proxy Target: Bridging the Gap Between Discrete Spiking Neural Networks and Continuous Controlcited by 4
- 2024GRSN: Gated Recurrent Spiking Neurons for POMDPs and MARLcited by 3
- 2025Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learningcited by 3
- 2025CaRe-BN: Precise Moving Statistics for Stabilizing Spiking Neural Networks in Reinforcement Learningcited by 2
Built on by
Not cited yet.