SNNSIR: A Simple Spiking Neural Network for Stereo Image Restoration
Not on the map. Why?
Abstract (arXiv)
Spiking Neural Networks (SNNs), characterized by discrete binary activations, offer high computational efficiency and low energy consumption, making them well-suited for computation-intensive tasks such as stereo image restoration. In this work, we propose SNNSIR, a simple yet effective Spiking Neural Network for Stereo Image Restoration, specifically designed under the spike-driven paradigm where neurons transmit information through sparse, event-based binary spikes. In contrast to existing hybrid SNN-ANN models that still rely on operations such as floating-point matrix division or exponentiation, which are incompatible with the binary and event-driven nature of SNNs, our proposed SNNSIR adopts a fully spike-driven architecture to achieve low-power and hardware-friendly computation. To address the expressiveness limitations of binary spiking neurons, we first introduce a lightweight Spike Residual Basic Block (SRBB) to enhance information flow via spike-compatible residual learning. Building on this, the Spike Stereo Convolutional Modulation (SSCM) module introduces simplified nonlinearity through element-wise multiplication and highlights noise-sensitive regions via cross-view-aware modulation. Complementing this, the Spike Stereo Cross-Attention (SSCA) module further improves stereo correspondence by enabling efficient bidirectional feature interaction across views within a spike-compatible framework. Extensive experiments on diverse stereo image restoration tasks, including rain streak removal, raindrop removal, low-light enhancement, and super-resolution demonstrate that our model achieves competitive restoration performance while significantly reducing computational overhead. These results highlight the potential for real-time, low-power stereo vision applications. The code will be available after the article is accepted.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 17 Aug 2025.
Builds on
38 of 49 references.
References · 38
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,786
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,687
- 2016Identity Mappings in Deep Residual Networkscited by 1,962
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,622
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
- 2022Simple Baselines for Image Restorationcited by 703
- 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
- 2021Deep Residual Learning in Spiking Neural Networkscited by 329
- 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 275
- 2022Spikformer: When Spiking Neural Network Meets Transformercited by 266
26 more
- 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 167
- 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
- 2023Spike-driven Transformercited by 143
- 2024Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chipscited by 99
- 2021Advancing Spiking Neural Networks towards Deep Residual Learningcited by 79
- 2022NAFSSR: Stereo Image Super-Resolution Using NAFNetcited by 75
- 2024Integer-Valued Training and Spike-Driven Inference Spiking Neural Network for High-performance and Energy-efficient Object Detectioncited by 66
- 2024Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Trainingcited by 58
- 2019Learning Parallax Attention for Stereo Image Super-Resolutioncited by 56
- 2024SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networkscited by 39
- 2020Learning to See Through Obstructionscited by 38
- 2020Holopix50k: A Large-Scale In-the-wild Stereo Image Datasetcited by 36
- 2020Symmetric Parallax Attention for Stereo Image Super-Resolutioncited by 35
- 2022Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Drivingcited by 30
- 2020Unifying Activation- and Timing-based Learning Rules for Spiking Neural Networkscited by 28
- 2021Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Priorcited by 18
- 2024Learning A Spiking Neural Network for Efficient Image Derainingcited by 16
- 2024UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagerycited by 15
- 2024HazyDet: Open-Source Benchmark for Drone-View Object Detection with Depth-Cues in Hazy Scenescited by 15
- 2021RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Derainingcited by 12
- 2024Cross-spectral Gated-RGB Stereo Depth Estimationcited by 8
- 2020Joint Spatial-Temporal Optimization for Stereo 3D Object Trackingcited by 7
- 2021Stereo Waterdrop Removal with Row-wise Dilated Attentioncited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.