Spiking Neural Beamforming for Multichannel Speech Enhancement on the Edge
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
Speech enhancement with wearable and edge devices requires architectures that balance enhancement quality against power and memory resources. Spiking Neural Networks (SNNs) offer a promising path towards this goal through sparse, event-driven computation, but existing SNN-based speech enhancement methods are largely restricted to single-channel processing and therefore cannot exploit the spatial diversity available from microphone arrays. In this work, we propose a fully SNN framework for multichannel speech enhancement based on a fully connected architecture (FC-SNN) with sequential spike encoding, derived from a compact artificial neural network (ANN) baseline via leaky integrate-and-fire neurons. We characterize how enhancement performance scales with model size and spike-train length relative to ANN and classical beamforming baselines, and report the resulting parameter counts and computational complexity. We further compare direct and rate spike encoding, revealing a clear trade-off between event-driven computation and enhancement performance, and use these results to identify favorable configurations for edge devices.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 20 of its 39 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
20 of 39 references.
Closest ancestors · 4
Same direction, newest first
- 2024DPSNN: Spiking Neural Network for Low-Latency Streaming Speech Enhancement14 Aug
- 2023DeFTAN-II: Efficient Multichannel Speech Enhancement with Subgroup Processing30 Aug
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug
- 2022Insights Into Deep Non-linear Filters for Improved Multi-channel Speech Enhancement27 Jun
Other references · 16
- 2018SDR - half-baked or well done?cited by 626
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 596
- 2021Deep Residual Learning in Spiking Neural Networkscited by 335
- 2020DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancementcited by 284
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 261
- 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 234
- 2018gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Accelerationcited by 54
- 2019FaSNet: Low-latency Adaptive Beamforming for Multi-microphone Audio Processingcited by 52
- 2021EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environmentscited by 41
- 2020ADL-MVDR: All deep learning MVDR beamformer for target speech separationcited by 40
- 2022Rate Coding or Direct Coding: Which One is Better for Accurate, Robust, and Energy-efficient Spiking Neural Networks?cited by 26
- 2020Real-time binaural speech separation with preserved spatial cuescited by 22
4 more
- 2023Multi-channel Speech Separation Using Spatially Selective Deep Non-linear Filterscited by 20
- 2020Dual Application of Speech Enhancement for Automatic Speech Recognitioncited by 18
- 2023The Intel Neuromorphic DNS Challengecited by 12
- 2022Towards Unified All-Neural Beamforming for Time and Frequency Domain Speech Separationcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Single Channel Speech Enhancement Using U-Net Spiking Neural Networks
- 2024Towards Ultra-Low-Power Neuromorphic Speech Enhancement with Spiking-FullSubNet
- 2026Neuromorphic Speech Enhancement with Dual-Branch Spiking Neural Networks
- 2026DBHN-Net: Dual-Branch Hybrid Neural Network For Low-Complexity Monaural Speech Enhancement
- 2026Low-Power End-to-End Cochlear Implant Speech Denoising with Spiking Neural Networks ↗
- 2024Decoupled Spatial and Temporal Processing for Resource Efficient Multichannel Speech Enhancement
- 2022A Neural Beam Filter for Real-time Multi-channel Speech Enhancement
- 2023Spiking Structured State Space Model for Monaural Speech Enhancement