Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
While the spatial directivity of multichannel speech enhancement algorithms improves with the number of microphones, fitting large capture arrays into real-world edge devices is typically limited by physical constraints. To overcome this limitation, we propose Spatial-Magnifier, a neural network designed to generate virtual microphone (VM) signals from a limited set of real microphone (RM) measurements. Moreover, we introduce the Spatial Audio Representation Learning (SARL) framework, which leverages estimated VM signals and features to condition a downstream speech enhancement system. Experimental results demonstrate that the proposed framework outperforms existing spatial upsampling baselines across various speech extraction systems, including end-to-end multichannel speech enhancement and neural beamforming. The proposed method nearly recovers the oracle performance achieved when all microphones are available.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 19 of its 34 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
19 of 34 references.
Closest ancestors · 4
Same direction, newest first
- 2024FoVNet: Configurable Field-of-View Speech Enhancement with Low Computation and Distortion for Smart Glasses12 Aug
- 2023DeFTAN-II: Efficient Multichannel Speech Enhancement with Subgroup Processing30 Aug
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancement22 Sep
- 2022STFT-Domain Neural Speech Enhancement with Very Low Algorithmic Latency21 Apr
Other references · 15
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,462
- 2018SDR - half-baked or well done?cited by 626
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 596
- 2019Dynamic Convolution: Attention over Convolution Kernelscited by 361
- 2020The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Resultscited by 230
- 2018Deep Back-Projection Networks For Super-Resolutioncited by 226
- 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 175
- 2023SpatialNet: Extensively Learning Spatial Information for Multichannel Joint Speech Separation, Denoising and Dereverberationcited by 39
- 2020Multi-Microphone Complex Spectral Mapping for Speech Dereverberationcited by 25
- 2024Robust DOA estimation using deep acoustic imagingcited by 5
- 2023Self-Supervised Learning of Spatial Acoustic Representation with Cross-Channel Signal Reconstruction and Multi-Channel Conformercited by 4
- 2024DeFT-Mamba: Universal Multichannel Sound Separation and Polyphonic Audio Classificationcited by 4
3 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025An Analysis of Joint Nonlinear Spatial Filtering for Spatial Aliasing Reduction
- 2022Insights Into Deep Non-linear Filters for Improved Multi-channel Speech Enhancement
- 2025Spatial-Filter-Bank-Based Neural Method for Multichannel Speech Enhancement
- 2023Hierarchical Modeling of Spatial Cues via Spherical Harmonics for Multi-Channel Speech Enhancement
- 2025Microphone Array Signal Processing and Deep Learning for Speech Enhancement
- 2021Nonlinear Spatial Filtering in Multichannel Speech Enhancement
- 2021Complex-valued Spatial Autoencoders for Multichannel Speech Enhancement
- 2022A Neural Beam Filter for Real-time Multi-channel Speech Enhancement