Implicit Neural Spatial Filtering for Multichannel Source Separation in the Waveform Domain
Not on the map. Why?
Abstract (arXiv)
We present a single-stage casual waveform-to-waveform multichannel model that can separate moving sound sources based on their broad spatial locations in a dynamic acoustic scene. We divide the scene into two spatial regions containing, respectively, the target and the interfering sound sources. The model is trained end-to-end and performs spatial processing implicitly, without any components based on traditional processing or use of hand-crafted spatial features. We evaluate the proposed model on a real-world dataset and show that the model matches the performance of an oracle beamformer followed by a state-of-the-art single-channel enhancement network.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 26 of its 48 references that are in the map. First posted on arXiv 30 Jun 2022.
Builds on
26 of 48 references.
References · 26
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 400
- 2017Supervised Speech Separation Based on Deep Learning: An Overviewcited by 213
- 2020Real Time Speech Enhancement in the Waveform Domaincited by 183
- 2019Music Source Separation in the Waveform Domaincited by 98
- 2021Hybrid Spectrogram and Waveform Source Separationcited by 90
- 2019End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separationcited by 31
- 2019FaSNet: Low-latency Adaptive Beamforming for Multi-microphone Audio Processingcited by 23
- 2020The Cone of Silence: Speech Separation by Localizationcited by 21
- 2020ADL-MVDR: All deep learning MVDR beamformer for target speech separationcited by 20
- 2020Channel-Attention Dense U-Net for Multichannel Speech Enhancementcited by 18
- 2020Enhancing End-to-End Multi-channel Speech Separation via Spatial Feature Learningcited by 12
- 2019End-to-End Multi-Channel Speech Separationcited by 11
14 more
- 2020Neural Spatio-Temporal Beamformer for Target Speech Separationcited by 9
- 2020End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamformingcited by 9
- 2020Multi-microphone Complex Spectral Mapping for Utterance-wise and Continuous Speech Separationcited by 9
- 2020Multi-Microphone Complex Spectral Mapping for Speech Dereverberationcited by 8
- 2020On End-to-end Multi-channel Time Domain Speech Separation in Reverberant Environmentscited by 7
- 2020DESNet: A Multi-channel Network for Simultaneous Speech Dereverberation, Enhancement and Separationcited by 6
- 2020An End-to-end Architecture of Online Multi-channel Speech Separationcited by 5
- 2021Multi-Channel Speech Enhancement using Graph Neural Networkscited by 5
- 2018Deep Learning Based Speech Beamformingcited by 4
- 2019Multichannel Speech Enhancement by Raw Waveform-mapping using Fully Convolutional Networkscited by 4
- 2018Cracking the cocktail party problem by multi-beam deep attractor networkcited by 3
- 2021Complex Neural Spatial Filter: Enhancing Multi-channel Target Speech Separation in Complex Domaincited by 3
- 2021Multichannel Speech Enhancement without Beamformingcited by 2
- 2022A Neural Beam Filter for Real-time Multi-channel Speech Enhancementcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 0; 2025: 1.
6 papers.
- 2023Multi-channel Speech Separation Using Spatially Selective Deep Non-linear Filterscited by 10
- 2023ReZero: Region-customizable Sound Extractioncited by 10
- 2022Spatially Selective Deep Non-linear Filters for Speaker Extractioncited by 4
- 2023Multi-Microphone Speaker Separation by Spatial Regionscited by 4
- 2023Attention-Driven Multichannel Speech Enhancement in Moving Sound Source Scenarioscited by 0
- 2025End-to-End Multi-Microphone Speaker Extraction Using Relative Transfer Functionscited by 0
- 2025End-to-End Multi-Microphone Speaker Extraction Using Relative Transfer Functions10 Feb 2025
- 2023Attention-Driven Multichannel Speech Enhancement in Moving Sound Source Scenarios17 Dec 2023
- 2023ReZero: Region-customizable Sound Extraction31 Aug 2023
- 2023Multi-channel Speech Separation Using Spatially Selective Deep Non-linear Filters24 Apr 2023
- 2023Multi-Microphone Speaker Separation by Spatial Regions13 Mar 2023
- 2022Spatially Selective Deep Non-linear Filters for Speaker Extraction4 Nov 2022