mlsanityData to 19 Oct 2026

Neural Directed Speech Enhancement with Dual Microphone Array in High Noise Scenario

arXiv 2412.18141 ↗First posted 24 Dec 2024eess.AS cs.SDcited by 2

On the map: Speech and audio language models → Speech enhancement and noise suppression

Abstract (arXiv)

In multi-speaker scenarios, leveraging spatial features is essential for enhancing target speech. While with limited microphone arrays, developing a compact multi-channel speech enhancement system remains challenging, especially in extremely low signal-to-noise ratio (SNR) conditions. To tackle this issue, we propose a triple-steering spatial selection method, a flexible framework that uses three steering vectors to guide enhancement and determine the enhancement range. Specifically, we introduce a causal-directed U-Net (CDUNet) model, which takes raw multi-channel speech and the desired enhancement width as inputs. This enables dynamic adjustment of steering vectors based on the target direction and fine-tuning of the enhancement region according to the angular separation between the target and interference signals. Our model with only a dual microphone array, excels in both speech quality and downstream task performance. It operates in real-time with minimal parameters, making it ideal for low-latency, on-device streaming applications.

Key facts. Cited by 2 papers in the map (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 24 of its 39 references that are in the map. First posted on arXiv 24 Dec 2024.

Builds on

24 of 39 references.

Closest ancestors · 5

Same direction, newest first

  1. 2023Time-domain Speech Enhancement Assisted by Multi-resolution Frequency Encoder and Decoder26 Mar
  2. 2023Guided Speech Enhancement Network13 Mar
  3. 2022FullSubNet+: Channel Attention FullSubNet with Complex Spectrograms for Speech Enhancement23 Mar
  4. 2022HGCN: Harmonic gated compensation network for speech enhancement30 Jan
  5. 2021MetricGAN-U: Unsupervised speech enhancement/ dereverberation based only on noisy/ reverberated speech12 Oct

Other references · 19

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,832
  2. 2018CBAM: Convolutional Block Attention Modulecited by 2,495
  3. 2022TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separationcited by 121
  4. 2022Music Source Separation with Band-split RNNcited by 89
  5. 2023Multi-channel Speech Separation Using Spatially Selective Deep Non-linear Filterscited by 20
  6. 2022Distance-Based Sound Separationcited by 12
  7. 2022Spatially Selective Deep Non-linear Filters for Speaker Extractioncited by 9
  8. 2021VSEGAN: Visual Speech Enhancement Generative Adversarial Networkcited by 8
  9. 2021Complex Neural Spatial Filter: Enhancing Multi-channel Target Speech Separation in Complex Domaincited by 8
  10. 2022Learning to Separate Voices by Spatial Regionscited by 6
  11. 2024Contrastive Learning With Audio Discrimination For Customizable Keyword Spotting In Continuous Speechcited by 6
  12. 2024Semi-supervised Learning for Code-Switching ASR with Large Language Model Filtercited by 6
7 more
  1. 2024Text-aware Speech Separation for Multi-talker Keyword Spottingcited by 5
  2. 2024NTC-KWS: Noise-aware CTC for Robust Keyword Spottingcited by 5
  3. 2024TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducercited by 3
  4. 2020Two Channel Audio Zooming System For Smartphonecited by 2
  5. 2024Binaural Angular Separation Networkcited by 2
  6. 2022EMGSE: Acoustic/EMG Fusion for Multimodal Speech Enhancementcited by 1
  7. 2024Streaming Keyword Spotting Boosted by Cross-layer Discrimination Consistencycited by 1

Built on by

Cited by year (2026 to 19 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Advances in Microphone Array Processing and Multichannel Speech Enhancement
  2. 2021Time-domain Ad-hoc Array Speech Enhancement Using a Triple-path Network
  3. 2022A Neural Beam Filter for Real-time Multi-channel Speech Enhancement
  4. 2022Multi-channel target speech enhancement based on ERB-scaled spatial coherence features ↗
  5. 2026Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement
  6. 2023DFSNet: A Steerable Neural Beamformer Invariant to Microphone Array Configuration for Real-Time, Low-Latency Speech Enhancement
  7. 2022Insights Into Deep Non-linear Filters for Improved Multi-channel Speech Enhancement
  8. 2024Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers