A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancement
Not on the map. Why?
Abstract (arXiv)
Despite noise suppression being a mature area in signal processing, it remains highly dependent on fine tuning of estimator algorithms and parameters. In this paper, we demonstrate a hybrid DSP/deep learning approach to noise suppression. A deep neural network with four hidden layers is used to estimate ideal critical band gains, while a more traditional pitch filter attenuates noise between pitch harmonics. The approach achieves significantly higher quality than a traditional minimum mean squared error spectral estimator, while keeping the complexity low enough for real-time operation at 48 kHz on a low-power processor.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 5; 2024: 4; 2025: 7; 2026: 5.
34 papers.
Sort:
- 2021DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filteringcited by 38
- 2022Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Modelcited by 37
- 2023DeepFilterNet: Perceptually Motivated Real-Time Speech Enhancementcited by 25
- 2022DeepFilterNet2: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audiocited by 23
- 2022Accelerating RNN-based Speech Enhancement on a Multi-Core MCU with Mixed FP16-INT8 Post-Training Quantizationcited by 8
- 2021Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoderscited by 7
- 2024Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancementcited by 4
- 2023In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platformscited by 3
- 2025BanglaTalk: Towards Real-Time Speech Assistance for Bengali Regional Dialectscited by 3
- 2022Neural Augmented Kalman Filtering with Bollinger Bands for Pairs Tradingcited by 2
- 2025CleanMel: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASRcited by 2
- 2025A Two-Stage Hierarchical Deep Filtering Framework for Real-Time Speech Enhancementcited by 2
22 more
- 2021Best Practices for Noise-Based Augmentation to Improve the Performance of Deployable Speech-Based Emotion Recognition Systemscited by 1
- 2021RNNoise-Ex: Hybrid Speech Enhancement System based on RNN and Spectral Featurescited by 1
- 2022Denoising Induction Motor Sounds Using an Autoencodercited by 1
- 2023CheapNET: Improving Light-weight speech enhancement network by projected loss functioncited by 1
- 2025A Synergistic Framework of Nonlinear Acoustic Computing and Reinforcement Learning for Real-World Human-Robot Interactioncited by 1
- 2025Lightweight DNN for Full-Band Speech Denoising on Mobile Devices: Exploiting Long and Short Temporal Patternscited by 1
- 2021Full Attention Bidirectional Deep Learning Structure for Single Channel Speech Enhancementcited by 0
- 2021Task-aware Warping Factors in Mask-based Speech Enhancementcited by 0
- 2022Audio Defect Detection in Music with Deep Networkscited by 0
- 2022Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNetcited by 0
- 2023Efficient Monaural Speech Enhancement using Spectrum Attention Fusioncited by 0
- 2023Unveiling the frontiers of deep learning: innovations shaping diverse domainscited by 0
- 2024ConcateNet: Dialogue Separation Using Local And Global Feature Concatenationcited by 0
- 2024aTENNuate: Optimized Real-time Speech Enhancement with Deep SSMs on Raw Audiocited by 0
- 2024A Recurrent Neural Network Approach to the Answering Machine Detection Problemcited by 0
- 2025DFingerNet: Noise-Adaptive Speech Enhancement for Hearing Aidscited by 0
- 2025UL-UNAS: Ultra-Lightweight U-Nets for Real-Time Speech Enhancement via Network Architecture Searchcited by 0
- 2026An Interpretable, Controllable Time-Varying IIR Denoiser for On-Device Assistive Hearingcited by 0
- 2026ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilotscited by 0
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancementcited by 0
- 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancementcited by 0
- 2026Transformer-based Neural Beamforming for Real-Time Speech Enhancement on Smart Low-Power Hearable Devicescited by 0
- 2026Transformer-based Neural Beamforming for Real-Time Speech Enhancement on Smart Low-Power Hearable Devices27 Sep 2026
- 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement24 Sep 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots16 Jun 2026
- 2026An Interpretable, Controllable Time-Varying IIR Denoiser for On-Device Assistive Hearing3 Mar 2026
- 2025BanglaTalk: Towards Real-Time Speech Assistance for Bengali Regional Dialects7 Oct 2025
- 2025Lightweight DNN for Full-Band Speech Denoising on Mobile Devices: Exploiting Long and Short Temporal Patterns5 Sep 2025
- 2025A Two-Stage Hierarchical Deep Filtering Framework for Real-Time Speech Enhancement1 Jun 2025
- 2025A Synergistic Framework of Nonlinear Acoustic Computing and Reinforcement Learning for Real-World Human-Robot Interaction4 May 2025
- 2025UL-UNAS: Ultra-Lightweight U-Nets for Real-Time Speech Enhancement via Network Architecture Search1 Mar 2025
- 2025CleanMel: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASR27 Feb 2025
- 2025DFingerNet: Noise-Adaptive Speech Enhancement for Hearing Aids17 Jan 2025
22 more
- 2024Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement4 Nov 2024
- 2024A Recurrent Neural Network Approach to the Answering Machine Detection Problem7 Oct 2024
- 2024aTENNuate: Optimized Real-time Speech Enhancement with Deep SSMs on Raw Audio5 Sep 2024
- 2024ConcateNet: Dialogue Separation Using Local And Global Feature Concatenation16 Aug 2024
- 2023CheapNET: Improving Light-weight speech enhancement network by projected loss function27 Nov 2023
- 2023Unveiling the frontiers of deep learning: innovations shaping diverse domains6 Sep 2023
- 2023In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms5 Sep 2023
- 2023Efficient Monaural Speech Enhancement using Spectrum Attention Fusion4 Aug 2023
- 2023DeepFilterNet: Perceptually Motivated Real-Time Speech Enhancement14 May 2023
- 2022Neural Augmented Kalman Filtering with Bollinger Bands for Pairs Trading19 Oct 2022
- 2022Accelerating RNN-based Speech Enhancement on a Multi-Core MCU with Mixed FP16-INT8 Post-Training Quantization14 Oct 2022
- 2022Denoising Induction Motor Sounds Using an Autoencoder8 Aug 2022
- 2022DeepFilterNet2: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audio11 May 2022
- 2022Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNet22 Feb 2022
- 2022Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Model15 Feb 2022
- 2022Audio Defect Detection in Music with Deep Networks11 Feb 2022
- 2021DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filtering11 Oct 2021
- 2021Task-aware Warping Factors in Mask-based Speech Enhancement27 Aug 2021
- 2021Full Attention Bidirectional Deep Learning Structure for Single Channel Speech Enhancement27 Aug 2021
- 2021RNNoise-Ex: Hybrid Speech Enhancement System based on RNN and Spectral Features25 May 2021
- 2021Best Practices for Noise-Based Augmentation to Improve the Performance of Deployable Speech-Based Emotion Recognition Systems18 Apr 2021
- 2021Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoders12 Feb 2021
- 2021DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filteringcited by 38
- 2022Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Modelcited by 37
- 2023DeepFilterNet: Perceptually Motivated Real-Time Speech Enhancementcited by 25
- 2022DeepFilterNet2: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audiocited by 23
- 2022Accelerating RNN-based Speech Enhancement on a Multi-Core MCU with Mixed FP16-INT8 Post-Training Quantizationcited by 8
- 2021Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoderscited by 7
- 2024Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancementcited by 4
- 2023In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platformscited by 3
- 2025BanglaTalk: Towards Real-Time Speech Assistance for Bengali Regional Dialectscited by 3
- 2022Neural Augmented Kalman Filtering with Bollinger Bands for Pairs Tradingcited by 2
- 2025CleanMel: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASRcited by 2
- 2025A Two-Stage Hierarchical Deep Filtering Framework for Real-Time Speech Enhancementcited by 2
12 most cited of 34 All 34 (JSON)
- 2026Transformer-based Neural Beamforming for Real-Time Speech Enhancement on Smart Low-Power Hearable Devices27 Sep 2026
- 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement24 Sep 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots16 Jun 2026
- 2026An Interpretable, Controllable Time-Varying IIR Denoiser for On-Device Assistive Hearing3 Mar 2026
- 2025BanglaTalk: Towards Real-Time Speech Assistance for Bengali Regional Dialects7 Oct 2025
- 2025Lightweight DNN for Full-Band Speech Denoising on Mobile Devices: Exploiting Long and Short Temporal Patterns5 Sep 2025
- 2025A Two-Stage Hierarchical Deep Filtering Framework for Real-Time Speech Enhancement1 Jun 2025
- 2025A Synergistic Framework of Nonlinear Acoustic Computing and Reinforcement Learning for Real-World Human-Robot Interaction4 May 2025
- 2025UL-UNAS: Ultra-Lightweight U-Nets for Real-Time Speech Enhancement via Network Architecture Search1 Mar 2025
- 2025CleanMel: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASR27 Feb 2025
- 2025DFingerNet: Noise-Adaptive Speech Enhancement for Hearing Aids17 Jan 2025
12 newest of 34 All 34 (JSON)