mlsanityData to 7 Oct 2026

Real Time Speech Enhancement in the Waveform Domain

arXiv 2006.12847 ↗First posted 23 Jun 2020eess.AS cs.LG cs.SDcited by 183

Not on the map. Why?

Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present a causal speech enhancement model working on the raw waveform that runs in real-time on a laptop CPU. The proposed model is based on an encoder-decoder architecture with skip-connections. It is optimized on both time and frequency domains, using multiple loss functions. Empirical evidence shows that it is capable of removing various kinds of background noise including stationary and non-stationary noises, as well as room reverb. Additionally, we suggest a set of data augmentation techniques applied directly on the raw waveform which further improve model performance and its generalization abilities. We perform evaluations on several standard benchmarks, both using objective metrics and human judgements. The proposed model matches state-of-the-art performance of both causal and non causal methods while working directly on the raw waveform.

Key facts. Cited by 183 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 19; 2022: 34; 2023: 36; 2024: 37; 2025: 40; 2026: 17.

183 papers.

Sort:

By area:

  1. 2022High Fidelity Neural Audio Compressioncited by 673
  2. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
  3. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  4. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
  5. 2022Conditional Diffusion Probabilistic Model for Speech Enhancementcited by 132
  6. 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancementcited by 114
  7. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
  8. 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
  9. 2022Music Source Separation with Band-split RNNcited by 69
  10. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
  11. 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 67
  12. 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
38 more
  1. 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
  2. 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Modelcited by 52
  3. 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
  4. 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
  5. 2021Differentiable Model Compression via Pseudo Quantization Noisecited by 44
  6. 2023GAIA: Zero-shot Talking Avatar Generationcited by 43
  7. 2021CDPAM: Contrastive learning for perceptual audio similaritycited by 42
  8. 2021TSTNN: Two-stage Transformer based Neural Network for Speech Enhancement in the Time Domaincited by 36
  9. 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
  10. 2023Novel-View Acoustic Synthesiscited by 33
  11. 2022Cold Diffusion for Speech Enhancementcited by 31
  12. 2021fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkitcited by 24
  13. 2022Audio-Visual Speech Codecs: Rethinking Audio-Visual Speech Enhancement by Re-Synthesiscited by 24
  14. 2024Circumventing shortcuts in audio-visual deepfake detection datasets with unsupervised learningcited by 23
  15. 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
  16. 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 22
  17. 2022RemixIT: Continual self-training of speech enhancement models via bootstrapped remixingcited by 20
  18. 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iterationcited by 20
  19. 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
  20. 2021Dual-branch Attention-In-Attention Transformer for single-channel speech enhancementcited by 18
  21. 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
  22. 2025FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matchingcited by 17
  23. 2024InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generationcited by 16
  24. 2021Compute and memory efficient universal sound source separationcited by 15
  25. 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
  26. 2022Speech Denoising in the Waveform Domain with Self-Attentioncited by 13
  27. 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinementcited by 12
  28. 2022Music Enhancement via Image Translation and Vocodingcited by 11
  29. 2024TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platformscited by 11
  30. 2021High Fidelity Speech Regeneration with Application to Speech Enhancementcited by 10
  31. 2022Self-Supervised Learning for Speech Enhancement through Synthesiscited by 10
  32. 2023Audio2Gestures: Generating Diverse Gestures from Audiocited by 10
  33. 2023A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translationcited by 10
  34. 2023Wav2code: Restore Clean Speech Representations via Codebook Lookup for Noise-Robust ASRcited by 10
  35. 2023Investigating the Design Space of Diffusion Models for Speech Enhancementcited by 10
  36. 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancementcited by 10
  37. 2021An Investigation of End-to-End Models for Robust Speech Recognitioncited by 9
  38. 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Modelscited by 9

50 most cited of 183 All 183 (JSON)