MetricGAN+: An Improved Version of MetricGAN for Speech Enhancement
Not on the map. Why?
Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The discrepancy between the cost function used for training a speech enhancement model and human auditory perception usually makes the quality of enhanced speech unsatisfactory. Objective evaluation metrics which consider human perception can hence serve as a bridge to reduce the gap. Our previously proposed MetricGAN was designed to optimize objective metrics by connecting the metric with a discriminator. Because only the scores of the target evaluation functions are needed during training, the metrics can even be non-differentiable. In this study, we propose a MetricGAN+ in which three training techniques incorporating domain-knowledge of speech processing are proposed. With these techniques, experimental results on the VoiceBank-DEMAND dataset show that MetricGAN+ can increase PESQ score by 0.3 compared to the previous MetricGAN and achieve state-of-the-art results (PESQ score = 3.15).
Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 8 Apr 2021.
Builds on
26 of 44 references.
References · 26
- 2013Intriguing properties of neural networkscited by 5,114
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
- 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 235
- 2017Supervised Speech Separation Based on Deep Learning: An Overviewcited by 213
- 2020Real Time Speech Enhancement in the Waveform Domaincited by 183
- 2017SEGAN: Speech Enhancement Generative Adversarial Networkcited by 165
- 2017HashNet: Deep Learning to Hash by Continuationcited by 121
- 2019MetricGAN: Generative Adversarial Networks based Black-box Metric Scores Optimization for Speech Enhancementcited by 104
- 2019PHASEN: A Phase-and-Harmonics-Aware Speech Enhancement Networkcited by 49
- 2020HiFi-GAN: High-Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networkscited by 40
- 2018Quality-Net: An End-to-End Non-intrusive Speech Quality Assessment Model based on BLSTMcited by 36
14 more
- 2020Speech Enhancement using Self-Adaptation and Multi-Head Self-Attentioncited by 28
- 2017End-to-End Waveform Utterance Enhancement for Direct Evaluation Metrics Optimization by Fully Convolutional Neural Networkscited by 26
- 2020A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differencescited by 22
- 2020Perceptual Loss based Speech Denoising with an ensemble of Audio Pattern Recognition and Self-Supervised Modelscited by 10
- 2018Spectral feature mapping with mimic loss for robust speech recognitioncited by 8
- 2018DNN-based Source Enhancement to Increase Objective Sound Quality Assessment Scorecited by 8
- 2019End-to-End Multi-Task Denoising for joint SDR and PESQ Optimizationcited by 8
- 2019Learning with Learned Loss Function: Speech Enhancement with Quality-Net to Improve Perceptual Evaluation of Speech Qualitycited by 8
- 2020SERIL: Noise Adaptive Speech Enhancement using Regularization-based Incremental Learningcited by 6
- 2020iMetricGAN: Intelligibility Enhancement for Speech-in-Noise using Generative Adversarial Network-based Metric Learningcited by 4
- 2018Monaural Speech Enhancement using Deep Neural Networks by Maximizing a Short-Time Objective Intelligibility Measurecited by 3
- 2020Boosting Objective Scores of a Speech Enhancement Model by MetricGAN Post-processingcited by 3
- 2018Acoustics-guided evaluation (AGE): a new measure for estimating performance of speech enhancement algorithms for robust ASRcited by 2
- 2020Stable Training of DNN for Speech Enhancement based on Perceptually-Motivated Black-Box Cost Functioncited by 2
Built on by
Citing papers per year: 2021: 10; 2022: 21; 2023: 22; 2024: 22; 2025: 26; 2026: 13.
114 papers.
Sort:
By area:
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 195
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2023Generative Pre-training for Speech with Flow Matchingcited by 55
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoderscited by 28
- 2021Learning Audio-Visual Dereverberationcited by 26
- 2023Spiking Structured State Space Model for Monaural Speech Enhancementcited by 23
38 more
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 22
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
- 2021MetricGAN-U: Unsupervised speech enhancement/ dereverberation based only on noisy/ reverberated speechcited by 18
- 2021Dual-branch Attention-In-Attention Transformer for single-channel speech enhancementcited by 18
- 2021Unsupervised Noise Adaptive Speech Enhancement by Discriminator-Constrained Optimal Transportcited by 16
- 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
- 2023Self-Supervised Visual Acoustic Matchingcited by 14
- 2022Speech Denoising in the Waveform Domain with Self-Attentioncited by 13
- 2024The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancementcited by 12
- 2021Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problemcited by 11
- 2023Diffusion-Based Speech Enhancement with Joint Generative and Predictive Decoderscited by 10
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancementcited by 10
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Modelscited by 9
- 2023Noise-aware Speech Enhancement using Diffusion Probabilistic Modelcited by 9
- 2024BSS-CFFMA: Cross-Domain Feature Fusion and Multi-Attention Speech Enhancement Network based on Self-Supervised Embeddingcited by 9
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
- 2022Music Separation Enhancement with Generative Modelingcited by 8
- 2022SCP-GAN: Self-Correcting Discriminator Optimization for Training Consistency Preserving Metric GAN on Speech Enhancement Taskscited by 8
- 2023Perceive and predict: self-supervised speech representation based loss functions for speech enhancementcited by 8
- 2024Diffusion-based Speech Enhancement with Schr"odinger Bridge and Symmetric Noise Schedulecited by 8
- 2021REAL-M: Towards Speech Separation on Real Mixturescited by 7
- 2022FFC-SE: Fast Fourier Convolution for Speech Enhancementcited by 7
- 2023SE-Bridge: Speech Enhancement with Consistent Brownian Bridgecited by 7
- 2024FINALLY: fast and universal speech enhancement with studio-like qualitycited by 7
- 2022Perceptual Contrast Stretching on Target Feature for Speech Enhancementcited by 6
- 2022Multi-View Attention Transfer for Efficient Speech Enhancementcited by 6
- 2024Thunder : Unified Regression-Diffusion Speech Enhancement with a Single Reverse Step using Brownian Bridgecited by 6
- 2024TrustEMG-Net: Using Representation-Masking Transformer with U-Net for Surface Electromyography Enhancementcited by 6
- 2022MetricGAN+/-: Increasing Robustness of Noise Reduction on Unseen Datacited by 5
- 2022A Systematic Comparison of Phonetic Aware Techniques for Speech Enhancementcited by 5
- 2022Improving Speech Enhancement through Fine-Grained Speech Characteristicscited by 5
- 2023Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancementcited by 5
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
- 2024Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translationcited by 5
- 2022Exploring Self-Attention Mechanisms for Speech Separationcited by 4
- 2024MUSE: Flexible Voiceprint Receptive Fields and Multi-Path Fusion Enhanced Taylor Transformer for U-Net-based Speech Enhancementcited by 4
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancementcited by 4
- 2025Robust One-step Speech Enhancement via Consistency Distillationcited by 4
50 most cited of 114 All 114 (JSON)
- 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement24 Sep 2026
- 2026DriftSE: Speech Enhancement with Generative Drifting10 Sep 2026
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoising10 Sep 2026
- 2026Discriminative Flow Matching: Beyond Time-Conditioning in Generative Restoration via Flow-State Representations3 Sep 2026
- 2026SlimDiffuSE: Towards Efficient Diffusion-Based Speech Enhancement using Slimmable Networks21 Aug 2026
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillation12 Aug 2026
- 2026Post-Training Speech Enhancement Language Models with Perceptual Rewards19 Jun 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026Quaternion Self-Attention with Shared Scores24 May 2026
- 2026Speech Enhancement Based on Drifting Models27 Apr 2026
- 2026Investigating the Impact of Speech Enhancement on Audio Deepfake Detection in Noisy Environments16 Mar 2026
- 2026LLM-Guided Reinforcement Learning for Audio-Visual Speech Enhancement14 Mar 2026
38 more
- 2026When Audio Separation Hurts Zero-Shot ASR: Evaluating SAM-Audio with Whisper on Bengali and English Speech5 Mar 2026
- 2025When De-noising Hurts: A Systematic Study of Speech Enhancement Effects on Modern Medical ASR Systems19 Dec 2025
- 2025Investigating training objective for flow matching-based speech enhancement11 Dec 2025
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025Better audio representations are more brain-like: linking model-brain alignment with performance in downstream auditory tasks20 Nov 2025
- 2025IMSE: Efficient U-Net-based Speech Enhancement using Inception Depthwise Convolution and Amplitude-Aware Linear Attention18 Nov 2025
- 2025Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancement12 Nov 2025
- 2025TMD-TTS: A Unified Tibetan Multi-Dialect Text-to-Speech Framework for "U-Tsang, Amdo and Kham Speech Dataset Generation22 Sep 2025
- 2025Compose Yourself: Average-Velocity Flow Matching for One-Step Speech Enhancement19 Sep 2025
- 2025Leveraging Discriminative Latent Representations for Conditioning GAN-Based Speech Enhancement28 Aug 2025
- 2025Modality-Specific Speech Enhancement and Noise-Adaptive Fusion for Acoustic and Body-Conduction Microphone Framework24 Aug 2025
- 2025A Study of the Scale Invariant Signal to Distortion Ratio in Speech Separation with Noisy References20 Aug 2025
- 2025EffiFusion-GAN: Efficient Fusion Generative Adversarial Network for Speech Enhancement20 Aug 2025
- 2025Alternating Approach-Putt Models for Multi-Stage Speech Enhancement14 Aug 2025
- 2025WhiSQA: Non-Intrusive Speech Quality Prediction Using Whisper Encoder Features4 Aug 2025
- 2025Autoregressive Speech Enhancement via Acoustic Tokens17 Jul 2025
- 2025Robust One-step Speech Enhancement via Consistency Distillation8 Jul 2025
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement1 Jul 2025
- 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberation22 May 2025
- 2025FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for "U-Tsang, Amdo and Kham Speech Dataset Generation20 May 2025
- 2025Magnitude-Phase Dual-Path Speech Enhancement Network based on Self-Supervised Embedding and Perceptual Contrast Stretch Boosting27 Mar 2025
- 2025HiFi-Stream: Streaming Speech Enhancement with Generative Adversarial Networks21 Mar 2025
- 2025VANPY: Voice Analysis Framework17 Feb 2025
- 2025NeuroAMP: A Novel End-to-end General Purpose Deep Neural Amplifier for Personalized Hearing Aids15 Feb 2025
- 2025Generative Data Augmentation Challenge: Zero-Shot Speech Synthesis for Personalized Speech Enhancement23 Jan 2025
- 2025Conditional Latent Diffusion-Based Speech Enhancement Via Dual Context Learning17 Jan 2025
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement10 Jan 2025
- 2024From KAN to GR-KAN: Advancing Speech Enhancement with KAN-Based Methodology23 Dec 2024
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement21 Dec 2024
- 2024Selective State Space Model for Monaural Speech Enhancement9 Nov 2024
- 2024DENOASR: Debiasing ASRs through Selective Denoising22 Oct 2024
- 2024FINALLY: fast and universal speech enhancement with studio-like quality8 Oct 2024
- 2024TrustEMG-Net: Using Representation-Masking Transformer with U-Net for Surface Electromyography Enhancement4 Oct 2024
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolution14 Sep 2024
- 2024Diffusion-based Speech Enhancement with Schr"odinger Bridge and Symmetric Noise Schedule8 Sep 2024
- 2024BSS-CFFMA: Cross-Domain Feature Fusion and Multi-Attention Speech Enhancement Network based on Self-Supervised Embedding13 Aug 2024
- 2024Audio Enhancement for Computer Audition -- An Iterative Training Paradigm Using Sample Importance12 Aug 2024
- 2024Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion15 Jul 2024
50 newest of 114 All 114 (JSON)
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 195
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
- 2023Generative Pre-training for Speech with Flow Matchingcited by 55
- 2023Diffusion-Based Speech Enhancement with Joint Generative and Predictive Decoderscited by 10
- 2023Noise-aware Speech Enhancement using Diffusion Probabilistic Modelcited by 9
- 2024Diffusion-based Speech Enhancement with Schr"odinger Bridge and Symmetric Noise Schedulecited by 8
- 2023SE-Bridge: Speech Enhancement with Consistent Brownian Bridgecited by 7
- 2024Thunder : Unified Regression-Diffusion Speech Enhancement with a Single Reverse Step using Brownian Bridgecited by 6
- 2023Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancementcited by 5
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
- 2025Robust One-step Speech Enhancement via Consistency Distillationcited by 4
- 2025Conditional Latent Diffusion-Based Speech Enhancement Via Dual Context Learningcited by 3
12 most cited of 21 All 21 (JSON)
- 2026Discriminative Flow Matching: Beyond Time-Conditioning in Generative Restoration via Flow-State Representations3 Sep 2026
- 2026SlimDiffuSE: Towards Efficient Diffusion-Based Speech Enhancement using Slimmable Networks21 Aug 2026
- 2025Investigating training objective for flow matching-based speech enhancement11 Dec 2025
- 2025Compose Yourself: Average-Velocity Flow Matching for One-Step Speech Enhancement19 Sep 2025
- 2025Leveraging Discriminative Latent Representations for Conditioning GAN-Based Speech Enhancement28 Aug 2025
- 2025Robust One-step Speech Enhancement via Consistency Distillation8 Jul 2025
- 2025Conditional Latent Diffusion-Based Speech Enhancement Via Dual Context Learning17 Jan 2025
- 2024Diffusion-based Speech Enhancement with Schr"odinger Bridge and Symmetric Noise Schedule8 Sep 2024
- 2024Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion15 Jul 2024
- 2024Complex Image-Generative Diffusion Transformer for Audio Denoising13 Jun 2024
- 2024Diffusion Gaussian Mixture Audio Denoise13 Jun 2024
- 2024Pre-training Feature Guided Diffusion Model for Speech Enhancement11 Jun 2024
12 newest of 21 All 21 (JSON)
- 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2023Spiking Structured State Space Model for Monaural Speech Enhancementcited by 23
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancementcited by 10
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Modelscited by 9
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancementcited by 4
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancementcited by 2
- 2024Selective State Space Model for Monaural Speech Enhancementcited by 1
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillationcited by 0
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoisingcited by 0
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoising10 Sep 2026
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillation12 Aug 2026
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement1 Jul 2025
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement10 Jan 2025
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement21 Dec 2024
- 2024Selective State Space Model for Monaural Speech Enhancement9 Nov 2024
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolution14 Sep 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2024An Investigation of Incorporating Mamba for Speech Enhancement10 May 2024
- 2023Spiking Structured State Space Model for Monaural Speech Enhancement7 Sep 2023
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Models1 Jun 2023
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoderscited by 28
- 2021Learning Audio-Visual Dereverberationcited by 26
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 22
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
- 2021MetricGAN-U: Unsupervised speech enhancement/ dereverberation based only on noisy/ reverberated speechcited by 18
- 2021Dual-branch Attention-In-Attention Transformer for single-channel speech enhancementcited by 18
- 2021Unsupervised Noise Adaptive Speech Enhancement by Discriminator-Constrained Optimal Transportcited by 16
- 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
12 most cited of 81 All 81 (JSON)
- 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement24 Sep 2026
- 2026DriftSE: Speech Enhancement with Generative Drifting10 Sep 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026Quaternion Self-Attention with Shared Scores24 May 2026
- 2026Speech Enhancement Based on Drifting Models27 Apr 2026
- 2026Investigating the Impact of Speech Enhancement on Audio Deepfake Detection in Noisy Environments16 Mar 2026
- 2026LLM-Guided Reinforcement Learning for Audio-Visual Speech Enhancement14 Mar 2026
- 2026When Audio Separation Hurts Zero-Shot ASR: Evaluating SAM-Audio with Whisper on Bengali and English Speech5 Mar 2026
- 2025When De-noising Hurts: A Systematic Study of Speech Enhancement Effects on Modern Medical ASR Systems19 Dec 2025
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025Better audio representations are more brain-like: linking model-brain alignment with performance in downstream auditory tasks20 Nov 2025
- 2025IMSE: Efficient U-Net-based Speech Enhancement using Inception Depthwise Convolution and Amplitude-Aware Linear Attention18 Nov 2025
12 newest of 81 All 81 (JSON)