MetricGAN: Generative Adversarial Networks based Black-box Metric Scores Optimization for Speech Enhancement
Not on the map. Why?
Abstract (arXiv)
Adversarial loss in a conditional generative adversarial network (GAN) is not designed to directly optimize evaluation metrics of a target task, and thus, may not always guide the generator in a GAN to generate data with improved metric scores. To overcome this issue, we propose a novel MetricGAN approach with an aim to optimize the generator with respect to one or multiple evaluation metrics. Moreover, based on MetricGAN, the metric scores of the generated data can also be arbitrarily specified by users. We tested the proposed MetricGAN on a speech enhancement task, which is particularly suitable to verify the proposed approach because there are multiple metrics measuring different aspects of speech signals. Moreover, these metrics are generally complex and could not be fully optimized by Lp or conventional adversarial losses.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 28; 2023: 17; 2024: 14; 2025: 17; 2026: 12.
104 papers.
Sort:
By area:
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancementcited by 132
- 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancementcited by 114
- 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
- 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Modelcited by 52
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
- 2023Separate Anything You Describecited by 43
- 2021CDPAM: Contrastive learning for perceptual audio similaritycited by 42
- 2021TSTNN: Two-stage Transformer based Neural Network for Speech Enhancement in the Time Domaincited by 36
- 2023Novel-View Acoustic Synthesiscited by 33
38 more
- 2021Deep Learning-based Non-Intrusive Multi-Objective Speech Assessment Model with Cross-Domain Featurescited by 32
- 2022Cold Diffusion for Speech Enhancementcited by 31
- 2024Large Language Models are Efficient Learners of Noise-Robust Speech Recognitioncited by 30
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoderscited by 28
- 2021Learning Audio-Visual Dereverberationcited by 26
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 22
- 2022RemixIT: Continual self-training of speech enhancement models via bootstrapped remixingcited by 20
- 2021MetricGAN-U: Unsupervised speech enhancement/ dereverberation based only on noisy/ reverberated speechcited by 18
- 2021Dual-branch Attention-In-Attention Transformer for single-channel speech enhancementcited by 18
- 2023The Age of Synthetic Realities: Challenges and Opportunitiescited by 15
- 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancementcited by 14
- 2023Self-Supervised Visual Acoustic Matchingcited by 14
- 2022Speech Denoising in the Waveform Domain with Self-Attentioncited by 13
- 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinementcited by 12
- 2024The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancementcited by 12
- 2021High Fidelity Speech Regeneration with Application to Speech Enhancementcited by 10
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Modelscited by 9
- 2024BSS-CFFMA: Cross-Domain Feature Fusion and Multi-Attention Speech Enhancement Network based on Self-Supervised Embeddingcited by 9
- 2022Music Separation Enhancement with Generative Modelingcited by 8
- 2022SCP-GAN: Self-Correcting Discriminator Optimization for Training Consistency Preserving Metric GAN on Speech Enhancement Taskscited by 8
- 2021REAL-M: Towards Speech Separation on Real Mixturescited by 7
- 2022FFC-SE: Fast Fourier Convolution for Speech Enhancementcited by 7
- 2025Multi-Metric Preference Alignment for Generative Speech Restorationcited by 7
- 2022Perceptual Contrast Stretching on Target Feature for Speech Enhancementcited by 6
- 2022Multi-View Attention Transfer for Efficient Speech Enhancementcited by 6
- 2022SkipConvGAN: Monaural Speech Dereverberation using Generative Adversarial Networks via Complex Time-Frequency Maskingcited by 6
- 2022MetricGAN+/-: Increasing Robustness of Noise Reduction on Unseen Datacited by 5
- 2022Improving Speech Enhancement through Fine-Grained Speech Characteristicscited by 5
- 2023Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancementcited by 5
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
- 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesiscited by 5
- 2022Exploring Self-Attention Mechanisms for Speech Separationcited by 4
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancementcited by 4
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysiscited by 3
- 2022Blind Restoration of Real-World Audio by 1D Operational GANscited by 3
- 2025Linguistic Knowledge Transfer Learning for Speech Enhancementcited by 3
- 2026Investigating the Impact of Speech Enhancement on Audio Deepfake Detection in Noisy Environmentscited by 3
50 most cited of 104 All 104 (JSON)
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?28 Sep 2026
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillation12 Aug 2026
- 2026Post-Training Speech Enhancement Language Models with Perceptual Rewards19 Jun 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026DBHN-Net: Dual-Branch Hybrid Neural Network For Low-Complexity Monaural Speech Enhancement4 Jun 2026
- 2026A Cold Diffusion Approach for Percussive Dereverberation11 May 2026
- 2026Speech Enhancement Based on Drifting Models27 Apr 2026
- 2026Investigating the Impact of Speech Enhancement on Audio Deepfake Detection in Noisy Environments16 Mar 2026
- 2026LLM-Guided Reinforcement Learning for Audio-Visual Speech Enhancement14 Mar 2026
- 2026Rethinking Flow and Diffusion Bridge Models for Speech Enhancement20 Feb 2026
- 2026Universal Robust Speech Adaptation for Cross-Domain Speech Recognition and Enhancement4 Feb 2026
- 2026Masked Autoencoders as Universal Speech Enhancer2 Feb 2026
38 more
- 2025When De-noising Hurts: A Systematic Study of Speech Enhancement Effects on Modern Medical ASR Systems19 Dec 2025
- 2025Investigating training objective for flow matching-based speech enhancement11 Dec 2025
- 2025Exploring Resolution-Wise Shared Attention in Hybrid Mamba-U-Nets for Improved Cross-Corpus Speech Enhancement2 Oct 2025
- 2025Unsupervised Speech Enhancement using Data-defined Priors26 Sep 2025
- 2025Leveraging Discriminative Latent Representations for Conditioning GAN-Based Speech Enhancement28 Aug 2025
- 2025Modality-Specific Speech Enhancement and Noise-Adaptive Fusion for Acoustic and Body-Conduction Microphone Framework24 Aug 2025
- 2025Multi-Metric Preference Alignment for Generative Speech Restoration24 Aug 2025
- 2025EffiFusion-GAN: Efficient Fusion Generative Adversarial Network for Speech Enhancement20 Aug 2025
- 2025Autoregressive Speech Enhancement via Acoustic Tokens17 Jul 2025
- 2025Aligning Generative Speech Enhancement with Perceptual Feedback14 Jul 2025
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement1 Jul 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement30 May 2025
- 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberation22 May 2025
- 2025Linguistic Knowledge Transfer Learning for Speech Enhancement10 Mar 2025
- 2025VINP: Variational Bayesian Inference with Neural Speech Prior for Joint ASR-Effective Speech Dereverberation and Blind RIR Identification11 Feb 2025
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement10 Jan 2025
- 2025Single-Channel Distance-Based Source Separation for Mobile GPU in Outdoor and Indoor Environments6 Jan 2025
- 2024From KAN to GR-KAN: Advancing Speech Enhancement with KAN-Based Methodology23 Dec 2024
- 2024Selective State Space Model for Monaural Speech Enhancement9 Nov 2024
- 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis14 Oct 2024
- 2024Effective Noise-aware Data Simulation for Domain-adaptive Speech Enhancement Leveraging Dynamic Stochastic Perturbation3 Sep 2024
- 2024BSS-CFFMA: Cross-Domain Feature Fusion and Multi-Attention Speech Enhancement Network based on Self-Supervised Embedding13 Aug 2024
- 2024Global Optimisation of Black-Box Functions with Generative Models in the Wasserstein Space16 Jul 2024
- 2024Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion15 Jul 2024
- 2024LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition6 Jun 2024
- 2024The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement5 Jun 2024
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognition27 May 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2024An Investigation of Incorporating Mamba for Speech Enhancement10 May 2024
- 2024Objective and subjective evaluation of speech enhancement methods in the UDASE task of the 7th CHiME challenge2 Feb 2024
- 2024Large Language Models are Efficient Learners of Noise-Robust Speech Recognition19 Jan 2024
- 2023ROSE: A Recognition-Oriented Speech Enhancement Framework in Air Traffic Control Using Multi-Objective Learning11 Dec 2023
- 2023D4AM: A General Denoising Framework for Downstream Acoustic Models28 Nov 2023
- 2023CORN: Co-Trained Full- And No-Reference Speech Quality Assessment13 Oct 2023
- 2023CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram12 Sep 2023
- 2023Separate Anything You Describe9 Aug 2023
- 2023Self-Supervised Visual Acoustic Matching27 Jul 2023
- 2023Self-supervised learning with diffusion-based multichannel speech enhancement for speaker verification under noisy conditions5 Jul 2023
50 newest of 104 All 104 (JSON)
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancementcited by 132
- 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
- 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Modelcited by 52
- 2022Cold Diffusion for Speech Enhancementcited by 31
- 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancementcited by 14
- 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinementcited by 12
- 2023Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancementcited by 5
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
- 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesiscited by 5
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2026Rethinking Flow and Diffusion Bridge Models for Speech Enhancementcited by 2
- 2025Leveraging Discriminative Latent Representations for Conditioning GAN-Based Speech Enhancementcited by 1
12 most cited of 15 All 15 (JSON)
- 2026Rethinking Flow and Diffusion Bridge Models for Speech Enhancement20 Feb 2026
- 2025Investigating training objective for flow matching-based speech enhancement11 Dec 2025
- 2025Leveraging Discriminative Latent Representations for Conditioning GAN-Based Speech Enhancement28 Aug 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement30 May 2025
- 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis14 Oct 2024
- 2024Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion15 Jul 2024
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognition27 May 2024
- 2023Self-supervised learning with diffusion-based multichannel speech enhancement for speaker verification under noisy conditions5 Jul 2023
- 2023Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancement14 Jun 2023
- 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI23 Mar 2023
- 2022Cold Diffusion for Speech Enhancement4 Nov 2022
- 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinement30 Oct 2022
12 newest of 15 All 15 (JSON)
- 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Modelscited by 9
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancementcited by 4
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancementcited by 2
- 2024Selective State Space Model for Monaural Speech Enhancementcited by 1
- 2025Exploring Resolution-Wise Shared Attention in Hybrid Mamba-U-Nets for Improved Cross-Corpus Speech Enhancementcited by 0
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillationcited by 0
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillation12 Aug 2026
- 2025Exploring Resolution-Wise Shared Attention in Hybrid Mamba-U-Nets for Improved Cross-Corpus Speech Enhancement2 Oct 2025
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement1 Jul 2025
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement10 Jan 2025
- 2024Selective State Space Model for Monaural Speech Enhancement9 Nov 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2024An Investigation of Incorporating Mamba for Speech Enhancement10 May 2024
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Models1 Jun 2023
- 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancementcited by 114
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
- 2023Separate Anything You Describecited by 43
- 2021CDPAM: Contrastive learning for perceptual audio similaritycited by 42
- 2021TSTNN: Two-stage Transformer based Neural Network for Speech Enhancement in the Time Domaincited by 36
- 2023Novel-View Acoustic Synthesiscited by 33
- 2021Deep Learning-based Non-Intrusive Multi-Objective Speech Assessment Model with Cross-Domain Featurescited by 32
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoderscited by 28
- 2021Learning Audio-Visual Dereverberationcited by 26
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 22
- 2022RemixIT: Continual self-training of speech enhancement models via bootstrapped remixingcited by 20
12 most cited of 77 All 77 (JSON)
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?28 Sep 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026DBHN-Net: Dual-Branch Hybrid Neural Network For Low-Complexity Monaural Speech Enhancement4 Jun 2026
- 2026A Cold Diffusion Approach for Percussive Dereverberation11 May 2026
- 2026Speech Enhancement Based on Drifting Models27 Apr 2026
- 2026Investigating the Impact of Speech Enhancement on Audio Deepfake Detection in Noisy Environments16 Mar 2026
- 2026LLM-Guided Reinforcement Learning for Audio-Visual Speech Enhancement14 Mar 2026
- 2026Universal Robust Speech Adaptation for Cross-Domain Speech Recognition and Enhancement4 Feb 2026
- 2026Masked Autoencoders as Universal Speech Enhancer2 Feb 2026
- 2025When De-noising Hurts: A Systematic Study of Speech Enhancement Effects on Modern Medical ASR Systems19 Dec 2025
- 2025Unsupervised Speech Enhancement using Data-defined Priors26 Sep 2025
- 2025Modality-Specific Speech Enhancement and Noise-Adaptive Fusion for Acoustic and Body-Conduction Microphone Framework24 Aug 2025
12 newest of 77 All 77 (JSON)