MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra
Not on the map. Why?
Abstract (arXiv)
This paper proposes MP-SENet, a novel Speech Enhancement Network which directly denoises Magnitude and Phase spectra in parallel. The proposed MP-SENet adopts a codec architecture in which the encoder and decoder are bridged by convolution-augmented transformers. The encoder aims to encode time-frequency representations from the input noisy magnitude and phase spectra. The decoder is composed of parallel magnitude mask decoder and phase decoder, directly recovering clean magnitude spectra and clean-wrapped phase spectra by incorporating learnable sigmoid activation and parallel phase estimation architecture, respectively. Multi-level losses defined on magnitude spectra, phase spectra, short-time complex spectra, and time-domain waveforms are used to train the MP-SENet model jointly. Experimental results show that our proposed MP-SENet achieves a PESQ of 3.50 on the public VoiceBank+DEMAND dataset and outperforms existing advanced speech enhancement methods.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 May 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 12; 2025: 23; 2026: 14.
51 papers.
Sort:
By area:
- 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2023Separate Anything You Describecited by 43
- 2023HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesiscited by 35
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancementcited by 10
- 2025Bilingual Dual-Head Deep Model for Parkinson's Disease Detection from Speechcited by 7
- 2025Universal Speech Enhancement with Regression and Generative Mambacited by 7
- 2024SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Modelcited by 6
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
- 2024MECG-E: Mamba-based ECG Enhancer for Baseline Wander Removalcited by 5
- 2026FlowSE-GRPO: Training Flow Matching Speech Enhancement via Online Reinforcement Learningcited by 5
- 2024MUSE: Flexible Voiceprint Receptive Fields and Multi-Path Fusion Enhanced Taylor Transformer for U-Net-based Speech Enhancementcited by 4
38 more
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancementcited by 4
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancementcited by 4
- 2025Linguistic Knowledge Transfer Learning for Speech Enhancementcited by 3
- 2025A Survey of Deep Learning for Complex Speech Spectrogramscited by 3
- 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruningcited by 2
- 2024Broadband Ground Motion Synthesis by Diffusion Model with Minimal Conditioncited by 2
- 2025Audio Texture Manipulation by Exemplar-Based Analogycited by 2
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancementcited by 2
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separationcited by 2
- 2024ICMC-ASR: The ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition Challengecited by 1
- 2024Selective State Space Model for Monaural Speech Enhancementcited by 1
- 2025TF-MLPNet: Tiny Real-Time Neural Speech Separationcited by 1
- 2026Bug or Feature2: Weight Drift, Activation Sparsity and Spikescited by 1
- 2024A Dual-Branch Parallel Network for Speech Enhancement and Restorationcited by 0
- 2025Are Deep Speech Denoising Models Robust to Adversarial Noise?cited by 0
- 2025Magnitude-Phase Dual-Path Speech Enhancement Network based on Self-Supervised Embedding and Perceptual Contrast Stretch Boostingcited by 0
- 2025RoVo: Robust Voice Protection Against Unauthorized Speech Synthesis with Embedding-Level Perturbationscited by 0
- 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberationcited by 0
- 2025ClaritySpeech: Dementia Obfuscation in Speechcited by 0
- 2025Balalaika: Data-Centric, Prosody-Aware Annotation Pipeline for Russian Speechcited by 0
- 2025EffiFusion-GAN: Efficient Fusion Generative Adversarial Network for Speech Enhancementcited by 0
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restorationcited by 0
- 2025Leveraging Multiple Speech Enhancers for Non-Intrusive Intelligibility Prediction for Hearing-Impaired Listenerscited by 0
- 2025Exploring Resolution-Wise Shared Attention in Hybrid Mamba-U-Nets for Improved Cross-Corpus Speech Enhancementcited by 0
- 2025DroneAudioset: An Audio Dataset for Drone-based Search and Rescuecited by 0
- 2025IMSE: Efficient U-Net-based Speech Enhancement using Inception Depthwise Convolution and Amplitude-Aware Linear Attentioncited by 0
- 2025Lightweight Wasserstein Audio-Visual Model for Unified Speech Enhancement and Separationcited by 0
- 2026Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergycited by 0
- 2026Universal Robust Speech Adaptation for Cross-Domain Speech Recognition and Enhancementcited by 0
- 2026Training-Free Intelligibility-Guided Observation Addition for Noisy ASRcited by 0
- 2026Evolution Strategy-Based Calibration for Low-Bit Quantization of Speech Modelscited by 0
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancementcited by 0
- 2026BASENet: Band-Adapted Speech Enhancement Network with Cross-Band Attentioncited by 0
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancementcited by 0
- 2026Neuromorphic Speech Enhancement with Dual-Branch Spiking Neural Networkscited by 0
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillationcited by 0
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarioscited by 0
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoisingcited by 0
50 most cited of 51 All 51 (JSON)
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?28 Sep 2026
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoising10 Sep 2026
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarios3 Sep 2026
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillation12 Aug 2026
- 2026Neuromorphic Speech Enhancement with Dual-Branch Spiking Neural Networks22 Jun 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026BASENet: Band-Adapted Speech Enhancement Network with Cross-Band Attention10 Jun 2026
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancement4 Jun 2026
- 2026Bug or Feature2: Weight Drift, Activation Sparsity and Spikes17 May 2026
- 2026Evolution Strategy-Based Calibration for Low-Bit Quantization of Speech Models9 Mar 2026
- 2026Training-Free Intelligibility-Guided Observation Addition for Noisy ASR24 Feb 2026
- 2026Universal Robust Speech Adaptation for Cross-Domain Speech Recognition and Enhancement4 Feb 2026
38 more
- 2026Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy31 Jan 2026
- 2026FlowSE-GRPO: Training Flow Matching Speech Enhancement via Online Reinforcement Learning23 Jan 2026
- 2025Lightweight Wasserstein Audio-Visual Model for Unified Speech Enhancement and Separation7 Dec 2025
- 2025IMSE: Efficient U-Net-based Speech Enhancement using Inception Depthwise Convolution and Amplitude-Aware Linear Attention18 Nov 2025
- 2025DroneAudioset: An Audio Dataset for Drone-based Search and Rescue17 Oct 2025
- 2025Exploring Resolution-Wise Shared Attention in Hybrid Mamba-U-Nets for Improved Cross-Corpus Speech Enhancement2 Oct 2025
- 2025Leveraging Multiple Speech Enhancers for Non-Intrusive Intelligibility Prediction for Hearing-Impaired Listeners21 Sep 2025
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restoration28 Aug 2025
- 2025EffiFusion-GAN: Efficient Fusion Generative Adversarial Network for Speech Enhancement20 Aug 2025
- 2025TF-MLPNet: Tiny Real-Time Neural Speech Separation5 Aug 2025
- 2025Balalaika: Data-Centric, Prosody-Aware Annotation Pipeline for Russian Speech17 Jul 2025
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancement16 Jul 2025
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separation13 Jul 2025
- 2025ClaritySpeech: Dementia Obfuscation in Speech12 Jul 2025
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement1 Jul 2025
- 2025Universal Speech Enhancement with Regression and Generative Mamba27 May 2025
- 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberation22 May 2025
- 2025RoVo: Robust Voice Protection Against Unauthorized Speech Synthesis with Embedding-Level Perturbations19 May 2025
- 2025A Survey of Deep Learning for Complex Speech Spectrograms13 May 2025
- 2025Magnitude-Phase Dual-Path Speech Enhancement Network based on Self-Supervised Embedding and Perceptual Contrast Stretch Boosting27 Mar 2025
- 2025Are Deep Speech Denoising Models Robust to Adversarial Noise?14 Mar 2025
- 2025Bilingual Dual-Head Deep Model for Parkinson's Disease Detection from Speech13 Mar 2025
- 2025Linguistic Knowledge Transfer Learning for Speech Enhancement10 Mar 2025
- 2025Audio Texture Manipulation by Exemplar-Based Analogy21 Jan 2025
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement10 Jan 2025
- 2024Broadband Ground Motion Synthesis by Diffusion Model with Minimal Condition23 Dec 2024
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement21 Dec 2024
- 2024SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Model12 Nov 2024
- 2024Selective State Space Model for Monaural Speech Enhancement9 Nov 2024
- 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning14 Oct 2024
- 2024MECG-E: Mamba-based ECG Enhancer for Baseline Wander Removal27 Sep 2024
- 2024A Dual-Branch Parallel Network for Speech Enhancement and Restoration13 Sep 2024
- 2024MUSE: Flexible Voiceprint Receptive Fields and Multi-Path Fusion Enhanced Taylor Transformer for U-Net-based Speech Enhancement7 Jun 2024
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognition27 May 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2024An Investigation of Incorporating Mamba for Speech Enhancement10 May 2024
- 2024ICMC-ASR: The ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition Challenge7 Jan 2024
- 2023HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesis21 Nov 2023
50 newest of 51 All 51 (JSON)
- 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancementcited by 10
- 2025Universal Speech Enhancement with Regression and Generative Mambacited by 7
- 2024SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Modelcited by 6
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancementcited by 4
- 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruningcited by 2
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancementcited by 2
- 2024Selective State Space Model for Monaural Speech Enhancementcited by 1
- 2025Exploring Resolution-Wise Shared Attention in Hybrid Mamba-U-Nets for Improved Cross-Corpus Speech Enhancementcited by 0
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillationcited by 0
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoisingcited by 0
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoising10 Sep 2026
- 2026RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillation12 Aug 2026
- 2025Exploring Resolution-Wise Shared Attention in Hybrid Mamba-U-Nets for Improved Cross-Corpus Speech Enhancement2 Oct 2025
- 2025MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement1 Jul 2025
- 2025Universal Speech Enhancement with Regression and Generative Mamba27 May 2025
- 2025xLSTM-SENet: xLSTM for Single-Channel Speech Enhancement10 Jan 2025
- 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement21 Dec 2024
- 2024SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Model12 Nov 2024
- 2024Selective State Space Model for Monaural Speech Enhancement9 Nov 2024
- 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning14 Oct 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2024An Investigation of Incorporating Mamba for Speech Enhancement10 May 2024
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
- 2026FlowSE-GRPO: Training Flow Matching Speech Enhancement via Online Reinforcement Learningcited by 5
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancementcited by 4
- 2024Broadband Ground Motion Synthesis by Diffusion Model with Minimal Conditioncited by 2
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restorationcited by 0
- 2026Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergycited by 0
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancementcited by 0
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancement4 Jun 2026
- 2026Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy31 Jan 2026
- 2026FlowSE-GRPO: Training Flow Matching Speech Enhancement via Online Reinforcement Learning23 Jan 2026
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restoration28 Aug 2025
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancement16 Jul 2025
- 2024Broadband Ground Motion Synthesis by Diffusion Model with Minimal Condition23 Dec 2024
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognition27 May 2024
- 2023Separate Anything You Describecited by 43
- 2023HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesiscited by 35
- 2025Bilingual Dual-Head Deep Model for Parkinson's Disease Detection from Speechcited by 7
- 2024MECG-E: Mamba-based ECG Enhancer for Baseline Wander Removalcited by 5
- 2024MUSE: Flexible Voiceprint Receptive Fields and Multi-Path Fusion Enhanced Taylor Transformer for U-Net-based Speech Enhancementcited by 4
- 2025Linguistic Knowledge Transfer Learning for Speech Enhancementcited by 3
- 2025A Survey of Deep Learning for Complex Speech Spectrogramscited by 3
- 2025Audio Texture Manipulation by Exemplar-Based Analogycited by 2
- 2024ICMC-ASR: The ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition Challengecited by 1
- 2025TF-MLPNet: Tiny Real-Time Neural Speech Separationcited by 1
- 2026Bug or Feature2: Weight Drift, Activation Sparsity and Spikescited by 1
- 2024A Dual-Branch Parallel Network for Speech Enhancement and Restorationcited by 0
12 most cited of 31 All 31 (JSON)
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?28 Sep 2026
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarios3 Sep 2026
- 2026Neuromorphic Speech Enhancement with Dual-Branch Spiking Neural Networks22 Jun 2026
- 2026QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement17 Jun 2026
- 2026BASENet: Band-Adapted Speech Enhancement Network with Cross-Band Attention10 Jun 2026
- 2026Bug or Feature2: Weight Drift, Activation Sparsity and Spikes17 May 2026
- 2026Evolution Strategy-Based Calibration for Low-Bit Quantization of Speech Models9 Mar 2026
- 2026Training-Free Intelligibility-Guided Observation Addition for Noisy ASR24 Feb 2026
- 2026Universal Robust Speech Adaptation for Cross-Domain Speech Recognition and Enhancement4 Feb 2026
- 2025Lightweight Wasserstein Audio-Visual Model for Unified Speech Enhancement and Separation7 Dec 2025
- 2025IMSE: Efficient U-Net-based Speech Enhancement using Inception Depthwise Convolution and Amplitude-Aware Linear Attention18 Nov 2025
- 2025DroneAudioset: An Audio Dataset for Drone-based Search and Rescue17 Oct 2025
12 newest of 31 All 31 (JSON)