On loss functions and evaluation metrics for music source separation
Not on the map. Why?
Abstract (arXiv)
We investigate which loss functions provide better separations via benchmarking an extensive set of those for music source separation. To that end, we first survey the most representative audio source separation losses we identified, to later consistently benchmark them in a controlled experimental setup. We also explore using such losses as evaluation metrics, via cross-correlating them with the results of a subjective test. Based on the observation that the standard signal-to-distortion ratio metric can be misleading in some scenarios, we study alternative evaluation metrics based on the considered losses.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 16 Feb 2022.
Builds on
20 of 39 references.
References · 20
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016Improved Techniques for Training GANscited by 2,938
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
- 2018SDR - half-baked or well done?cited by 420
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 400
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
- 2017SEGAN: Speech Enhancement Generative Adversarial Networkcited by 165
- 2018Wave-U-Net: A Multi-Scale Neural Network for End-to-End Audio Source Separationcited by 125
- 2019Music Source Separation in the Waveform Domaincited by 98
8 more
- 2020Upsampling artifacts in neural audio synthesiscited by 28
- 2020D3Net: Densely connected multidilated DenseNet for music source separationcited by 24
- 2018Fast Spectrogram Inversion using Multi-head Convolutional Neural Networkscited by 21
- 2020An empirical study of Conv-TasNetcited by 14
- 2019Demystifying TasNet: A Dissecting Approachcited by 12
- 2017Adversarial Semi-Supervised Audio Source Separation applied to Singing Voice Extractioncited by 11
- 2021On permutation invariant training for speech source separationcited by 4
- 2019Spectrogram Feature Losses for Music Source Separationcited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 4; 2025: 5; 2026: 3.
17 papers.
Sort:
By area:
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2025Fast Text-to-Audio Generation with Adversarial Post-Trainingcited by 14
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
- 2023Latent Autoregressive Source Separationcited by 12
- 2022Music Separation Enhancement with Generative Modelingcited by 8
- 2022Adversarial Permutation Invariant Training for Universal Sound Separationcited by 8
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extractioncited by 4
- 2025Efficient and Fast Generative-Based Singing Voice Separation using a Latent Diffusion Modelcited by 2
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Modelscited by 1
- 2024Improving Music Source Separation with Diffusion and Consistency Refinementcited by 1
- 2025StutterZero and StutterFormer: End-to-End Speech Conversion for Stuttering Transcription and Correctioncited by 1
- 2024Spectral Mapping of Singing Voices: U-Net-Assisted Vocal Segmentationcited by 0
5 more
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencodercited by 0
- 2025Solving Copyright Infringement on Short Video Platforms: Novel Datasets and an Audio Restoration Deep Learning Pipelinecited by 0
- 2026Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Modelscited by 0
- 2026Iterative Audio Separation with Mixture Consistency via MIMO Model Extensioncited by 0
- 2026Prism-SQA: An Interpretable and Adaptable Neural Framework for Surface Electromyography Quality Assessmentcited by 0
- 2026Prism-SQA: An Interpretable and Adaptable Neural Framework for Surface Electromyography Quality Assessment11 Sep 2026
- 2026Iterative Audio Separation with Mixture Consistency via MIMO Model Extension7 Sep 2026
- 2026Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Models25 Jul 2026
- 2025Efficient and Fast Generative-Based Singing Voice Separation using a Latent Diffusion Model25 Nov 2025
- 2025StutterZero and StutterFormer: End-to-End Speech Conversion for Stuttering Transcription and Correction21 Oct 2025
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extraction29 May 2025
- 2025Fast Text-to-Audio Generation with Adversarial Post-Training13 May 2025
- 2025Solving Copyright Infringement on Short Video Platforms: Novel Datasets and an Audio Restoration Deep Learning Pipeline30 Apr 2025
- 2024Improving Music Source Separation with Diffusion and Consistency Refinement9 Dec 2024
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models18 Sep 2024
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencoder12 Aug 2024
- 2024Spectral Mapping of Singing Voices: U-Net-Assisted Vocal Segmentation30 May 2024
5 more
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Models10 Mar 2023
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separation4 Feb 2023
- 2023Latent Autoregressive Source Separation9 Jan 2023
- 2022Adversarial Permutation Invariant Training for Universal Sound Separation21 Oct 2022
- 2022Music Separation Enhancement with Generative Modeling26 Aug 2022
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extractioncited by 4
- 2025Efficient and Fast Generative-Based Singing Voice Separation using a Latent Diffusion Modelcited by 2
- 2024Improving Music Source Separation with Diffusion and Consistency Refinementcited by 1
- 2025Efficient and Fast Generative-Based Singing Voice Separation using a Latent Diffusion Model25 Nov 2025
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extraction29 May 2025
- 2024Improving Music Source Separation with Diffusion and Consistency Refinement9 Dec 2024
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models18 Sep 2024
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separation4 Feb 2023
- 2025Fast Text-to-Audio Generation with Adversarial Post-Trainingcited by 14
- 2023Latent Autoregressive Source Separationcited by 12
- 2022Music Separation Enhancement with Generative Modelingcited by 8
- 2022Adversarial Permutation Invariant Training for Universal Sound Separationcited by 8
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Modelscited by 1
- 2025StutterZero and StutterFormer: End-to-End Speech Conversion for Stuttering Transcription and Correctioncited by 1
- 2024Spectral Mapping of Singing Voices: U-Net-Assisted Vocal Segmentationcited by 0
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencodercited by 0
- 2025Solving Copyright Infringement on Short Video Platforms: Novel Datasets and an Audio Restoration Deep Learning Pipelinecited by 0
- 2026Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Modelscited by 0
- 2026Iterative Audio Separation with Mixture Consistency via MIMO Model Extensioncited by 0
- 2026Prism-SQA: An Interpretable and Adaptable Neural Framework for Surface Electromyography Quality Assessmentcited by 0
- 2026Prism-SQA: An Interpretable and Adaptable Neural Framework for Surface Electromyography Quality Assessment11 Sep 2026
- 2026Iterative Audio Separation with Mixture Consistency via MIMO Model Extension7 Sep 2026
- 2026Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Models25 Jul 2026
- 2025StutterZero and StutterFormer: End-to-End Speech Conversion for Stuttering Transcription and Correction21 Oct 2025
- 2025Fast Text-to-Audio Generation with Adversarial Post-Training13 May 2025
- 2025Solving Copyright Infringement on Short Video Platforms: Novel Datasets and an Audio Restoration Deep Learning Pipeline30 Apr 2025
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencoder12 Aug 2024
- 2024Spectral Mapping of Singing Voices: U-Net-Assisted Vocal Segmentation30 May 2024
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Models10 Mar 2023
- 2023Latent Autoregressive Source Separation9 Jan 2023
- 2022Adversarial Permutation Invariant Training for Universal Sound Separation21 Oct 2022
- 2022Music Separation Enhancement with Generative Modeling26 Aug 2022