End-to-end music source separation: is it possible in the waveform domain?
Not on the map. Why?
Abstract (arXiv)
Most of the currently successful source separation techniques use the magnitude spectrogram as input, and are therefore by default omitting part of the signal: the phase. To avoid omitting potentially useful information, we study the viability of using end-to-end models for music source separation --- which take into account all the information available in the raw audio signal, including the phase. Although during the last decades end-to-end music source separation has been considered almost unattainable, our results confirm that waveform-based models can perform similarly (if not better) than a spectrogram-based deep learning model. Namely: a Wavenet-based model we propose and Wave-U-Net can outperform DeepConvSep, a recent spectrogram-based deep learning model.
Key facts. Cited by 19 papers in the map (data through 13 Oct 2026). First posted on arXiv 29 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 6; 2022: 4; 2023: 5; 2024: 3.
19 papers.
Sort:
By area:
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,348
- 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Datacited by 27
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
- 2023Latent Autoregressive Source Separationcited by 12
- 2022Music Separation Enhancement with Generative Modelingcited by 8
- 2022Adversarial Permutation Invariant Training for Universal Sound Separationcited by 8
- 2021Points2Sound: From mono to binaural audio using 3D point cloud scenescited by 4
- 2023Fitting Auditory Filterbanks with Multiresolution Neural Networkscited by 4
- 2021Audiovisual Singing Voice Separationcited by 3
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysiscited by 3
7 more
- 2021Music source separation conditioned on 3D point cloudscited by 2
- 2021A Time-domain Real-valued Generalized Wiener Filter for Multi-channel Neural Separation Systemscited by 1
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Modelscited by 1
- 2024Improving Music Source Separation with Diffusion and Consistency Refinementcited by 1
- 2022Self-Supervised Beat Tracking in Musical Signals with Polyphonic Contrastive Learningcited by 0
- 2023Hybrid Y-Net Architecture for Singing Voice Separationcited by 0
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencodercited by 0
- 2024Improving Music Source Separation with Diffusion and Consistency Refinement9 Dec 2024
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models18 Sep 2024
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencoder12 Aug 2024
- 2023Fitting Auditory Filterbanks with Multiresolution Neural Networks25 Jul 2023
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Models10 Mar 2023
- 2023Hybrid Y-Net Architecture for Singing Voice Separation5 Mar 2023
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separation4 Feb 2023
- 2023Latent Autoregressive Source Separation9 Jan 2023
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysis1 Dec 2022
- 2022Adversarial Permutation Invariant Training for Universal Sound Separation21 Oct 2022
- 2022Music Separation Enhancement with Generative Modeling26 Aug 2022
- 2022Self-Supervised Beat Tracking in Musical Signals with Polyphonic Contrastive Learning5 Jan 2022
7 more
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data15 Dec 2021
- 2021A Time-domain Real-valued Generalized Wiener Filter for Multi-channel Neural Separation Systems7 Dec 2021
- 2021Hybrid Spectrogram and Waveform Source Separation5 Nov 2021
- 2021Audiovisual Singing Voice Separation1 Jul 2021
- 2021Points2Sound: From mono to binaural audio using 3D point cloud scenes26 Apr 2021
- 2021Music source separation conditioned on 3D point clouds3 Feb 2021
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesis21 Sep 2020
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,348
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
- 2024Improving Music Source Separation with Diffusion and Consistency Refinementcited by 1
- 2024Improving Music Source Separation with Diffusion and Consistency Refinement9 Dec 2024
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models18 Sep 2024
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separation4 Feb 2023
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesis21 Sep 2020
- 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Datacited by 27
- 2023Latent Autoregressive Source Separationcited by 12
- 2022Music Separation Enhancement with Generative Modelingcited by 8
- 2022Adversarial Permutation Invariant Training for Universal Sound Separationcited by 8
- 2021Points2Sound: From mono to binaural audio using 3D point cloud scenescited by 4
- 2023Fitting Auditory Filterbanks with Multiresolution Neural Networkscited by 4
- 2021Audiovisual Singing Voice Separationcited by 3
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysiscited by 3
- 2021Music source separation conditioned on 3D point cloudscited by 2
- 2021A Time-domain Real-valued Generalized Wiener Filter for Multi-channel Neural Separation Systemscited by 1
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Modelscited by 1
12 most cited of 15 All 15 (JSON)
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencoder12 Aug 2024
- 2023Fitting Auditory Filterbanks with Multiresolution Neural Networks25 Jul 2023
- 2023Distribution Preserving Source Separation With Time Frequency Predictive Models10 Mar 2023
- 2023Hybrid Y-Net Architecture for Singing Voice Separation5 Mar 2023
- 2023Latent Autoregressive Source Separation9 Jan 2023
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysis1 Dec 2022
- 2022Adversarial Permutation Invariant Training for Universal Sound Separation21 Oct 2022
- 2022Music Separation Enhancement with Generative Modeling26 Aug 2022
- 2022Self-Supervised Beat Tracking in Musical Signals with Polyphonic Contrastive Learning5 Jan 2022
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data15 Dec 2021
- 2021A Time-domain Real-valued Generalized Wiener Filter for Multi-channel Neural Separation Systems7 Dec 2021
- 2021Hybrid Spectrogram and Waveform Source Separation5 Nov 2021
12 newest of 15 All 15 (JSON)