mlsanityData to 14 Oct 2026

Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Models

arXiv 2607.23395 ↗First posted 25 Jul 2026cs.SD cs.LG eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Music Source Separation (MSS), the task of recovering individual sound components (stems) from a polyphonic mixture, is central to applications ranging from karaoke and remixing to audio restoration and content production. The separation quality depends on engineering decisions across the entire pipeline: model choice, training data preparation and augmentation, loss function and metrics choice, training configuration, validation, and post-processing. This paper presents MSST (Music-Source-Separation-Training) - a universal open-source framework for MSS tasks, which unifies training, validation, and inference for a broad range of modern demixing model families under a single, configuration-driven interface. The framework supports various model architectures, data preprocessing and augmentations, multiple loss functions and evaluation metrics, which helps with fast iterations and ablation studies. Additionally, the framework supports a range of practical techniques that improve separation quality, such as sliding-window inference with cross-fading, test-time augmentation, model ensembling, and fine-tuning via Low-Rank Adaptation (LORA). Our ablation studies demonstrate improvements of MSS using the above techniques. By consolidating these components into a reproducible, YAML-configurable framework, MSST lowers the barrier to systematic experimentation and enables rapid iteration from idea to verifiable result.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 43 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

21 of 43 references.

References · 21

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
  5. 2018SDR - half-baked or well done?cited by 423
  6. 20218-bit Optimizers via Block-wise Quantizationcited by 403
  7. 2022Hybrid Transformers for Music Source Separationcited by 134
  8. 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 133
  9. 2018Wave-U-Net: A Multi-Scale Neural Network for End-to-End Audio Source Separationcited by 125
  10. 2019Music Source Separation in the Waveform Domaincited by 99
  11. 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
  12. 2021Decoupling Magnitude and Phase Estimation with Deep ResUNet for Music Source Separationcited by 48
9 more
  1. 2020Asteroid: the PyTorch-based audio source separation toolkit for researcherscited by 45
  2. 2023Moisesdb: A dataset for source separation beyond 4-stemscited by 39
  3. 2021Music Demixing Challenge 2021cited by 38
  4. 2023Music Source Separation with Band-Split RoPE Transformercited by 37
  5. 2021KUIELab-MDX-Net: A Two-Stream Neural Network for Music Demixingcited by 24
  6. 2023The Sound Demixing Challenge 2023 unicodex2013 Music Demixing Trackcited by 20
  7. 2022On loss functions and evaluation metrics for music source separationcited by 17
  8. 2023Mel-Band RoFormer for Music Source Separationcited by 17
  9. 2024SCNet: Sparse Compression Network for Music Source Separationcited by 10

Built on by

Not cited yet.