# Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music

arXiv: https://arxiv.org/abs/2503.07352 · HTML: https://mlsanity.com/paper/2503.07352/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 21 references that are in the map.
- First posted on arXiv 10 Mar 2025.

## Builds on (most cited first, 11 of 11)

- [Hybrid Transformers for Music Source Separation](https://mlsanity.com/paper/2211.08553/) (2022)
- [Music Source Separation in the Waveform Domain](https://mlsanity.com/paper/1911.13254/) (2019)
- [Hybrid Spectrogram and Waveform Source Separation](https://mlsanity.com/paper/2111.03600/) (2021)
- [Music Source Separation with Band-split RNN](https://mlsanity.com/paper/2209.15174/) (2022)
- [Creating A Multi-track Classical Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications](https://mlsanity.com/paper/1612.08727/) (2016)
- [Asteroid: the PyTorch-based audio source separation toolkit for researchers](https://mlsanity.com/paper/2005.04132/) (2020)
- [All for One and One for All: Improving Music Separation by Bridging Networks](https://mlsanity.com/paper/2010.04228/) (2020)
- [The Sound Demixing Challenge 2023 unicodex2013 Music Demixing Track](https://mlsanity.com/paper/2308.06979/) (2023)
- [Conditioned Source Separation for Music Instrument Performances](https://mlsanity.com/paper/2004.03873/) (2020)
- [Structured Dropout for Weak Label and Multi-Instance Learning and Its Application to Score-Informed Source Separation](https://mlsanity.com/paper/1609.04557/) (2016)
- [SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separation](https://mlsanity.com/paper/2409.10995/) (2024)

## Built on by (most cited first, 2 of 2)

- [The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrieval](https://mlsanity.com/paper/2511.21247/) (2025)
- [SCISSOR: Score-Conditioned Instrument Source Separation for Orchestral Recordings](https://mlsanity.com/paper/2609.33265/) (2026)

## Abstract (arXiv)

Music source separation is the task of separating a mixture of instruments into constituent tracks. Music source separation models are typically trained using only audio data, although additional information can be used to improve the model's separation capability. In this paper, we propose two ways of using musical scores to aid music source separation: a score-informed model where the score is concatenated with the magnitude spectrogram of the audio mixture as the input of the model, and a model where we use only the score to calculate the separation mask. We train our models on synthetic data in the SynthSOD dataset and evaluate our methods on the URMP and Aalto anechoic orchestra datasets, comprised of real recordings. The score-informed model improves separation results compared to a baseline approach, but struggles to generalize from synthetic to real data, whereas the score-only model shows a clear improvement in synthetic-to-real generalization.
