Conditioned Source Separation for Music Instrument Performances
Not on the map. Why?
Abstract (arXiv)
In music source separation, the number of sources may vary for each piece and some of the sources may belong to the same family of instruments, thus sharing timbral characteristics and making the sources more correlated. This leads to additional challenges in the source separation problem. This paper proposes a source separation method for multiple musical instruments sounding simultaneously and explores how much additional information apart from the audio stream can lift the quality of source separation. We explore conditioning techniques at different levels of a primary source separation network and utilize two extra modalities of data, namely presence or absence of instruments in the mixture, and the corresponding video stream data.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 2; 2024: 3; 2025: 4.
18 papers.
Sort:
By area:
- 2022VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformercited by 14
- 2022Heterogeneous Target Speech Separationcited by 13
- 2021A cappella: Audio-visual Singing Voice Separationcited by 12
- 2023DPM-TSE: A Diffusion Probabilistic Model for Target Sound Extractioncited by 12
- 2021Multistage linguistic conditioning of convolutional layers for speech emotion recognitioncited by 8
- 2024A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stemscited by 7
- 2022Optimal Condition Training for Target Source Separationcited by 5
- 2024SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separationcited by 4
- 2025Music Audio-Visual Question Answering Requires Specialized Multimodal Designscited by 4
- 2021Music source separation conditioned on 3D point cloudscited by 2
- 2025Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Musiccited by 2
- 2022Locate This, Not That: Class-Conditioned Sound Event DOA Estimationcited by 1
6 more
- 2025The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrievalcited by 1
- 2021LightSAFT: Lightweight Latent Source Aware Frequency Transform for Source Separationcited by 0
- 2022SANE-TTS: Stable And Natural End-to-End Multilingual Text-to-Speechcited by 0
- 2023Pre-trained Spatial Priors on Multichannel NMF for Music Source Separationcited by 0
- 2024CATSE: A Context-Aware Framework for Causal Target Sound Extractioncited by 0
- 2025A Conditioned UNet for Music Source Separationcited by 0
- 2025A Conditioned UNet for Music Source Separation17 Dec 2025
- 2025The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrieval26 Nov 2025
- 2025Music Audio-Visual Question Answering Requires Specialized Multimodal Designs27 May 2025
- 2025Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music10 Mar 2025
- 2024SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separation17 Sep 2024
- 2024A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stems26 Jun 2024
- 2024CATSE: A Context-Aware Framework for Causal Target Sound Extraction21 Mar 2024
- 2023Pre-trained Spatial Priors on Multichannel NMF for Music Source Separation9 Oct 2023
- 2023DPM-TSE: A Diffusion Probabilistic Model for Target Sound Extraction6 Oct 2023
- 2022Optimal Condition Training for Target Source Separation11 Nov 2022
- 2022SANE-TTS: Stable And Natural End-to-End Multilingual Text-to-Speech24 Jun 2022
- 2022Heterogeneous Target Speech Separation7 Apr 2022
6 more
- 2022Locate This, Not That: Class-Conditioned Sound Event DOA Estimation8 Mar 2022
- 2022VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformer8 Mar 2022
- 2021LightSAFT: Lightweight Latent Source Aware Frequency Transform for Source Separation24 Nov 2021
- 2021Multistage linguistic conditioning of convolutional layers for speech emotion recognition13 Oct 2021
- 2021A cappella: Audio-visual Singing Voice Separation20 Apr 2021
- 2021Music source separation conditioned on 3D point clouds3 Feb 2021
- 2022VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformercited by 14
- 2022Heterogeneous Target Speech Separationcited by 13
- 2021A cappella: Audio-visual Singing Voice Separationcited by 12
- 2021Multistage linguistic conditioning of convolutional layers for speech emotion recognitioncited by 8
- 2024A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stemscited by 7
- 2022Optimal Condition Training for Target Source Separationcited by 5
- 2024SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separationcited by 4
- 2021Music source separation conditioned on 3D point cloudscited by 2
- 2025Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Musiccited by 2
- 2022Locate This, Not That: Class-Conditioned Sound Event DOA Estimationcited by 1
- 2025The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrievalcited by 1
- 2021LightSAFT: Lightweight Latent Source Aware Frequency Transform for Source Separationcited by 0
12 most cited of 16 All 16 (JSON)
- 2025A Conditioned UNet for Music Source Separation17 Dec 2025
- 2025The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrieval26 Nov 2025
- 2025Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music10 Mar 2025
- 2024SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separation17 Sep 2024
- 2024A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stems26 Jun 2024
- 2024CATSE: A Context-Aware Framework for Causal Target Sound Extraction21 Mar 2024
- 2023Pre-trained Spatial Priors on Multichannel NMF for Music Source Separation9 Oct 2023
- 2022Optimal Condition Training for Target Source Separation11 Nov 2022
- 2022SANE-TTS: Stable And Natural End-to-End Multilingual Text-to-Speech24 Jun 2022
- 2022Heterogeneous Target Speech Separation7 Apr 2022
- 2022Locate This, Not That: Class-Conditioned Sound Event DOA Estimation8 Mar 2022
- 2022VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformer8 Mar 2022
12 newest of 16 All 16 (JSON)