mlsanityData to 14 Oct 2026

Complete and separate: Conditional separation with missing target source attribute completion

arXiv 2307.14609 ↗First posted 27 Jul 2023cs.SD cs.LG eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Recent approaches in source separation leverage semantic information about their input mixtures and constituent sources that when used in conditional separation models can achieve impressive performance. Most approaches along these lines have focused on simple descriptions, which are not always useful for varying types of input mixtures. In this work, we present an approach in which a model, given an input mixture and partial semantic information about a target source, is trained to extract additional semantic data. We then leverage this pre-trained model to improve the separation performance of an uncoupled multi-conditional separation network. Our experiments demonstrate that the separation performance of this multi-conditional model is significantly improved, approaching the performance of an oracle model with complete semantic information. Furthermore, our approach achieves performance levels that are comparable to those of the best performing specialized single conditional models, thus providing an easier to use alternative.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 28 references that are in the map. First posted on arXiv 27 Jul 2023.

Builds on

24 of 28 references.

References · 24

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  4. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
  5. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
  6. 2018SDR - half-baked or well done?cited by 423
  7. 2015Deep clustering: Discriminative embeddings for segmentation and separationcited by 212
  8. 2016Permutation Invariant Training of Deep Models for Speaker-Independent Multi-talker Speech Separationcited by 191
  9. 2020Wavesplit: End-to-End Speech Separation by Speaker Clusteringcited by 75
  10. 2018VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Maskingcited by 73
  11. 2022TF-GridNet: Making Time-Frequency Domain Models Great Again for Monaural Speaker Separationcited by 48
  12. 2016Single-Channel Multi-Speaker Separation using Deep Clusteringcited by 45
12 more
  1. 2022Separate What You Describe: Language-Queried Audio Source Separationcited by 45
  2. 2019Conditioned-U-Net: Introducing a Control Mechanism in the U-Net for Multiple Source Separationscited by 27
  3. 2020Listen to What You Want: Neural Network-based Universal Sound Selectorcited by 27
  4. 2022AudioScopeV2: Audio-Visual Attention Architectures for Calibrated Open-Domain On-Screen Sound Separationcited by 24
  5. 2022Text-Driven Separation of Arbitrary Soundscited by 23
  6. 2022CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videoscited by 23
  7. 2019Improving Universal Sound Separation Using Sound Classificationcited by 17
  8. 2021Compute and memory efficient universal sound source separationcited by 15
  9. 2022Heterogeneous Target Speech Separationcited by 13
  10. 2020Improving Sound Event Detection In Domestic Environments Using Sound Separationcited by 6
  11. 2022Optimal Condition Training for Target Source Separationcited by 5
  12. 2023Improving Speech Enhancement via Event-based Querycited by 1

Built on by

Not cited yet.