Unsupervised training of a deep clustering model for multichannel blind source separation
Not on the map. Why?
Abstract (arXiv)
We propose a training scheme to train neural network-based source separation algorithms from scratch when parallel clean data is unavailable. In particular, we demonstrate that an unsupervised spatial clustering algorithm is sufficient to guide the training of a deep clustering system. We argue that previous work on deep clustering requires strong supervision and elaborate on why this is a limitation. We demonstrate that (a) the single-channel deep clustering system trained according to the proposed scheme alone is able to achieve a similar performance as the multi-channel teacher in terms of word error rates and (b) initializing the spatial clustering approach with the deep clustering result yields a relative word error rate reduction of 26 % over the unsupervised teacher.
Key facts. Cited by 14 papers in the map (data through 13 Oct 2026). First posted on arXiv 2 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 3.
14 papers.
Sort:
By area:
- 2022AudioScopeV2: Audio-Visual Attention Architectures for Calibrated Open-Domain On-Screen Sound Separationcited by 24
- 2021Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillationcited by 8
- 2021Separate but Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Datacited by 8
- 2021Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separationcited by 8
- 2022MixCycle: Unsupervised Speech Separation via Cyclic Mixture Permutation Invariant Trainingcited by 7
- 2021Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attentioncited by 5
- 2022Unsupervised Music Source Separation Using Differentiable Parametric Source Modelscited by 4
- 2022Learning to Separate Voices by Spatial Regionscited by 4
- 2023UNSSOR: Unsupervised Neural Speech Separation by Leveraging Over-determined Training Mixturescited by 4
- 2023Unearthing InSights into Mars: Unsupervised Source Separation with Limited Datacited by 3
- 2023Multi-scale clustering and source separation of InSight mission seismic datacited by 3
- 2022Reverberation as Supervision for Speech Separationcited by 2
- 2023UNSSOR: Unsupervised Neural Speech Separation by Leveraging Over-determined Training Mixtures31 May 2023
- 2023Multi-scale clustering and source separation of InSight mission seismic data25 May 2023
- 2023Unearthing InSights into Mars: Unsupervised Source Separation with Limited Data27 Jan 2023
- 2022Reverberation as Supervision for Speech Separation15 Nov 2022
- 2022AudioScopeV2: Audio-Visual Attention Architectures for Calibrated Open-Domain On-Screen Sound Separation20 Jul 2022
- 2022Direction-Aware Adaptive Online Neural Speech Enhancement with an Augmented Reality Headset in Real Noisy Conversational Environments15 Jul 2022
- 2022Learning to Separate Voices by Spatial Regions9 Jul 2022
- 2022End-to-End Multi-speaker ASR with Independent Vector Analysis1 Apr 2022
- 2022MixCycle: Unsupervised Speech Separation via Cyclic Mixture Permutation Invariant Training8 Feb 2022
- 2022Unsupervised Music Source Separation Using Differentiable Parametric Source Models24 Jan 2022
- 2021Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attention17 Jun 2021
- 2021Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separation15 Jun 2021
- 2022AudioScopeV2: Audio-Visual Attention Architectures for Calibrated Open-Domain On-Screen Sound Separationcited by 24
- 2021Separate but Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Datacited by 8
- 2022MixCycle: Unsupervised Speech Separation via Cyclic Mixture Permutation Invariant Trainingcited by 7
- 2021Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attentioncited by 5
- 2022Unsupervised Music Source Separation Using Differentiable Parametric Source Modelscited by 4
- 2022Learning to Separate Voices by Spatial Regionscited by 4
- 2023UNSSOR: Unsupervised Neural Speech Separation by Leveraging Over-determined Training Mixturescited by 4
- 2023Unearthing InSights into Mars: Unsupervised Source Separation with Limited Datacited by 3
- 2023Multi-scale clustering and source separation of InSight mission seismic datacited by 3
- 2022Reverberation as Supervision for Speech Separationcited by 2
- 2022End-to-End Multi-speaker ASR with Independent Vector Analysiscited by 1
- 2022Direction-Aware Adaptive Online Neural Speech Enhancement with an Augmented Reality Headset in Real Noisy Conversational Environmentscited by 1
- 2023UNSSOR: Unsupervised Neural Speech Separation by Leveraging Over-determined Training Mixtures31 May 2023
- 2023Multi-scale clustering and source separation of InSight mission seismic data25 May 2023
- 2023Unearthing InSights into Mars: Unsupervised Source Separation with Limited Data27 Jan 2023
- 2022Reverberation as Supervision for Speech Separation15 Nov 2022
- 2022AudioScopeV2: Audio-Visual Attention Architectures for Calibrated Open-Domain On-Screen Sound Separation20 Jul 2022
- 2022Direction-Aware Adaptive Online Neural Speech Enhancement with an Augmented Reality Headset in Real Noisy Conversational Environments15 Jul 2022
- 2022Learning to Separate Voices by Spatial Regions9 Jul 2022
- 2022End-to-End Multi-speaker ASR with Independent Vector Analysis1 Apr 2022
- 2022MixCycle: Unsupervised Speech Separation via Cyclic Mixture Permutation Invariant Training8 Feb 2022
- 2022Unsupervised Music Source Separation Using Differentiable Parametric Source Models24 Jan 2022
- 2021Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attention17 Jun 2021
- 2021Separate but Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Data11 May 2021