Multi-Speaker and Wide-Band Simulated Conversations as Training Data for End-to-End Neural Diarization
Not on the map. Why?
Abstract (arXiv)
End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once. Many flavors of end-to-end models have been proposed but all of them require (so far non-existing) large amounts of annotated data for training. The compromise solution consists in generating synthetic data and the recently proposed simulated conversations (SC) have shown remarkable improvements over the original simulated mixtures (SM). In this work, we create SC with multiple speakers per conversation and show that they allow for substantially better performance than SM, also reducing the dependence on a fine-tuning stage. We also create SC with wide-band public audio sources and present an analysis on several evaluation sets. Together with this publication, we release the recipes for generating such data and models trained on public sets as well as the implementation to efficiently handle multiple speakers per conversation and an auxiliary voice activity detection loss.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Nov 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 2.
4 papers.
- 2023DiaCorrect: Error Correction Back-end For Speaker Diarizationcited by 3
- 2026Speaker-Aware Simulation Improves Conversational Speech Recognitioncited by 2
- 2025LibriConvo: Simulating Conversations from Read Literature for ASR and Diarizationcited by 1
- 2026On the Role of Conversational Timing in Synthetic Training Data for ASRcited by 0
- 2026On the Role of Conversational Timing in Synthetic Training Data for ASR9 Jul 2026
- 2026Speaker-Aware Simulation Improves Conversational Speech Recognition4 Feb 2026
- 2025LibriConvo: Simulating Conversations from Read Literature for ASR and Diarization27 Oct 2025
- 2023DiaCorrect: Error Correction Back-end For Speaker Diarization15 Sep 2023