mlsanityData to 7 Oct 2026

Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis

arXiv 2011.02014 ↗First posted 3 Nov 2020eess.AS cs.SDcited by 34

Not on the map. Why?

Abstract (arXiv)

Multi-speaker speech recognition of unsegmented recordings has diverse applications such as meeting transcription and automatic subtitle generation. With technical advances in systems dealing with speech separation, speaker diarization, and automatic speech recognition (ASR) in the last decade, it has become possible to build pipelines that achieve reasonable error rates on this task. In this paper, we propose an end-to-end modular system for the LibriCSS meeting data, which combines independently trained separation, diarization, and recognition components, in that order. We study the effect of different state-of-the-art methods at each stage of the pipeline, and report results using task-specific metrics like SDR and DER, as well as downstream WER. Experiments indicate that the problem of overlapping speech for diarization and ASR can be effectively mitigated with the presence of a well-trained separation module. Our best system achieves a speaker-attributed WER of 12.7%, which is close to that of a non-overlapping ASR.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 10; 2023: 8; 2024: 2; 2025: 6; 2026: 3.

34 papers.

Sort:

By area:

  1. 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 122
  2. 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
  3. 2021End-to-End Speaker-Attributed ASR with Transformercited by 35
  4. 2021Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphonecited by 33
  5. 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASRcited by 22
  6. 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 20
  7. 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcriptioncited by 18
  8. 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
  9. 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 14
  10. 2023One model to rule them all ? Towards End-to-End Joint Speaker Diarization and Speech Recognitioncited by 12
  11. 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audiocited by 10
  12. 2022Simulating realistic speech overlaps improves multi-talker ASRcited by 10
22 more
  1. 2022VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognitioncited by 7
  2. 2023Typing to Listen at the Cocktail Party: Text-Guided Target Speaker Extractioncited by 6
  3. 2026D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioningcited by 6
  4. 2022Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separationcited by 4
  5. 2024MSA-ASR: Efficient Multilingual Speaker Attribution with frozen ASR Modelscited by 4
  6. 2025Unifying Diarization, Separation, and ASR with Multi-Speaker Encodercited by 4
  7. 2022Disentangling the Impacts of Language and Channel Variability on Speech Separation Networkscited by 3
  8. 2022CasNet: Investigating Channel Robustness for Speech Separationcited by 2
  9. 2022Handling Trade-Offs in Speech Separation with Sparsely-Gated Mixture of Expertscited by 2
  10. 2022Reverberation as Supervision for Speech Separationcited by 2
  11. 2023End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversationscited by 2
  12. 2023On Data Sampling Strategies for Training Neural Network Speech Separation Modelscited by 2
  13. 2025Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challengescited by 2
  14. 2022Analysis of impact of emotions on target speech extraction and speech separationcited by 1
  15. 2023Combining TF-GridNet and Mixture Encoder for Continuous Speech Separation for Meeting Transcriptioncited by 1
  16. 2025Error Analysis in a Modular Meeting Transcription Systemcited by 1
  17. 2026MK-SGC-SC: Multiple Kernel Guided Sparse Graph Construction in Spectral Clustering for Unsupervised Speaker Diarizationcited by 1
  18. 2023Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representationcited by 0
  19. 2023LibriWASN: A Data Set for Meeting Separation, Diarization, and Recognition with Asynchronous Recording Devicescited by 0
  20. 2025Improving Practical Aspects of End-to-End Multi-Talker Speech Recognition for Online and Offline Scenarioscited by 0
  21. 2025Robust Target Speaker Diarization and Separation via Augmented Speaker Embedding Samplingcited by 0
  22. 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokenscited by 0