mlsanityData to 19 Oct 2026

A Toolkit for Joint Speaker Diarization and Identification with Application to Speaker-Attributed ASR

arXiv 2409.05750 ↗First posted 9 Sep 2024eess.AS cs.MMcited by 0

On the map: Speech and audio language models → Speaker recognition and diarization

Abstract (arXiv)

We present a modular toolkit to perform joint speaker diarization and speaker identification. The toolkit can leverage on multiple models and algorithms which are defined in a configuration file. Such flexibility allows our system to work properly in various conditions (e.g., multiple registered speakers' sets, acoustic conditions and languages) and across application domains (e.g. media monitoring, institutional, speech analytics). In this demonstration we show a practical use-case in which speaker-related information is used jointly with automatic speech recognition engines to generate speaker-attributed transcriptions. To achieve that, we employ a user-friendly web-based interface to process audio and video inputs with the chosen configuration.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speaker recognition and diarization, one of 11 directions in Speech and audio language models. Builds on 3 of its 5 references that are in the map. First posted on arXiv 9 Sep 2024.

Builds on

3 of 5 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkit31 Oct
  2. 2021Advances in integration of end-to-end neural and clustering-based diarization for real conversational speech19 May

Other references · 1

  1. 2018VoxCeleb2: Deep Speaker Recognitioncited by 1,166

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  2. 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  3. 2024Improving Speaker Assignment in Speaker-Attributed ASR for Real Meeting Applications
  4. 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  5. 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge
  6. 2023USED: Universal Speaker Extraction and Diarization
  7. 2023One model to rule them all ? Towards End-to-End Joint Speaker Diarization and Speech Recognition
  8. 2022A Comparative Study on Speaker-attributed Automatic Speech Recognition in Multi-party Meetings