Speaker Diarization for Low-Resource Languages Through Wav2vec Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
Speaker diarization is a fundamental task in speech processing that involves dividing an audio stream by speaker. Although state-of-the-art models have advanced performance in high-resource languages, low-resource languages such as Kurdish pose unique challenges due to limited annotated data, multiple dialects and frequent code-switching. In this study, we address these issues by training the Wav2Vec 2.0 self-supervised learning model on a dedicated Kurdish corpus. By leveraging transfer learning, we adapted multilingual representations learned from other languages to capture the phonetic and acoustic characteristics of Kurdish speech. Relative to a baseline method, our approach reduced the diarization error rate by seven point two percent and improved cluster purity by thirteen percent. These findings demonstrate that enhancements to existing models can significantly improve diarization performance for under-resourced languages. Our work has practical implications for developing transcription services for Kurdish-language media and for speaker segmentation in multilingual call centers, teleconferencing and video-conferencing systems. The results establish a foundation for building effective diarization systems in other understudied languages, contributing to greater equity in speech technology.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 23 Apr 2025.
Builds on
18 of 45 references.
References · 18
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
- 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
- 2020A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarioscited by 171
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
- 2020Exploring wav2vec 2.0 on speaker verification and language identificationcited by 95
- 2020A Survey on Text Classification: From Shallow to Deep Learningcited by 80
- 2019End-to-End Neural Speaker Diarization with Self-attentioncited by 77
- 2017Speaker Diarization with LSTMcited by 73
- 2020End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractorscited by 71
- 2020The Third DIHARD Diarization Challengecited by 49
- 2020A Survey on Transfer Learning in Natural Language Processingcited by 33
6 more
- 2019FocusNet: Imbalanced Large and Small Organ Segmentation with an End-to-End Deep Neural Network for Head and Neck CT Imagescited by 24
- 2023Enhancing Speaker Diarization with Large Language Models: A Contextual Beam Search Approachcited by 16
- 2022EEND-SS: Joint End-to-End Neural Speaker Diarization and Speech Separation for Flexible Number of Speakerscited by 10
- 2024Breaking Walls: Pioneering Automatic Speech Recognition for Central Kurdish: End-to-End Transformer Paradigmcited by 7
- 2024Language and Speech Technology for Central Kurdish Varietiescited by 5
- 2024Towards Unsupervised Speaker Diarization System for Multilingual Telephone Calls Using Pre-trained Whisper Model and Mixture of Sparse Autoencoderscited by 1
Built on by
Not cited yet.