mlsanityData to 19 Oct 2026

Cross-Lingual Speaker Verification with Self-Supervised Pre-Trained Models

arXiv 2610.11099 ↗First posted 8 Oct 2026cs.SD eess.AScited by 0

On the map: Speech and audio language models → Speaker recognition and diarization

Abstract (arXiv)

Speaker verification (SV) performance degrades under language mismatch due to the entanglement of speaker identity with language-specific acoustic cues. To address this problem, we leverage large-scale self-supervised pre-trained models (PTMs) to learn language-agnostic speaker representations. We utilize PTMs as robust front-end feature extractors, capitalizing on their rich acoustic and linguistic knowledge acquired from vast, diverse audio data. These generalized features are then used to train a downstream speaker embedding network, effectively disentangling speaker identity from language-specific characteristics. We validate our approach on the TidyVoice2026 benchmark, which benchmarks SV under language mismatch. Our proposed system (team T02) achieves equal error rates (EERs) of 2.21% on tv26_eval-A and 2.99% on tv26_eval-U.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speaker recognition and diarization, one of 11 directions in Speech and audio language models. Builds on 29 of its 38 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

29 of 38 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026TidyVoice 2026 Challenge Evaluation Plan29 Jan
  2. 2026TidyVoice: A Curated Multilingual Dataset for Speaker Verification Derived from Common Voice22 Jan
  3. 2025Enhancing Speaker Verification with w2v-BERT 2.0 and Knowledge Distillation guided Structured Pruning5 Oct
  4. 2024Reshape Dimensions Network for Speaker Recognition25 Jul
  5. 2024VoxBlink2: A 100K+ Speaker Recognition Corpus and the Open-Set Speaker-Identification Benchmark16 Jul
  6. 2023The DKU-MSXF Speaker Verification System for the VoxCeleb Speaker Recognition Challenge 202317 Aug
  7. 2023Exploring Binary Classification Loss For Speaker Verification17 Jul
  8. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking1 Mar
  9. 2021Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification12 Oct

Other references · 20

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,661
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 4,385
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,762
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 2,135
  5. 2018VoxCeleb2: Deep Speaker Recognitioncited by 1,166
  6. 2017VoxCeleb: a large-scale speaker identification datasetcited by 985
  7. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 980
  8. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 694
  9. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 678
  10. 2023Scaling Speech Technology to 1,000+ Languagescited by 483
  11. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 412
  12. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 270
8 more
  1. 2018Attentive Statistics Pooling for Deep Speaker Embeddingcited by 207
  2. 2023SeamlessM4T: Massively Multilingual & Multimodal Machine Translationcited by 145
  3. 2019CN-CELEB: a challenging Chinese speaker recognition datasetcited by 123
  4. 2021UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Trainingcited by 69
  5. 2019Large Margin Softmax Loss for Speaker Verificationcited by 59
  6. 20233D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglementcited by 31
  7. 2024Whisper-PMFA: Partial Multi-Scale Feature Aggregation for Speaker Verification using Whisper Modelscited by 5
  8. 2025Quantifying and Reducing Speaker Heterogeneity within the Common Voice Corpus for Phonetic Analysiscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Audio Large Language Models Verify Speaker Identity?
  2. 2024Towards Supervised Performance on Speaker Verification with Self-Supervised Learning by Leveraging Large-Scale ASR Models
  3. 2022Label-Efficient Self-Supervised Speaker Verification With Information Maximization and Contrastive Learning
  4. 2021Tackling the Score Shift in Cross-Lingual Speaker Verification by Exploiting Language Information
  5. 2026Language-Invariant Multilingual Speaker Verification for the TidyVoice 2026 Challenge
  6. 2025DELULU: Discriminative Embedding Learning Using Latent Units for Speaker-Aware Self-Trained Speech Foundational Model
  7. 2023Improving Speaker Verification with Self-Pretrained Transformer Models
  8. 2023Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision