mlsanityData to 7 Oct 2026

Spoken Language Identification with Pre-trained Models and Margin Loss

arXiv 2605.01905 ↗First posted 3 May 2026cs.SD cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

For the speaker-controlled spoken language identification task proposed in the TidyLang Challenge 2026, this paper proposes a language identification method based on pre-trained models and margin-based losses. The proposed method adopts a pre-trained ECAPA-TDNN as the feature encoder and incorporates margin-based losses to enhance the discriminative ability of language representations, thereby improving inter-class separability and reducing the interference of non-linguistic factors such as speaker characteristics. Experimental results on the Tidy-X dataset show that the proposed method achieves 85.95% macro accuracy and 90.96% micro accuracy on the language identification task and 17.08% equal error rate (EER) on the verification task. Compared with the official baseline, the macro accuracy improves by 45.7%, the micro accuracy improves by 15.2%, and the EER is reduced by approximately 50.8%, demonstrating the effectiveness of the proposed method. The code will be released at https://github.com/PunkMale/TidyLang2026.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 24 references that are in the map. First posted on arXiv 3 May 2026.

Builds on

11 of 24 references.

References · 11

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  3. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  5. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  6. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  7. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 400
  8. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  9. 2020Exploring wav2vec 2.0 on speaker verification and language identificationcited by 93
  10. 2026TidyVoice: A Curated Multilingual Dataset for Speaker Verification Derived from Common Voicecited by 5
  11. 2021Real Additive Margin Softmax for Speaker Verificationcited by 3

Built on by

Not cited yet.