Spoken Language Identification with Pre-trained Models and Margin Loss
Not on the map. Why?
Abstract (arXiv)
For the speaker-controlled spoken language identification task proposed in the TidyLang Challenge 2026, this paper proposes a language identification method based on pre-trained models and margin-based losses. The proposed method adopts a pre-trained ECAPA-TDNN as the feature encoder and incorporates margin-based losses to enhance the discriminative ability of language representations, thereby improving inter-class separability and reducing the interference of non-linguistic factors such as speaker characteristics. Experimental results on the Tidy-X dataset show that the proposed method achieves 85.95% macro accuracy and 90.96% micro accuracy on the language identification task and 17.08% equal error rate (EER) on the verification task. Compared with the official baseline, the macro accuracy improves by 45.7%, the micro accuracy improves by 15.2%, and the EER is reduced by approximately 50.8%, demonstrating the effectiveness of the proposed method. The code will be released at https://github.com/PunkMale/TidyLang2026.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 24 references that are in the map. First posted on arXiv 3 May 2026.
Builds on
11 of 24 references.
References · 11
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
- 2015MUSAN: A Music, Speech, and Noise Corpuscited by 400
- 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
- 2020Exploring wav2vec 2.0 on speaker verification and language identificationcited by 93
- 2026TidyVoice: A Curated Multilingual Dataset for Speaker Verification Derived from Common Voicecited by 5
- 2021Real Additive Margin Softmax for Speaker Verificationcited by 3
Built on by
Not cited yet.