Polyglot-Lion: Efficient Multilingual ASR for Singapore via Balanced Fine-Tuning of Qwen3-ASR
Not on the map. Why?
Abstract (arXiv)
We present Polyglot-Lion, a family of compact multilingual automatic speech recognition (ASR) models tailored for the linguistic landscape of Singapore, covering English, Mandarin, Tamil, and Malay. Our models are obtained by fine-tuning Qwen3-ASR-0.6B and Qwen3-ASR-1.7B exclusively on publicly available speech corpora, using a balanced sampling strategy that equalizes the number of training utterances per language and deliberately omits language-tag conditioning so that the model learns to identify languages implicitly from audio. On 12 benchmarks spanning the four target languages, Polyglot-Lion-1.7B achieves an average error rate of 14.85, competitive with MERaLiON-2-10B-ASR (14.32) - a model 6x larger - while incurring a training cost of 81 on a single RTX PRO 6000 GPU compared to 18,862 for the 128-GPU baseline. Inference throughput is approximately 20x faster than MERaLiON at 0.10 s/sample versus 2.02 s/sample. These results demonstrate that linguistically balanced fine-tuning of moderate-scale pretrained models can yield deployment-ready multilingual ASR at a fraction of the cost of larger specialist systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
24 of 39 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
- 2023Scaling Speech Technology to 1,000+ Languagescited by 401
12 more
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
- 2019Massively Multilingual Neural Machine Translation in the Wild: Findings and Challengescited by 253
- 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
- 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
- 2019A Survey of Code-switched Speech and Language Processingcited by 73
- 2020Balancing Training for Multilingual Neural Machine Translationcited by 71
- 2021Are Multilingual Models Effective in Code-Switching?cited by 56
- 2018Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytescited by 54
- 2020Meta-Transfer Learning for Code-Switched Speech Recognitioncited by 22
- 2022Subword Dictionary Learning and Segmentation Techniques for Automatic Speech Recognition in Tamil and Kannadacited by 10
- 2022Knowledge-driven Subword Grammar Modeling for Automatic Speech Recognition in Tamil and Kannadacited by 6
- 2023Towards Improving the Expressiveness of Singing Voice Synthesis with BERT Derived Semantic Informationcited by 4
Built on by
Not cited yet.