mlsanityData to 14 Oct 2026

Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devices

arXiv 2509.02523 ↗First posted 2 Sep 2025cs.CL cs.LG cs.SDcited by 2

Not on the map. Why?

Abstract (arXiv)

We present the Flavors of Moonshine, a suite of tiny automatic speech recognition (ASR) models specialized for a range of underrepresented languages. Prevailing wisdom suggests that multilingual ASR models outperform monolingual counterparts by exploiting cross-lingual phonetic similarities. We challenge this assumption, showing that for sufficiently small models (27M parameters), training monolingual systems on a carefully balanced mix of high-quality human-labeled, pseudo-labeled, and synthetic data yields substantially superior performance. On average, our models achieve error rates 48% lower than the comparably sized Whisper Tiny model, outperform the 9x larger Whisper Small model, and in most cases match or outperform the 28x larger Whisper Medium model. These results advance the state of the art for models of this size, enabling accurate on-device ASR for languages that previously had limited support. We release Arabic, Chinese, Japanese, Korean, Ukrainian, and Vietnamese Moonshine models under a permissive open-source license.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

18 of 30 references.

References · 18

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  4. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  5. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  6. 2016A Learned Representation For Artistic Stylecited by 341
  7. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
  8. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
  9. 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
  10. 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
  11. 2021Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASRcited by 41
  12. 2018Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modelingcited by 34
6 more
  1. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  2. 2024Moonshine: Speech Recognition for Live Transcription and Voice Commandscited by 19
  3. 2025NVSpeech: An Integrated and Scalable Pipeline for Human-Like Speech Modeling with Paralinguistic Vocalizationscited by 15
  4. 2023ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpuscited by 14
  5. 2024PhoWhisper: Automatic Speech Recognition for Vietnamesecited by 13
  6. 2024Open Universal Arabic ASR Leaderboardcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.