Dolphin-CN-Dialect: Where Chinese Dialects Matter
Not on the map. Why?
Abstract (arXiv)
We present Dolphin-CN-Dialect, a streaming-capable ASR model with a focus on Chinese and dialect-rich scenarios. Compared to the previous version, Dolphin-CN-Dialect introduces substantial improvements in data processing, tokenization, training stability, and data sampling strategies. To address the challenges of highly imbalanced dialect data, we propose a temperature-based sampling strategy that effectively balances standard Mandarin and low-resource dialects, leading to significant gains in dialect recognition performance. In addition, we redesign the tokenizer to better align with linguistic characteristics, adopting character-level modeling for Chinese and subword modeling for English, while introducing extensible dialect tokens. Experimental results show that Dolphin-CN-Dialect achieves improvement in dialect recognition accuracy and CER reduction compared to Dolphin. Furthermore, Dolphin-CN-Dialect reaches competitive performance with recent SOTA open-source ASR models, while maintaining a significantly smaller model size. Dolphin-CN-Dialect supports both streaming and non-streaming inference, enabling a practical balance between latency and accuracy. It also provides flexible customization through hotword support and efficient deployment optimized for specialized hardware. These improvements make Dolphin-CN-Dialect a strong and practical solution for real-world multi-dialect ASR applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 19 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
17 of 19 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
- 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
- 2026Qwen3-ASR Technical Reportcited by 118
- 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 47
- 2025FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM Integrationcited by 46
5 more
- 2023Contextualized End-to-End Speech Recognition with Contextual Phrase Prediction Networkcited by 31
- 2025Fun-ASR Technical Reportcited by 19
- 2023SeACo-Paraformer: A Non-Autoregressive ASR System with Flexible and Effective Hotword Customization Abilitycited by 18
- 2026FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition Systemcited by 16
- 2025Dolphin: A Large-Scale Automatic Speech Recognition Model for Eastern Languagescited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.