Qwen-Audio-3.0-ASR Technical Report
On the map: Mixture-of-experts → Multimodal MoE models
Abstract (arXiv)
In recent years, automatic speech recognition (ASR) has witnessed transformative advancements driven by three complementary paradigms: data scaling, model scaling, and deep integration with large language models (LLMs). However, bridging the gap between academic benchmark performance and real-world production utility remains a persistent challenge, particularly in handling diverse regional dialects, dynamic entities and hotwords, long-range contextual information, and disfluent spontaneous speech. In this report, we present Qwen-Audio-3.0-ASR, a Mixture-of-Experts (MoE) LLM-based ASR system designed to address these production demands through a unified, instruction-following framework. The model is built upon the Qwen backbone, and is trained on tens of millions of hours of large-scale speech data. Qwen-Audio-3.0-ASR supports transcription across 30 languages and 16 Chinese dialectal varieties spanning eight major dialect regions. Beyond multilingual and dialectal recognition, the model provides production-oriented capabilities including industry-domain entity recognition, hierarchical hotword customization, native single-pass transcription polishing, and long-audio contextual modeling. We further develop a dedicated streaming variant, Qwen-Audio-3.0-ASR-Streaming, for latency-sensitive applications. Extensive evaluations on Chinese, English, multilingual, and real-world industrial test sets demonstrate state-of-the-art or highly competitive recognition performance across a broad range of evaluation conditions, with strong performance relative to leading commercial and proprietary systems including GPT-4o Transcribe and Gemini 3.1 Pro.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 23 of its 25 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
23 of 25 references.
Closest ancestors · 1
Same direction, newest first
Other references · 22
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2022Self-supervised Learning with Random-projection Quantizer for Speech Recognitioncited by 158
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 142
- 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 125
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
10 more
- 2024Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognitioncited by 61
- 2025Fun-ASR Technical Reportcited by 19
- 2024Paraformer-v2: An improved non-autoregressive transformer for noise-robust speech recognitioncited by 5
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 5
- 2025Contextual Biasing for LLM-Based ASR with Hotword Retrieval and Reinforcement Learningcited by 3
- 2024Are Transformers in Pre-trained LM A Good ASR Encoder? An Empirical Studycited by 2
- 2026GigaSpeechBench: A Real-World Multilingual Speech-to-Text Benchmarkcited by 2
- 2026Contextual Biasing for ASR in Speech LLM with Common Word Cues and Bias Word Position Predictioncited by 1
- 2026MEUSLI: a Multilingual Projector for LLM-based ASR and Beyondcited by 1
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR
- 2024LA-RAG:Enhancing LLM-based ASR Accuracy with Retrieval-Augmented Generation
- 2024Anatomy of Industrial Scale Multilingual ASR
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects
- 2024Using Large Language Model for End-to-End Chinese ASR and NER
- 2024HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models
- 2024UME: Upcycling Mixture-of-Experts for Scalable and Efficient Automatic Speech Recognition
- 2026Qwen-Audio-3.0-TTS: Freely Controllable and Highly Robust Speech Synthesis with Multi-Stage Training Paradigm