mlsanityData to 7 Oct 2026

Qwen-Audio-3.0-ASR Technical Report

arXiv 2609.07549 ↗First posted 7 Sep 2026cs.CLcited by 1

On the map: Mixture-of-experts → Multimodal MoE models

Abstract (arXiv)

In recent years, automatic speech recognition (ASR) has witnessed transformative advancements driven by three complementary paradigms: data scaling, model scaling, and deep integration with large language models (LLMs). However, bridging the gap between academic benchmark performance and real-world production utility remains a persistent challenge, particularly in handling diverse regional dialects, dynamic entities and hotwords, long-range contextual information, and disfluent spontaneous speech. In this report, we present Qwen-Audio-3.0-ASR, a Mixture-of-Experts (MoE) LLM-based ASR system designed to address these production demands through a unified, instruction-following framework. The model is built upon the Qwen backbone, and is trained on tens of millions of hours of large-scale speech data. Qwen-Audio-3.0-ASR supports transcription across 30 languages and 16 Chinese dialectal varieties spanning eight major dialect regions. Beyond multilingual and dialectal recognition, the model provides production-oriented capabilities including industry-domain entity recognition, hierarchical hotword customization, native single-pass transcription polishing, and long-audio contextual modeling. We further develop a dedicated streaming variant, Qwen-Audio-3.0-ASR-Streaming, for latency-sensitive applications. Extensive evaluations on Chinese, English, multilingual, and real-world industrial test sets demonstrate state-of-the-art or highly competitive recognition performance across a broad range of evaluation conditions, with strong performance relative to leading commercial and proprietary systems including GPT-4o Transcribe and Gemini 3.1 Pro.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 23 of its 25 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

23 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling9 Jun

Other references · 22

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  5. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  6. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  7. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
  8. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
  9. 2022Self-supervised Learning with Random-projection Quantizer for Speech Recognitioncited by 158
  10. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 142
  11. 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 125
  12. 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
10 more
  1. 2024Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognitioncited by 61
  2. 2025Fun-ASR Technical Reportcited by 19
  3. 2024Paraformer-v2: An improved non-autoregressive transformer for noise-robust speech recognitioncited by 5
  4. 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 5
  5. 2025Contextual Biasing for LLM-Based ASR with Hotword Retrieval and Reinforcement Learningcited by 3
  6. 2024Are Transformers in Pre-trained LM A Good ASR Encoder? An Empirical Studycited by 2
  7. 2026GigaSpeechBench: A Real-World Multilingual Speech-to-Text Benchmarkcited by 2
  8. 2026Contextual Biasing for ASR in Speech LLM with Common Word Cues and Bias Word Position Predictioncited by 1
  9. 2026MEUSLI: a Multilingual Projector for LLM-based ASR and Beyondcited by 1
  10. 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR
  2. 2024LA-RAG:Enhancing LLM-based ASR Accuracy with Retrieval-Augmented Generation
  3. 2024Anatomy of Industrial Scale Multilingual ASR
  4. 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects
  5. 2024Using Large Language Model for End-to-End Chinese ASR and NER
  6. 2024HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models
  7. 2024UME: Upcycling Mixture-of-Experts for Scalable and Efficient Automatic Speech Recognition
  8. 2026Qwen-Audio-3.0-TTS: Freely Controllable and Highly Robust Speech Synthesis with Multi-Stage Training Paradigm