Qwen3-ASR Technical Report
Not on the map. Why?
Abstract (arXiv)
In this report, we introduce Qwen3-ASR family, which includes two powerful all-in-one speech recognition models and a novel non-autoregressive speech forced alignment model. Qwen3-ASR-1.7B and Qwen3-ASR-0.6B are ASR models that support language identification and ASR for 52 languages and dialects. Both of them leverage large-scale speech training data and the strong audio understanding ability of their foundation model Qwen3-Omni. We conduct comprehensive internal evaluation besides the open-sourced benchmarks as ASR models might differ little on open-sourced benchmark scores but exhibit significant quality differences in real-world scenarios. The experiments reveal that the 1.7B version achieves SOTA performance among open-sourced ASR models and is competitive with the strongest proprietary APIs while the 0.6B version offers the best accuracy-efficiency trade-off. Qwen3-ASR-0.6B can achieve an average TTFT as low as 92ms and transcribe 2000 seconds speech in 1 second at a concurrency of 128. Qwen3-ForcedAligner-0.6B is an LLM based NAR timestamp predictor that is able to align text-speech pairs in 11 languages. Timestamp accuracy experiments show that the proposed model outperforms the three strongest force alignment models and takes more advantages in efficiency and versatility. To further accelerate the community research of ASR and audio understanding, we release these models under the Apache 2.0 license.
Key facts. Cited by 118 papers in the map (data through 14 Oct 2026). Builds on 12 of its 23 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
12 of 23 references.
References · 12
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2015Listen, Attend and Spellcited by 543
- 2025Qwen3-Omni Technical Reportcited by 497
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
- 2020CTC-Segmentation of Large Corpora for German End-to-end Speech Recognitioncited by 76
- 2023Achieving Timestamp Prediction While Recognizing with Non-Autoregressive End-to-End ASR Modelcited by 10
- 2025Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methodscited by 10
- 2025WenetSpeech-Yue: A Large-scale Cantonese Speech Corpus with Multi-dimensional Annotationcited by 9
- 2026LLM-ForcedAligner: A Non-Autoregressive and Accurate LLM-Based Forced Aligner for Multilingual and Long-Form Speechcited by 9
- 2025WenetSpeech-Chuan: A Large-Scale Sichuanese Corpus with Rich Annotation for Dialectal Speech Processingcited by 8
Built on by
Citing papers per year: 2026: 118.
118 papers.
Sort:
By area:
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2026GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Taskscited by 14
- 2026MOSS-Audio Technical Reportcited by 11
- 2026PASK: Toward Intent-Aware Proactive Agents with Long-Term Memorycited by 9
- 2026Raon-Speech Technical Reportcited by 7
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 6
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 5
- 2026Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulationcited by 5
- 2026Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarizationcited by 4
- 2026Audio Interaction Modelcited by 4
- 2026Whisper-CD: Accurate Long-Form Speech Recognition using Multi-Negative Contrastive Decodingcited by 3
- 2026ASPIRin: Action Space Projection for Interactivity-Optimized Reinforcement Learning in Full-Duplex Speech Language Modelscited by 3
38 more
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Predictioncited by 3
- 2026Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modelingcited by 2
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluationcited by 2
- 2026MemoryCard: Topic-Aware Multi-Modal Clue Compression for Long-Video Question Answeringcited by 2
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 2
- 2026Exploring the potential and limitations of Model Merging for Multi-Domain Adaptation in ASRcited by 1
- 2026TaigiSpeech: A Low-Resource Real-World Speech Intent Dataset and Preliminary Results with Scalable Data Mining In-the-Wildcited by 1
- 2026Harf-Speech: A Clinically Aligned Framework for Arabic Phoneme-Level Speech Assessmentcited by 1
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMscited by 1
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognitioncited by 1
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASRcited by 1
- 20262nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VAcited by 1
- 2026Report of the 5th PVUW Challenge: Towards More Diverse Modalities in Pixel-Level Understandingcited by 1
- 2026When Audio-Language Models Fail to Leverage Multimodal Context for Dysarthric Speech Recognitioncited by 1
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Mattercited by 1
- 2026FormalASR: End-to-End Spoken Chinese to Formal Textcited by 1
- 2026LaSR: Context-Aware Speech Recognition via Latent Reasoningcited by 1
- 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognitioncited by 1
- 2026Bagpiper-TTS: Natural Language Guided Universal Speech Synthesiscited by 1
- 2026Adapting Foundation ASR Models to Dysarthric Speech: A Case Studycited by 1
- 2026InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generationcited by 1
- 2026AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approachcited by 1
- 2026Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASRcited by 1
- 2026How to Recognize New Words: A Comparison Between Context Biasing Methods and Speech LLMscited by 1
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editingcited by 1
- 2026DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Eventscited by 1
- 2026Enabling Streaming User Transcription in Full-Duplex Speech-to-Speech Modelscited by 1
- 2026Omni2Web: Benchmarking Audiovisual Website Developmentcited by 1
- 2026Long-Tail Rebalancing for Non-Verbal Vocalization-Aware ASR: A Track 1 System for the NVVSpeech Challengecited by 1
- 2026AST: Adaptive, Seamless, and Training-Free Precise Speech Editingcited by 0
- 2026Tadabur: A Large-Scale Quran Audio Datasetcited by 0
- 2026AppTek Call-Center Dialogues: A Multi-Accent Long-Form Benchmark for English ASRcited by 0
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
- 2026EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillationcited by 0
- 2026PilotTTS: A Disciplined Modular Recipe for Competitive Speech Synthesiscited by 0
- 2026MindVoice: Reconstructing Intelligible Speech from Non-invasive Neural Signals with Pretrained Priorscited by 0
- 2026Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancycited by 0
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Controlcited by 0
50 most cited of 118 All 118 (JSON)
- 2026SEA-HELM Audio: Evaluating Multilingual ASR-LLM Pipeline Performance Across SEA-HELM Subsets14 Oct 2026
- 2026ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Context12 Oct 2026
- 2026OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation9 Oct 2026
- 2026EgoVoice: Proactive Spoken Assistance from Egocentric Multimodal Streams8 Oct 2026
- 2026DiffuPlex: Accelerating Full-Duplex Spoken Dialog Models via Rolling Masked Diffusion8 Oct 2026
- 2026InterView-C: A Synchronized Multimodal Corpus of VR Avatar-Mediated Survey Interviews7 Oct 2026
- 2026HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR6 Oct 2026
- 2026Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants5 Oct 2026
- 2026Batched Speech Decisions Without Decoding: Single-Token Supervision Lets a Frozen LLM Hear Beyond the Transcript2 Oct 2026
- 2026OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning1 Oct 2026
- 2026ReCast: Contract-Preserving Protection for Fixed-Interface Multimodal Reasoning1 Oct 2026
- 2026From Speech to Editable Concepts: Probing Emotion Recognition with Concept Bottleneck Models30 Sep 2026
38 more
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026SCIC: Scope- and Codebook-Aware Instruction Conditioning for Speaker-Adapted Expressive TTS30 Sep 2026
- 2026AS2D: Accelerating On-Demand Audio Understanding on Mobile Devices29 Sep 2026
- 2026Benchmarking Automatic Speech Recognition Tools for Iberian Languages29 Sep 2026
- 2026PlaylistEval: Can Video-Language Judges Be Trusted at Day Scale and Beyond?28 Sep 2026
- 2026In-Context Adaptation of Encoder-Decoder Models in Speech Recognition27 Sep 2026
- 2026Controlling Speaking Rate in Autoregressive TTS via Activation Steering27 Sep 2026
- 2026YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality27 Sep 2026
- 2026FuseAlign: Forced Alignment in the Wild27 Sep 2026
- 2026Context Spanning: A Communication Framework for Full-Duplex Speech Models and External LLM Backends27 Sep 2026
- 2026From Script to Drama: An Agentic Framework for Controllable Multi-Speaker Dialogue TTS27 Sep 2026
- 2026Acoustic Progress Propagation for Long-Horizon Speculative Decoding in ASR27 Sep 2026
- 2026FA-Bench: A Benchmark for Phone- and Word-Level Timestamp Accuracy in Forced Alignment and ASR on Clean and Noisy Speech26 Sep 2026
- 2026Pretrained ASR Pseudo-labeling for Noisy Police Audio24 Sep 2026
- 2026Adaptive Fisher-Whitened Cross-Covariance for Low-Resource Speech Recognition24 Sep 2026
- 2026agentic-ger: terminology recovery in long-form speech using global context24 Sep 2026
- 2026A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations23 Sep 2026
- 2026PTC-Bias: Phoneme-Level Temporal Competition for Bias Retrieval and Post-Decoding Correction in Speech LLMs23 Sep 2026
- 2026MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos23 Sep 2026
- 2026Ruby-ASR: Evidence-Preserving Supervision for Joint Orthographic and Lexical-Reading Recognition23 Sep 2026
- 2026Long-Tail Rebalancing for Non-Verbal Vocalization-Aware ASR: A Track 1 System for the NVVSpeech Challenge20 Sep 2026
- 2026Omni2Web: Benchmarking Audiovisual Website Development20 Sep 2026
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning19 Sep 2026
- 2026OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue18 Sep 2026
- 2026Design of the IBM Granite 5.0 TurboCTC ASR Model17 Sep 2026
- 2026HearInContext: A Benchmark for Implicit Context in Speech Recognition16 Sep 2026
- 2026Voice of Reason: Reinforcement Learning for Spoken Math16 Sep 2026
- 2026VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval16 Sep 2026
- 2026Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR16 Sep 2026
- 2026Open-Qwen-Music: An Auditable Framework for LLM-Based Music Composition and Diffusion Rendering14 Sep 2026
- 2026Enabling Streaming User Transcription in Full-Duplex Speech-to-Speech Models14 Sep 2026
- 2026Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation13 Sep 2026
- 2026DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Events11 Sep 2026
- 2026SteerDuplex: Steerable Duplex Speech Dialogue Models11 Sep 2026
- 2026Quantifying Consonant Contributions to Word Intelligibility via Acoustic Masking10 Sep 2026
- 2026Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speech10 Sep 2026
- 2026S3-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants9 Sep 2026
- 2026X2-NativeCursor: Native-Token Text Progress Tracking for Incremental-Text Streaming Codec TTS9 Sep 2026
50 newest of 118 All 118 (JSON)
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMscited by 1
- 2026LaSR: Context-Aware Speech Recognition via Latent Reasoningcited by 1
- 2026Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleavingcited by 0
- 2026When Synthetic Speech Is All You Have: Better Call GRPOcited by 0
- 2026Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAGcited by 0
- 2026Voice of Reason: Reinforcement Learning for Spoken Mathcited by 0
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoningcited by 0
- 2026ReCast: Contract-Preserving Protection for Fixed-Interface Multimodal Reasoningcited by 0
- 2026OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoningcited by 0
- 2026Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistantscited by 0
- 2026Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants5 Oct 2026
- 2026OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning1 Oct 2026
- 2026ReCast: Contract-Preserving Protection for Fixed-Interface Multimodal Reasoning1 Oct 2026
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning19 Sep 2026
- 2026Voice of Reason: Reinforcement Learning for Spoken Math16 Sep 2026
- 2026Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAG27 Aug 2026
- 2026When Synthetic Speech Is All You Have: Better Call GRPO9 Jul 2026
- 2026Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleaving2 Jul 2026
- 2026LaSR: Context-Aware Speech Recognition via Latent Reasoning30 May 2026
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs9 Apr 2026
- 2026GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Taskscited by 14
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluationcited by 2
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognitioncited by 1
- 2026AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approachcited by 1
- 2026agentic-ger: terminology recovery in long-form speech using global contextcited by 0
- 2026From Script to Drama: An Agentic Framework for Controllable Multi-Speaker Dialogue TTScited by 0
- 2026From Script to Drama: An Agentic Framework for Controllable Multi-Speaker Dialogue TTS27 Sep 2026
- 2026agentic-ger: terminology recovery in long-form speech using global context24 Sep 2026
- 2026AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approach30 Jul 2026
- 2026GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Tasks6 Jul 2026
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation28 May 2026
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognition10 Apr 2026
- 2026Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASRcited by 1
- 2026EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillationcited by 0
- 2026DASH: Dual-View Self-Distillation with Multi-Layer Hidden Representations for Robust Speech Recognitioncited by 0
- 2026On-Policy Self-Distillation for Multi-Dialect ASR: Mastering Dialects, Retaining Mandarincited by 0
- 2026On-Policy Self-Distillation for Multi-Dialect ASR: Mastering Dialects, Retaining Mandarin12 Aug 2026
- 2026Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASR4 Aug 2026
- 2026DASH: Dual-View Self-Distillation with Multi-Layer Hidden Representations for Robust Speech Recognition17 Jun 2026
- 2026EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillation11 May 2026
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026MOSS-Audio Technical Reportcited by 11
- 2026PASK: Toward Intent-Aware Proactive Agents with Long-Term Memorycited by 9
- 2026Raon-Speech Technical Reportcited by 7
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 6
- 2026Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulationcited by 5
- 2026Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarizationcited by 4
- 2026Audio Interaction Modelcited by 4
- 2026Whisper-CD: Accurate Long-Form Speech Recognition using Multi-Negative Contrastive Decodingcited by 3
- 2026ASPIRin: Action Space Projection for Interactivity-Optimized Reinforcement Learning in Full-Duplex Speech Language Modelscited by 3
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Predictioncited by 3
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 2
- 2026Exploring the potential and limitations of Model Merging for Multi-Domain Adaptation in ASRcited by 1
12 most cited of 86 All 86 (JSON)
- 2026SEA-HELM Audio: Evaluating Multilingual ASR-LLM Pipeline Performance Across SEA-HELM Subsets14 Oct 2026
- 2026ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Context12 Oct 2026
- 2026OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation9 Oct 2026
- 2026EgoVoice: Proactive Spoken Assistance from Egocentric Multimodal Streams8 Oct 2026
- 2026InterView-C: A Synchronized Multimodal Corpus of VR Avatar-Mediated Survey Interviews7 Oct 2026
- 2026HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR6 Oct 2026
- 2026Batched Speech Decisions Without Decoding: Single-Token Supervision Lets a Frozen LLM Hear Beyond the Transcript2 Oct 2026
- 2026From Speech to Editable Concepts: Probing Emotion Recognition with Concept Bottleneck Models30 Sep 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026SCIC: Scope- and Codebook-Aware Instruction Conditioning for Speaker-Adapted Expressive TTS30 Sep 2026
- 2026Benchmarking Automatic Speech Recognition Tools for Iberian Languages29 Sep 2026
- 2026In-Context Adaptation of Encoder-Decoder Models in Speech Recognition27 Sep 2026
12 newest of 86 All 86 (JSON)