FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition System
Not on the map. Why?
Abstract (arXiv)
We present FireRedASR2S, a state-of-the-art industrial-grade all-in-one automatic speech recognition (ASR) system. It integrates four modules in a unified pipeline: ASR, Voice Activity Detection (VAD), Spoken Language Identification (LID), and Punctuation Prediction (Punc). All modules achieve SOTA performance on the evaluated benchmarks: FireRedASR2: An ASR module with two variants, FireRedASR2-LLM (8B+ parameters) and FireRedASR2-AED (1B+ parameters), supporting speech and singing transcription for Mandarin, Chinese dialects and accents, English, and code-switching. Compared to FireRedASR, FireRedASR2 delivers improved recognition accuracy and broader dialect and accent coverage. FireRedASR2-LLM achieves 2.89% average CER on 4 public Mandarin benchmarks and 11.55% on 19 public Chinese dialects and accents benchmarks, outperforming competitive baselines including Doubao-ASR, Qwen3-ASR, and Fun-ASR. FireRedVAD: An ultra-lightweight module (0.6M parameters) based on the Deep Feedforward Sequential Memory Network (DFSMN), supporting streaming VAD, non-streaming VAD, and multi-label VAD (mVAD). On the FLEURS-VAD-102 benchmark, it achieves 97.57% frame-level F1 and 99.60% AUC-ROC, outperforming Silero-VAD, TEN-VAD, FunASR-VAD, and WebRTC-VAD. FireRedLID: An Encoder-Decoder LID module supporting 100+ languages and 20+ Chinese dialects and accents. On FLEURS (82 languages), it achieves 97.18% utterance-level accuracy, outperforming Whisper and SpeechBrain. FireRedPunc: A BERT-style punctuation prediction module for Chinese and English. On multi-domain benchmarks, it achieves 78.90% average F1, outperforming FunASR-Punc (62.77%). To advance research in speech processing, we release model weights and code at https://github.com/FireRedTeam/FireRedASR2S.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 16.
16 papers.
Sort:
By area:
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generationcited by 10
- 2026Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulationcited by 5
- 2026Multimodal Duplex Interaction Agentcited by 3
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASRcited by 1
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Mattercited by 1
- 2026Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASRcited by 1
- 2026StepAudio 3 Music Technical Reportcited by 1
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialectscited by 0
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognitioncited by 0
- 2026HearInContext: A Benchmark for Implicit Context in Speech Recognitioncited by 0
- 2026Alignment-Path Distillation from Non-streaming ASR-LLMs for Streaming Speech Recognitioncited by 0
4 more
- 2026A Native-Reference Phone-Class Geometry for Second-Language Pronunciation Analysiscited by 0
- 2026AVIO: Learning to Add and Remove Sounding Objects in Audiovisual Scenescited by 0
- 2026ASSET: Adaptive Speech Segmentation via Reinforcement Learningcited by 0
- 2026ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Contextcited by 0
- 2026ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Context12 Oct 2026
- 2026ASSET: Adaptive Speech Segmentation via Reinforcement Learning9 Oct 2026
- 2026AVIO: Learning to Add and Remove Sounding Objects in Audiovisual Scenes29 Sep 2026
- 2026A Native-Reference Phone-Class Geometry for Second-Language Pronunciation Analysis24 Sep 2026
- 2026Alignment-Path Distillation from Non-streaming ASR-LLMs for Streaming Speech Recognition17 Sep 2026
- 2026HearInContext: A Benchmark for Implicit Context in Speech Recognition16 Sep 2026
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026Multimodal Duplex Interaction Agent8 Sep 2026
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialects8 Aug 2026
- 2026Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASR4 Aug 2026
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition6 Jul 2026
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
4 more
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generation19 May 2026
- 2026Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation19 May 2026
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Matter9 May 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
- 2026StepAudio 3 Music Technical Reportcited by 1
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generationcited by 10
- 2026Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulationcited by 5
- 2026Multimodal Duplex Interaction Agentcited by 3
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASRcited by 1
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Mattercited by 1
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialectscited by 0
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognitioncited by 0
- 2026HearInContext: A Benchmark for Implicit Context in Speech Recognitioncited by 0
- 2026A Native-Reference Phone-Class Geometry for Second-Language Pronunciation Analysiscited by 0
- 2026AVIO: Learning to Add and Remove Sounding Objects in Audiovisual Scenescited by 0
- 2026ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Contextcited by 0
- 2026ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Context12 Oct 2026
- 2026AVIO: Learning to Add and Remove Sounding Objects in Audiovisual Scenes29 Sep 2026
- 2026A Native-Reference Phone-Class Geometry for Second-Language Pronunciation Analysis24 Sep 2026
- 2026HearInContext: A Benchmark for Implicit Context in Speech Recognition16 Sep 2026
- 2026Multimodal Duplex Interaction Agent8 Sep 2026
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialects8 Aug 2026
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition6 Jul 2026
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generation19 May 2026
- 2026Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation19 May 2026
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Matter9 May 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026