Fun-ASR Technical Report
Not on the map. Why?
Abstract (arXiv)
In recent years, automatic speech recognition (ASR) has witnessed transformative advancements driven by three complementary paradigms: data scaling, model size scaling, and deep integration with large language models (LLMs). However, LLMs are prone to hallucination, which can significantly degrade user experience in real-world ASR applications. In this paper, we present Fun-ASR, a large-scale, LLM-based ASR system that synergistically combines massive data, large model capacity, LLM integration, and reinforcement learning to achieve state-of-the-art performance across diverse and complex speech recognition scenarios. Moreover, Fun-ASR is specifically optimized for practical deployment, with enhancements in streaming capability, noise robustness, code-switching, hotword customization, and satisfying other real-world application requirements. Experimental results show that while most LLM-based ASR systems achieve strong performance on open-source benchmarks, they often underperform on real industry evaluation sets. Thanks to production-oriented optimizations, Fun-ASR achieves state-of-the-art performance on real application datasets, demonstrating its effectiveness and robustness in practical settings. The code and models are accessible at https://github.com/FunAudioLLM/Fun-ASR .
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
14 of 22 references.
References · 14
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
- 2022Self-supervised Learning with Random-projection Quantizer for Speech Recognitioncited by 162
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 150
- 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 128
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 122
- 2024Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognitioncited by 63
- 2025FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM Integrationcited by 46
- 2025Dolphin: A Large-Scale Automatic Speech Recognition Model for Eastern Languagescited by 8
Built on by
Citing papers per year: 2025: 1; 2026: 18.
19 papers.
Sort:
By area:
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 6
- 2026OmniRAG-Agent: Agentic Omnimodal Reasoning for Low-Resource Long Audio-Video Question Answeringcited by 5
- 2025Explore the Reinforcement Learning for the LLM based ASR and TTS systemcited by 3
- 2026Multimodal Duplex Interaction Agentcited by 3
- 2026Qwen-Audio-3.0-ASR Technical Reportcited by 2
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognitioncited by 1
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMscited by 1
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognitioncited by 1
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASRcited by 1
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singingcited by 1
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Mattercited by 1
- 2026Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASRcited by 1
7 more
- 2026EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillationcited by 0
- 2026Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleavingcited by 0
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialectscited by 0
- 2026Whisper-Aware LLM: Self-Supervised Uncertainty Learning for Robust Whispered Speech Recognitioncited by 0
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognitioncited by 0
- 2026agentic-ger: terminology recovery in long-form speech using global contextcited by 0
- 2026UniAE-MoE: A Unified Audio Encoder via Mixture of Expertscited by 0
- 2026UniAE-MoE: A Unified Audio Encoder via Mixture of Experts30 Sep 2026
- 2026agentic-ger: terminology recovery in long-form speech using global context24 Sep 2026
- 2026Multimodal Duplex Interaction Agent8 Sep 2026
- 2026Qwen-Audio-3.0-ASR Technical Report7 Sep 2026
- 2026Whisper-Aware LLM: Self-Supervised Uncertainty Learning for Robust Whispered Speech Recognition11 Aug 2026
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialects8 Aug 2026
- 2026Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASR4 Aug 2026
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition6 Jul 2026
- 2026Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleaving2 Jul 2026
- 2026EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillation11 May 2026
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Matter9 May 2026
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singing7 May 2026
7 more
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognition10 Apr 2026
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs9 Apr 2026
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognition18 Mar 2026
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognition11 Mar 2026
- 2026OmniRAG-Agent: Agentic Omnimodal Reasoning for Low-Resource Long Audio-Video Question Answering3 Feb 2026
- 2025Explore the Reinforcement Learning for the LLM based ASR and TTS system23 Sep 2025
- 2026OmniRAG-Agent: Agentic Omnimodal Reasoning for Low-Resource Long Audio-Video Question Answeringcited by 5
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognitioncited by 1
- 2026agentic-ger: terminology recovery in long-form speech using global contextcited by 0
- 2026agentic-ger: terminology recovery in long-form speech using global context24 Sep 2026
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognition10 Apr 2026
- 2026OmniRAG-Agent: Agentic Omnimodal Reasoning for Low-Resource Long Audio-Video Question Answering3 Feb 2026
- 2026Qwen-Audio-3.0-ASR Technical Reportcited by 2
- 2026UniAE-MoE: A Unified Audio Encoder via Mixture of Expertscited by 0
- 2026UniAE-MoE: A Unified Audio Encoder via Mixture of Experts30 Sep 2026
- 2026Qwen-Audio-3.0-ASR Technical Report7 Sep 2026
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 6
- 2025Explore the Reinforcement Learning for the LLM based ASR and TTS systemcited by 3
- 2026Multimodal Duplex Interaction Agentcited by 3
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognitioncited by 1
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASRcited by 1
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singingcited by 1
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Mattercited by 1
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialectscited by 0
- 2026Whisper-Aware LLM: Self-Supervised Uncertainty Learning for Robust Whispered Speech Recognitioncited by 0
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognitioncited by 0
- 2026Multimodal Duplex Interaction Agent8 Sep 2026
- 2026Whisper-Aware LLM: Self-Supervised Uncertainty Learning for Robust Whispered Speech Recognition11 Aug 2026
- 2026DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialects8 Aug 2026
- 2026Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition6 Jul 2026
- 2026Dolphin-CN-Dialect: Where Chinese Dialects Matter9 May 2026
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singing7 May 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognition18 Mar 2026
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognition11 Mar 2026
- 2025Explore the Reinforcement Learning for the LLM based ASR and TTS system23 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling
- 2025Edge-ASR: Towards Low-Bit Quantization of Automatic Speech Recognition Models
- 2026dLLM-ASR: A Faster Diffusion LLM-based Framework for Speech Recognition
- 2024Anatomy of Industrial Scale Multilingual ASR
- 2026Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding ↗
- 2025Samba-ASR: State-Of-The-Art Speech Recognition Leveraging Structured State-Space Models
- 2024Automatic Speech Recognition using Advanced Deep Learning Approaches: A survey
- 2026Data-Efficient On-Policy Distillation for Automatic Speech Recognition