mlsanityData to 14 Oct 2026

FormalASR: End-to-End Spoken Chinese to Formal Text

arXiv 2605.19266 ↗First posted 19 May 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Automatic speech recognition (ASR) systems are typically optimized for verbatim transcription, which preserves disfluencies, filler words, and informal spoken structures that are often unsuitable for downstream writing-oriented applications. A common workaround is a two-stage ASR+LLM pipeline for post-editing, but this design increases latency and memory cost and is difficult to deploy on-device. We present FormalASR, two compact end-to-end models (0.6B and 1.7B) that directly transcribe spoken Chinese into formal written text. To enable this setting, we build WenetSpeech-Formal and Speechio-Formal, two large-scale spoken-to-formal datasets constructed by LLM-based rewriting and quality filtering. We then fine-tune Qwen3-ASR at two scales (0.6B and 1.7B) with supervised fine-tuning. Experiments on WenetSpeech-Formal and Speechio-Formal show that FormalASR achieves up to 37.4% relative CER reduction over verbatim baselines, while also improving ROUGE-L and BERTScore. FormalASR requires no post-processing LLM at deployment time, providing a lightweight, on-device solution for spoken-to-formal transcription.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

11 of 21 references.

References · 11

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
  4. 2015Listen, Attend and Spellcited by 543
  5. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
  6. 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 122
  7. 2026Qwen3-ASR Technical Reportcited by 118
  8. 2023HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Modelscited by 42
  9. 2016Disfluency Detection using a Bidirectional LSTMcited by 31
  10. 2016RNN Approaches to Text Normalization: A Challengecited by 30
  11. 2020Improving Disfluency Detection by Self-Training a Self-Attentive Modelcited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.