mlsanityData to 7 Oct 2026

PERL: Pinyin Enhanced Rephrasing Language Model for Chinese ASR N-best Error Correction

arXiv 2412.03230 ↗First posted 4 Dec 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Chinese ASR correction is challenging because errors are often phonetic (many characters share similar Pinyin) while the correction model must also obey a length constraint under noisy N-best hypotheses. Existing approaches either exploit Pinyin only at the prompt/feature level without integrating it into model representations or rely on generative decoding that can drift in length. We propose PERL, a constrained rephrasing pipeline for Chinese N-best ASR correction that (i) predicts the target length and enforces it via mask budgeting, and (ii) fuses semantic and phonetic (Pinyin) representations through token-wise gates conditioned on sentence semantics. Experiments on Aishell-1 and our new domain N-best benchmark DoAD show that PERL consistently reduces CER (29.11% on Aishell-1 and up to ~70% on DoAD) while maintaining low latency. We also provide analyzes of length generalization and phonetic--semantic interactions, showing when PERL relies on phonetic cues versus semantic constraints.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

17 of 25 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  5. 2020Spelling Error Correction with Soft-Masked BERTcited by 90
  6. 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 53
  7. 2021Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checkingcited by 52
  8. 2023N-best T5: Robust ASR Error Correction using Multiple Input Hypotheses and Constrained Decoding Spacecited by 41
  9. 2022MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correctioncited by 33
  10. 2021FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognitioncited by 27
  11. 2022General and Domain Adaptive Chinese Spelling Check with Error Consistent Pretrainingcited by 25
  12. 2022Improving Chinese Spelling Check by Character Pronunciation Prediction: The Effects of Adaptivity and Granularitycited by 19
5 more
  1. 2023Chinese Spelling Correction as Rephrasing Language Modelcited by 15
  2. 2023Multi-stage Large Language Model Correction for Speech Recognitioncited by 13
  3. 2024C-LLM: Learn to Check Chinese Spelling Errors Character by Charactercited by 12
  4. 2022From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correctioncited by 7
  5. 2024Mitigating Catastrophic Forgetting in Multi-domain Chinese Spelling Correction by Multi-stage Knowledge Transfer Frameworkcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.