mlsanityData to 14 Oct 2026

CSRP: Chain-of-Thought Reasoning for Chinese Text Correction via Reinforcement Learning with Efficiency-Aware Rewards

arXiv 2606.00020 ↗First posted 14 Apr 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large Language Model (LLM) based Chinese Grammatical Error Correction (CGEC) systems face two critical challenges: general-purpose models lack specialized linguistic priors for subtle grammatical distinctions, and Supervised Fine-Tuning (SFT) with Maximum Likelihood Estimation fails to optimize for precision-focused metrics, leading to systematic over-correction. We propose CSRP, a three-stage framework that progressively builds correction capability through Continual Pre-training (CPT) on 5.9M balanced samples to internalize domain knowledge, Chain-of-Thought SFT with explicit error reasoning for diagnostic transparency, and Group Relative Policy Optimization with a novel Efficiency-Aware Reward that explicitly penalizes unnecessary edits. On the NACGEC benchmark, CSRP achieves state-of-the-art performance with 50.99 F0.5 and 57.17 precision, substantially outperforming previous best results while effectively mitigating the over-correction bias inherent in MLE-trained models. Our method also advances CSCD spelling correction to 59.61 F1, surpassing GPT-4 by 5.20 points. Comprehensive ablation studies demonstrate that the RL alignment stage contributes a 8% relative gain over the SFT baseline, and that this gain is orthogonal to the contribution of large-scale CPT, validating that explicit optimization for edit efficiency is essential for high-quality grammatical error correction. Our code is available at https://github.com/TW-NLP/ChineseErrorCorrector.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 12 of its 25 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

12 of 25 references.

References · 12

  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  2. 2020Spelling Error Correction with Soft-Masked BERTcited by 90
  3. 2021Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checkingcited by 52
  4. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
  5. 2023ChatHome: Development and Evaluation of a Domain-Specific Language Model for Home Renovationcited by 25
  6. 2023Chinese Spelling Correction as Rephrasing Language Modelcited by 15
  7. 2023Disentangled Phonetic Representation for Chinese Spelling Correctioncited by 14
  8. 2024C-LLM: Learn to Check Chinese Spelling Errors Character by Charactercited by 12
  9. 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Textscited by 9
  10. 2025Mixture of Small and Large Models for Chinese Spelling Checkcited by 5
  11. 2025A Training-free LLM-based Approach to General Chinese Character Error Correctioncited by 4
  12. 2025ChineseErrorCorrector3-4B: State-of-the-Art Chinese Spelling and Grammar Correctorcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VAA-CSEC: Vote-guided Advantage Allocation for Chinese Semantic Error Correction
  2. 2025CEC-Zero: Zero-Supervision Character Error Correction with Self-Generated Rewards
  3. 2025CEC-Zero: Chinese Error Correction Solution Based on LLM
  4. 2025Harnessing Rule-Based Reinforcement Learning for Enhanced Grammatical Error Correction
  5. 2025RAIR: Retrieval-Augmented Iterative Refinement for Chinese Spelling Correction
  6. 2025Chinese Spelling Correction: A Comprehensive Survey of Progress, Challenges, and Opportunities
  7. 2026CLFEC: A New Task for Unified Linguistic and Factual Error Correction in paragraph-level Chinese Professional Writing
  8. 2024Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction