mlsanityData to 7 Oct 2026

Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction

arXiv 2402.11420 ↗First posted 18 Feb 2024cs.CLcited by 9

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to correct all potential grammatical errors in the input sentences. Previous studies have shown that LLMs' performance as correctors on CGEC remains unsatisfactory due to its challenging task focus. To promote the CGEC field to better adapt to the era of LLMs, we rethink the roles of LLMs in the CGEC task so that they can be better utilized and explored in CGEC. Considering the rich grammatical knowledge stored in LLMs and their powerful semantic understanding capabilities, we utilize LLMs as explainers to provide explanation information for the CGEC small models during error correction to enhance performance. We also use LLMs as evaluators to bring more reasonable CGEC evaluations, thus alleviating the troubles caused by the subjectivity of the CGEC task. In particular, our work is also an active exploration of how LLMs and small models better collaborate in downstream tasks. Extensive experiments and detailed analyses on widely used datasets verify the effectiveness of our thinking intuition and the proposed methods.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 38 of its 55 references that are in the map. First posted on arXiv 18 Feb 2024.

Builds on

38 of 55 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzles21 Aug

Other references · 37

  1. 2023Qwen Technical Reportcited by 3,273
  2. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  3. 2023BloombergGPT: A Large Language Model for Financecited by 923
  4. 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
  5. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 161
  6. 2023A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilitycited by 118
  7. 2019StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understandingcited by 108
  8. 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
  9. 2021CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generationcited by 81
  10. 2021Are we ready for a new paradigm shift? A Survey on Visual Deep MLPcited by 63
  11. 2022The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checkingcited by 56
  12. 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 53
25 more
  1. 2023Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Taskscited by 53
  2. 2023EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commercecited by 48
  3. 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
  4. 2020Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Modelcited by 33
  5. 2022MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correctioncited by 33
  6. 2023Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistancecited by 33
  7. 2022Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checkingcited by 31
  8. 2022Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correctioncited by 25
  9. 2024Prompting open-source and commercial language models for grammatical error correction of English learner textcited by 24
  10. 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
  11. 2024When LLMs Meet Cunning Texts: A Fallacy Understanding Benchmark for Large Language Modelscited by 22
  12. 2023Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characterscited by 21
  13. 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
  14. 2023A Frustratingly Easy Plug-and-Play Detection-and-Reasoning Module for Chinese Spelling Checkcited by 15
  15. 2023GEE! Grammar Error Explanation with Large Language Modelscited by 15
  16. 2022Contextual Similarity is More Valuable than Character Similarity: An Empirical Study for Chinese Spell Checkingcited by 14
  17. 2023Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correctioncited by 13
  18. 2023Beyond English: Evaluating LLMs for Arabic Grammatical Error Correctioncited by 12
  19. 2023Controlled Generation with Prompt Insertion for Natural Language Explanations in Grammatical Error Correctioncited by 7
  20. 2023Reducing Sequence Length by Predicting Edit Operations with Large Language Modelscited by 5
  21. 2023Evaluating GPT-3.5 and GPT-4 on Grammatical Error Correction for Brazilian Portuguesecited by 5
  22. 2023Evaluating the Capability of Large-scale Language Models on Chinese Grammatical Error Correction Taskcited by 5
  23. 2022Focus Is What You Need For Chinese Grammatical Error Correctioncited by 3
  24. 2023Evaluation of really good grammatical error correctioncited by 2
  25. 2023MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correctioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 3.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Alirector: Alignment-Enhanced Chinese Grammatical Error Corrector
  2. 2023CMMLU: Measuring massive multitask language understanding in Chinese
  3. 2024Leveraging LLMs for Bangla Grammar Error Correction:Error Categorization, Synthetic Data, and Model Evaluation
  4. 2025CEC-Zero: Chinese Error Correction Solution Based on LLM
  5. 2025CPG-EVAL: A Multi-Tiered Benchmark for Evaluating the Chinese Pedagogical Grammar Competence of Large Language Models
  6. 2023AlignBench: Benchmarking Chinese Alignment of Large Language Models
  7. 2023An Empirical Study of Instruction-tuning Large Language Models in Chinese
  8. 2024OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety