mlsanityData to 14 Oct 2026

CL2GEC: A Multi-Discipline Benchmark for Continual Learning in Chinese Literature Grammatical Error Correction

arXiv 2509.13672 ↗First posted 17 Sep 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The growing demand for automated writing assistance in diverse academic domains highlights the need for robust Chinese Grammatical Error Correction (CGEC) systems that can adapt across disciplines. However, existing CGEC research largely lacks dedicated benchmarks for multi-disciplinary academic writing, overlooking continual learning (CL) as a promising solution to handle domain-specific linguistic variation and prevent catastrophic forgetting. To fill this crucial gap, we introduce CL2GEC, the first Continual Learning benchmark for Chinese Literature Grammatical Error Correction, designed to evaluate adaptive CGEC across multiple academic fields. Our benchmark includes 10,000 human-annotated sentences spanning 10 disciplines, each exhibiting distinct linguistic styles and error patterns. CL2GEC focuses on evaluating grammatical error correction in a continual learning setting, simulating sequential exposure to diverse academic disciplines to reflect real-world editorial dynamics. We evaluate large language models under sequential tuning, parameter-efficient adaptation, and four representative CL algorithms, using both standard GEC metrics and continual learning metrics adapted to task-level variation. Experimental results reveal that regularization-based methods mitigate forgetting more effectively than replay-based or naive sequential approaches. Our benchmark provides a rigorous foundation for future research in adaptive grammatical error correction across diverse academic domains.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 57 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

36 of 57 references.

References · 36

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  5. 2019Orthogonal Gradient Descent for Continual Learningcited by 369
  6. 2017Incremental Learning of Object Detectors without Catastrophic Forgettingcited by 208
  7. 2023Progressive Prompts: Continual Learning for Language Modelscited by 197
  8. 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
  9. 2024Continual Learning for Large Language Models: A Surveycited by 147
  10. 2024Revisiting Catastrophic Forgetting in Large Language Model Tuningcited by 99
  11. 2021CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generationcited by 81
  12. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
24 more
  1. 2024Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agentcited by 65
  2. 2021Are we ready for a new paradigm shift? A Survey on Visual Deep MLPcited by 63
  3. 2020Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correctioncited by 59
  4. 2022The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checkingcited by 56
  5. 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 54
  6. 2023LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzlescited by 41
  7. 2022Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checkingcited by 31
  8. 2024ChatCite: LLM Agent with Human Workflow Guidance for Comparative Literature Summarycited by 30
  9. 2020N-LTP: An Open-source Neural Language Technology Platform for Chinesecited by 29
  10. 2022Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correctioncited by 25
  11. 2023Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characterscited by 22
  12. 2024Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmarkcited by 22
  13. 2025DAST: Context-Aware Compression in LLMs via Dynamic Allocation of Soft Tokenscited by 22
  14. 2022Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translationcited by 18
  15. 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
  16. 2025Refine Knowledge of Large Language Models via Adaptive Contrastive Learningcited by 15
  17. 2025One Example Shown, Many Concepts Known! Counterexample-Driven Conceptual Reasoning in Mathematical LLMscited by 14
  18. 2022FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correctioncited by 13
  19. 2023Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correctioncited by 13
  20. 2023Beyond Black Box AI-Generated Plagiarism Detection: From Sentence to Document Levelcited by 10
  21. 2024Mitigating Catastrophic Forgetting in Multi-domain Chinese Spelling Correction by Multi-stage Knowledge Transfer Frameworkcited by 4
  22. 2024Loss-Aware Curriculum Learning for Chinese Grammatical Error Correctioncited by 3
  23. 2025Chinese Grammatical Error Correction: A Surveycited by 3
  24. 2025MDIT: A Model-free Data Interpolation Method for Diverse Instruction Tuningcited by 3

Built on by

Not cited yet.