MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction
Not on the map. Why?
Abstract (arXiv)
This paper presents MuCGEC, a multi-reference multi-source evaluation dataset for Chinese Grammatical Error Correction (CGEC), consisting of 7,063 sentences collected from three Chinese-as-a-Second-Language (CSL) learner sources. Each sentence is corrected by three annotators, and their corrections are carefully reviewed by a senior annotator, resulting in 2.3 references per sentence. We conduct experiments with two mainstream CGEC models, i.e., the sequence-to-sequence model and the sequence-to-edit model, both enhanced with large pretrained language models, achieving competitive benchmark performance on previous and our datasets. We also discuss CGEC evaluation methodologies, including the effect of multiple references and using a char-based metric. Our annotation guidelines, data, and code are available at urlhttps://github.com/HillZhang1999/MuCGEC.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 24 of its 61 references that are in the map. First posted on arXiv 23 Apr 2022.
Builds on
24 of 61 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
- 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
- 2019StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understandingcited by 108
- 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
- 2019Encode, Tag, Realize: High-Precision Text Editingcited by 99
- 2017JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correctioncited by 96
12 more
- 2019Parallel Iterative Edit Models for Local Sequence Transductioncited by 81
- 2021CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generationcited by 81
- 2018Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Taskcited by 56
- 2020Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Modelcited by 33
- 2021UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Languagecited by 19
- 2021Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correctioncited by 19
- 2022Czech Grammar Error Correction with a Large and Diverse Corpuscited by 17
- 2020Grammatical Error Correction in Low Error Density Domains: A New Benchmark and Analysescited by 16
- 2018Inherent Biases in Reference based Evaluation for Grammatical Error Correction and Text Simplificationcited by 15
- 2021YACLC: A Chinese Learner Corpus with Multidimensional Annotationcited by 8
- 2020RethinkCWS: Is Chinese Word Segmentation a Solved Task?cited by 7
- 2019Cross-Corpora Evaluation and Analysis of Grammatical Error Correction Models --- Is Single-Corpus Evaluation Enough?cited by 6
Built on by
Citing papers per year: 2022: 9; 2023: 12; 2024: 6; 2025: 4; 2026: 2.
33 papers.
Sort:
By area:
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 111
- 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 53
- 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
- 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
- 2022Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correctioncited by 25
- 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
- 2022FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correctioncited by 13
- 2023Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correctioncited by 13
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applicationscited by 12
- 2024How Ready Are Generative Pre-trained Large Language Models for Explaining Bengali Grammatical Errors?cited by 11
- 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Textscited by 9
- 2024Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correctioncited by 9
21 more
- 2023Non-autoregressive Text Editing with Copy-aware Latent Alignmentscited by 8
- 2022From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correctioncited by 7
- 2023RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbationcited by 6
- 2023CLEME: Debiasing Multi-reference Evaluation for Grammatical Error Correctioncited by 5
- 2023Evaluating the Capability of Large-scale Language Models on Chinese Grammatical Error Correction Taskcited by 5
- 2023FlaCGEC: A Chinese Grammatical Error Correction Dataset with Fine-grained Linguistic Annotationcited by 5
- 2022CSynGEC: Incorporating Constituent-based Syntax for Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 4
- 2022Focus Is What You Need For Chinese Grammatical Error Correctioncited by 3
- 2023CSED: A Chinese Semantic Error Diagnosis Corpuscited by 3
- 2024Loss-Aware Curriculum Learning for Chinese Grammatical Error Correctioncited by 3
- 2025ChineseErrorCorrector3-4B: State-of-the-Art Chinese Spelling and Grammar Correctorcited by 2
- 2022Mining Error Templates for Grammatical Error Correctioncited by 1
- 2023Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?cited by 1
- 2024PERL: Pinyin Enhanced Rephrasing Language Model for Chinese ASR N-best Error Correctioncited by 1
- 2022Visual Subtitle Feature Enhanced Video Outline Generationcited by 0
- 2024An Analysis of Language Frequency and Error Correction for Esperantocited by 0
- 2025Leveraging Prompt-Tuning for Bengali Grammatical Error Explanation Using Large Language Modelscited by 0
- 2025COLA-GEC: A Bidirectional Framework for Enhancing Grammatical Acceptability and Error Correctioncited by 0
- 2025RE2: Improving Chinese Grammatical Error Correction via Retrieving Appropriate Examples with Explanationcited by 0
- 2026Data-driven Clustering and Merging of Adapters for On-device Large Language Modelscited by 0
- 2026A Layered Taxonomy for Chinese Learner Grammatical Error Annotationcited by 0
- 2026A Layered Taxonomy for Chinese Learner Grammatical Error Annotation2 Sep 2026
- 2026Data-driven Clustering and Merging of Adapters for On-device Large Language Models24 Jan 2026
- 2025ChineseErrorCorrector3-4B: State-of-the-Art Chinese Spelling and Grammar Corrector13 Nov 2025
- 2025RE2: Improving Chinese Grammatical Error Correction via Retrieving Appropriate Examples with Explanation30 Sep 2025
- 2025COLA-GEC: A Bidirectional Framework for Enhancing Grammatical Acceptability and Error Correction16 Jul 2025
- 2025Leveraging Prompt-Tuning for Bengali Grammatical Error Explanation Using Large Language Models8 Apr 2025
- 2024Loss-Aware Curriculum Learning for Chinese Grammatical Error Correction31 Dec 2024
- 2024PERL: Pinyin Enhanced Rephrasing Language Model for Chinese ASR N-best Error Correction4 Dec 2024
- 2024How Ready Are Generative Pre-trained Large Language Models for Explaining Bengali Grammatical Errors?27 May 2024
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications19 May 2024
- 2024Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction18 Feb 2024
- 2024An Analysis of Language Frequency and Error Correction for Esperanto15 Feb 2024
21 more
- 2023Non-autoregressive Text Editing with Copy-aware Latent Alignments11 Oct 2023
- 2023RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation11 Oct 2023
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Models28 Sep 2023
- 2023FlaCGEC: A Chinese Grammatical Error Correction Dataset with Fine-grained Linguistic Annotation26 Sep 2023
- 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuning26 Jul 2023
- 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correction18 Jul 2023
- 2023Evaluating the Capability of Large-scale Language Models on Chinese Grammatical Error Correction Task8 Jul 2023
- 2023Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correction30 Jun 2023
- 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Texts25 May 2023
- 2023Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?24 May 2023
- 2023CLEME: Debiasing Multi-reference Evaluation for Grammatical Error Correction18 May 2023
- 2023CSED: A Chinese Semantic Error Diagnosis Corpus9 May 2023
- 2022CSynGEC: Incorporating Constituent-based Syntax for Grammatical Error Correction with a Tailored GEC-Oriented Parser15 Nov 2022
- 2022Grammatical Error Correction: A Survey of the State of the Art9 Nov 2022
- 2022From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correction3 Nov 2022
- 2022Focus Is What You Need For Chinese Grammatical Error Correction23 Oct 2022
- 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parser22 Oct 2022
- 2022FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction22 Oct 2022
- 2022Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correction19 Oct 2022
- 2022Visual Subtitle Feature Enhanced Video Outline Generation24 Aug 2022
- 2022Mining Error Templates for Grammatical Error Correction23 Jun 2022
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 111
- 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 53
- 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
- 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
- 2022Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correctioncited by 25
- 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
- 2022FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correctioncited by 13
- 2023Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correctioncited by 13
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applicationscited by 12
- 2024How Ready Are Generative Pre-trained Large Language Models for Explaining Bengali Grammatical Errors?cited by 11
- 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Textscited by 9
- 2023Non-autoregressive Text Editing with Copy-aware Latent Alignmentscited by 8
12 most cited of 32 All 32 (JSON)
- 2026A Layered Taxonomy for Chinese Learner Grammatical Error Annotation2 Sep 2026
- 2026Data-driven Clustering and Merging of Adapters for On-device Large Language Models24 Jan 2026
- 2025ChineseErrorCorrector3-4B: State-of-the-Art Chinese Spelling and Grammar Corrector13 Nov 2025
- 2025RE2: Improving Chinese Grammatical Error Correction via Retrieving Appropriate Examples with Explanation30 Sep 2025
- 2025COLA-GEC: A Bidirectional Framework for Enhancing Grammatical Acceptability and Error Correction16 Jul 2025
- 2025Leveraging Prompt-Tuning for Bengali Grammatical Error Explanation Using Large Language Models8 Apr 2025
- 2024Loss-Aware Curriculum Learning for Chinese Grammatical Error Correction31 Dec 2024
- 2024PERL: Pinyin Enhanced Rephrasing Language Model for Chinese ASR N-best Error Correction4 Dec 2024
- 2024How Ready Are Generative Pre-trained Large Language Models for Explaining Bengali Grammatical Errors?27 May 2024
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications19 May 2024
- 2024An Analysis of Language Frequency and Error Correction for Esperanto15 Feb 2024
- 2023Non-autoregressive Text Editing with Copy-aware Latent Alignments11 Oct 2023
12 newest of 32 All 32 (JSON)