mlsanityData to 7 Oct 2026

Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Model

arXiv 2005.11849 ↗First posted 24 May 2020cs.CLcited by 33

Not on the map. Why?

Abstract (arXiv)

Studies on grammatical error correction (GEC) have reported the effectiveness of pretraining a Seq2Seq model with a large amount of pseudodata. However, this approach requires time-consuming pretraining for GEC because of the size of the pseudodata. In this study, we explore the utility of bidirectional and auto-regressive transformers (BART) as a generic pretrained encoder-decoder model for GEC. With the use of this generic pretrained model for GEC, the time-consuming pretraining can be eliminated. We find that monolingual and multilingual BART models achieve high performance in GEC, with one of the results being comparable to the current strong results in English GEC. Our implementations are publicly available at GitHub (https://github.com/Katsumata420/generic-pretrained-GEC).

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 7; 2023: 13; 2024: 2; 2025: 7; 2026: 2.

33 papers.

Sort:

By area:

  1. 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
  2. 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
  3. 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
  4. 2022MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correctioncited by 33
  5. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
  6. 2023On the application of Large Language Models for language teaching and assessment technologycited by 26
  7. 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
  8. 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigationcited by 22
  9. 2021UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Languagecited by 19
  10. 2022Revisiting Grammatical Error Correction Evaluation and Beyondcited by 18
  11. 2022A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Modelcited by 16
  12. 2022Towards standardizing Korean Grammatical Error Correction: Datasets and Annotationcited by 13
21 more
  1. 2024Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correctioncited by 9
  2. 2025Enhancing Text Editing for Grammatical Error Correction: Arabic as a Case Studycited by 9
  3. 2025gec-metrics: A Unified Library for Grammatical Error Correction Evaluationcited by 9
  4. 2023Non-autoregressive Text Editing with Copy-aware Latent Alignmentscited by 8
  5. 2023Improving Seq2Seq Grammatical Error Correction via Decoding Interventionscited by 8
  6. 2022From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correctioncited by 7
  7. 2025Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human?cited by 7
  8. 2023RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbationcited by 6
  9. 2025Opportunities and Challenges of LLMs in Education: An NLP Perspectivecited by 6
  10. 2023Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedulecited by 5
  11. 2023GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decodingcited by 3
  12. 2023MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correctioncited by 2
  13. 2023Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmentingcited by 2
  14. 2023System Combination via Quality Estimation for Grammatical Error Correctioncited by 2
  15. 2025Leveraging What's Overfixed: Post-Correction via LLM Grammatical Error Overcorrectioncited by 2
  16. 2024Detection-Correction Structure via General Language Model for Grammatical Error Correctioncited by 1
  17. 2025Explanation based In-Context Demonstrations Retrieval for Multilingual Grammatical Error Correctioncited by 1
  18. 2023Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correctioncited by 0
  19. 2025Refining Czech GEC: Insights from a Multi-Experiment Approachcited by 0
  20. 2026Encode Errors: Representational Retrieval of In-Context Demonstrations for Multilingual Grammatical Error Correctioncited by 0
  21. 2026STAGEET: Stage-wise Typed Edit Tagging for Grammatical Error Correction with Arabic as a Case Studycited by 0