mlsanityData to 14 Oct 2026

Corpora Generation for Grammatical Error Correction

arXiv 1904.05780 ↗First posted 10 Apr 2019cs.CL stat.MLcited by 53

Not on the map. Why?

Abstract (arXiv)

Grammatical Error Correction (GEC) has been recently modeled using the sequence-to-sequence framework. However, unlike sequence transduction problems such as machine translation, GEC suffers from the lack of plentiful parallel data. We describe two approaches for generating large parallel datasets for GEC using publicly available Wikipedia data. The first method extracts source-target pairs from Wikipedia edit histories with minimal filtration heuristics, while the second method introduces noise into Wikipedia sentences via round-trip translation through bridge languages. Both strategies yield similar sized parallel corpora containing around 4B tokens. We employ an iterative decoding strategy that is tailored to the loosely supervised nature of our constructed corpora. We demonstrate that neural GEC models trained using either type of corpora give similar performance. Fine-tuning these models on the Lang-8 corpus and ensembling allows us to surpass the state of the art on both the CoNLL-2014 benchmark and the JFLEG task. We provide systematic analysis that compares the two approaches to data generation and highlights the effectiveness of ensembling.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 18; 2022: 13; 2023: 10; 2024: 8; 2025: 1; 2026: 3.

53 papers.

Sort:

By area:

  1. 2021A Survey of Data Augmentation Approaches for NLPcited by 409
  2. 2022Generating Sequences by Learning to Self-Correctcited by 277
  3. 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 240
  4. 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
  5. 2023RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputscited by 105
  6. 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
  7. 2021Instantaneous Grammatical Error Correction with Shallow Aggressive Decodingcited by 53
  8. 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
  9. 2021Generate, Annotate, and Learn: NLP with Synthetic Textcited by 42
  10. 2023Exploring Effectiveness of GPT-3 in Grammatical Error Correction: A Study on Performance and Controllability in Prompt-Based Methodscited by 37
  11. 2021LM-Critic: Language Models for Unsupervised Grammatical Error Correctioncited by 33
  12. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
38 more
  1. 2021Quiz-Style Question Generation for News Storiescited by 23
  2. 2022Czech Grammar Error Correction with a Large and Diverse Corpuscited by 17
  3. 2022A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Modelcited by 16
  4. 2021Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systemscited by 15
  5. 2021On Robustness of Neural Semantic Parserscited by 14
  6. 2023Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Modelcited by 14
  7. 2022Towards standardizing Korean Grammatical Error Correction: Datasets and Annotationcited by 13
  8. 2022Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correctioncited by 12
  9. 2021Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correctioncited by 11
  10. 2025Out of Style: RAG's Fragility to Linguistic Variationcited by 11
  11. 2021Comparison of Grammatical Error Correction Using Back-Translation Modelscited by 9
  12. 2022Type-Driven Multi-Turn Corrections for Grammatical Error Correctioncited by 9
  13. 2021Empirical Error Modeling Improves Robustness of Noisy Neural Sequence Labelingcited by 8
  14. 2023To Revise or Not to Revise: Learning to Detect Improvable Claims for Argumentative Writing Supportcited by 8
  15. 2022From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correctioncited by 7
  16. 2023Byte-Level Grammatical Error Correction Using Synthetic and Curated Corporacited by 7
  17. 2021Grammatical Error Correction as GAN-like Sequence Labelingcited by 6
  18. 2024Improving Grammatical Error Correction via Contextual Data Augmentationcited by 6
  19. 2021A Syntax-Guided Grammatical Error Correction Model with Dependency Tree Correctioncited by 4
  20. 2021Diversity-Driven Combination for Grammatical Error Correctioncited by 3
  21. 2022Capitalization Normalization for Language Modeling with an Accurate and Efficient Hierarchical RNN Modelcited by 3
  22. 2022Claim Optimization in Computational Argumentationcited by 3
  23. 2023Cleansing Jewel: A Neural Spelling Correction Model Built On Google OCR-ed Tibetan Manuscriptscited by 3
  24. 2023Lost In Translation: Generating Adversarial Examples Robust to Round-Trip Translationcited by 2
  25. 2023MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correctioncited by 2
  26. 2023Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmentingcited by 2
  27. 2024Grammatical Error Correction for Code-Switched Sentences by Learners of Englishcited by 2
  28. 2024ChatLang-8: An LLM-Based Synthetic Data Generation Framework for Grammatical Error Correctioncited by 2
  29. 2026Neural Grammatical Error Correction for Romaniancited by 2
  30. 2021Few-Shot Domain Adaptation for Grammatical Error Correction via Meta-Learningcited by 1
  31. 2021An Alignment-Agnostic Model for Chinese Text Error Correctioncited by 1
  32. 2021Position-Invariant Truecasing with a Word-and-Character Hierarchical Recurrent Neural Networkcited by 1
  33. 2022Considerations for Multilingual Wikipedia Researchcited by 1
  34. 2022Conciseness: An Overlooked Language Taskcited by 1
  35. 2024Organic Data-Driven Approach for Turkish Grammatical Error Correction and LLMscited by 1
  36. 2023Improving Audio Caption Fluency with Automatic Error Correctioncited by 0
  37. 2024Leveraging LLMs for Bangla Grammar Error Correction:Error Categorization, Synthetic Data, and Model Evaluationcited by 0
  38. 2024Zero-shot Cross-Lingual Transfer for Synthetic Data Generation in Grammatical Error Detectioncited by 0

50 most cited of 53 All 53 (JSON)