mlsanityData to 7 Oct 2026

Pillars of Grammatical Error Correction: Comprehensive Inspection Of Contemporary Approaches In The Era of Large Language Models

arXiv 2404.14914 ↗First posted 23 Apr 2024cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

In this paper, we carry out experimental research on Grammatical Error Correction, delving into the nuances of single-model systems, comparing the efficiency of ensembling and ranking methods, and exploring the application of large language models to GEC as single-model systems, as parts of ensembles, and as ranking methods. We set new state-of-the-art performance with F_0.5 scores of 72.8 on CoNLL-2014-test and 81.4 on BEA-test, respectively. To support further advancements in GEC and ensure the reproducibility of our research, we make our code, trained models, and systems' outputs publicly available.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 23 Apr 2024.

Builds on

15 of 32 references.

References · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2013One Billion Word Benchmark for Measuring Progress in Statistical Language Modelingcited by 302
  5. 2022UL2: Unifying Language Learning Paradigmscited by 292
  6. 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
  7. 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
  8. 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
  9. 2023ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmarkcited by 77
  10. 2020Seq2Edits: Sequence Transduction Using Span-level Edit Operationscited by 58
  11. 2019An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correctioncited by 55
  12. 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methodscited by 42
3 more
  1. 2023Exploring Effectiveness of GPT-3 in Grammatical Error Correction: A Study on Performance and Controllability in Prompt-Based Methodscited by 37
  2. 2023Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistancecited by 33
  3. 2023Non-autoregressive Text Editing with Copy-aware Latent Alignmentscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 3.

8 papers.