mlsanityData to 7 Oct 2026

JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correction

arXiv 1702.04066 ↗First posted 14 Feb 2017cs.CLcited by 96

Not on the map. Why?

Abstract (arXiv)

We present a new parallel corpus, JHU FLuency-Extended GUG corpus (JFLEG) for developing and evaluating grammatical error correction (GEC). Unlike other corpora, it represents a broad range of language proficiency levels and uses holistic fluency edits to not only correct grammatical errors but also make the original text more native sounding. We describe the types of corrections made and benchmark four leading GEC systems on this corpus, identifying specific areas in which they do well and how they can improve. JFLEG fulfills the need for a new gold standard to properly assess the current state of GEC.

Key facts. Cited by 96 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Feb 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 20; 2023: 25; 2024: 16; 2025: 15; 2026: 12.

96 papers.

Sort:

By area:

  1. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  2. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  3. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
  4. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
  5. 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 112
  6. 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
  7. 2022PEER: A Collaborative Language Modelcited by 86
  8. 2023ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmarkcited by 77
  9. 2023CoEdIT: Text Editing by Task-Specific Instruction Tuningcited by 67
  10. 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
  11. 2023Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinationscited by 63
  12. 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
38 more
  1. 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
  2. 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
  3. 2023Exploring Effectiveness of GPT-3 in Grammatical Error Correction: A Study on Performance and Controllability in Prompt-Based Methodscited by 37
  4. 2021LM-Critic: Language Models for Unsupervised Grammatical Error Correctioncited by 33
  5. 2022MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correctioncited by 33
  6. 2023Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistancecited by 33
  7. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
  8. 2022EditEval: An Instruction-Based Benchmark for Text Improvementscited by 30
  9. 2023On the application of Large Language Models for language teaching and assessment technologycited by 26
  10. 2024Prompting open-source and commercial language models for grammatical error correction of English learner textcited by 24
  11. 2022Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyondcited by 20
  12. 2024Resilience of Large Language Models for Noisy Instructionscited by 20
  13. 2021UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Languagecited by 19
  14. 2021Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correctioncited by 19
  15. 2024GPT-3.5 for Grammatical Error Correctioncited by 18
  16. 2024Enhancing Prompt Injection Attacks to LLMs via Poisoning Alignmentcited by 18
  17. 2022Czech Grammar Error Correction with a Large and Diverse Corpuscited by 17
  18. 2022Interpretability for Language Learners Using Example-Based Grammatical Error Correctioncited by 13
  19. 2022FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correctioncited by 13
  20. 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
  21. 2025PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Featurescited by 13
  22. 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applicationscited by 12
  23. 2021Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correctioncited by 11
  24. 2024Robustness of Large Language Models to Perturbations in Textcited by 11
  25. 2021Comparison of Grammatical Error Correction Using Back-Translation Modelscited by 9
  26. 2022Type-Driven Multi-Turn Corrections for Grammatical Error Correctioncited by 9
  27. 2022Uncertainty Determines the Adequacy of the Mode and the Tractability of Decoding in Sequence-to-Sequence Modelscited by 9
  28. 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Textscited by 9
  29. 2024Classist Tools: Social Class Correlates with Performance in NLPcited by 9
  30. 2023Non-autoregressive Text Editing with Copy-aware Latent Alignmentscited by 8
  31. 2023Analyzing the Performance of GPT-3.5 and GPT-4 in Grammatical Error Correctioncited by 7
  32. 2023Towards an On-device Agent for Text Rewritingcited by 7
  33. 2024LLMs in Education: Novel Perspectives, Challenges, and Opportunitiescited by 7
  34. 2021Grammatical Error Correction as GAN-like Sequence Labelingcited by 6
  35. 2023XATU: A Fine-grained Instruction-based Benchmark for Explainable Text Updatescited by 6
  36. 2023RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbationcited by 6
  37. 2023DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selectioncited by 6
  38. 2025Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insightscited by 6

50 most cited of 96 All 96 (JSON)