mlsanityData to 7 Oct 2026

RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation

arXiv 2310.07299 ↗First posted 11 Oct 2023cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Grammatical Error Correction (GEC) systems play a vital role in assisting people with their daily writing tasks. However, users may sometimes come across a GEC system that initially performs well but fails to correct errors when the inputs are slightly modified. To ensure an ideal user experience, a reliable GEC system should have the ability to provide consistent and accurate suggestions when encountering irrelevant context perturbations, which we refer to as context robustness. In this paper, we introduce RobustGEC, a benchmark designed to evaluate the context robustness of GEC systems. RobustGEC comprises 5,000 GEC cases, each with one original error-correct sentence pair and five variants carefully devised by human annotators. Utilizing RobustGEC, we reveal that state-of-the-art GEC systems still lack sufficient robustness against context perturbations. In addition, we propose a simple yet effective method for remitting this issue.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 37 of its 64 references that are in the map. First posted on arXiv 11 Oct 2023.

Builds on

37 of 64 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  7. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  8. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  9. 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
  10. 2021Just Train Twice: Improving Group Robustness without Training Group Informationcited by 522
  11. 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 488
  12. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 428
25 more
  1. 2019PAWS: Paraphrase Adversaries from Word Scramblingcited by 395
  2. 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
  3. 2020MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classificationcited by 186
  4. 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
  5. 2020An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Modelscited by 133
  6. 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
  7. 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
  8. 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
  9. 2017JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correctioncited by 96
  10. 2019Parallel Iterative Edit Models for Local Sequence Transductioncited by 81
  11. 2023ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmarkcited by 77
  12. 2020Seq2Edits: Sequence Transduction Using Span-level Edit Operationscited by 58
  13. 2018Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Taskcited by 56
  14. 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
  15. 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
  16. 2023Exploring Effectiveness of GPT-3 in Grammatical Error Correction: A Study on Performance and Controllability in Prompt-Based Methodscited by 37
  17. 2020Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Modelcited by 33
  18. 2022MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correctioncited by 33
  19. 2023Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistancecited by 33
  20. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
  21. 2021RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Modelscited by 28
  22. 2020Tasty Burgers, Soggy Fries: Probing Aspect Robustness in Aspect-Based Sentiment Analysiscited by 23
  23. 2020Grammatical Error Correction in Low Error Density Domains: A New Benchmark and Analysescited by 16
  24. 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Textscited by 9
  25. 2022FactMix: Using a Few Labeled In-domain Examples to Generalize to Cross-domain Named Entity Recognitioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 0; 2026: 1.

6 papers.

  1. 2024Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScorecited by 27
  2. 2024REFeREE: A REference-FREE Model-Based Metric for Text Simplificationcited by 3
  3. 2023Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmentingcited by 2
  4. 2024Learning from Mistakes: Self-correct Adversarial Training for Chinese Unnatural Text Correctioncited by 2
  5. 2024Tibyan Corpus: Balanced and Comprehensive Error Coverage Corpus Using ChatGPT for Arabic Grammatical Error Correctioncited by 1
  6. 2026CoCoGEC: Counterfactual Generation for Robust Grammatical Error Correctioncited by 0