mlsanityData to 7 Oct 2026

Enhancing Text Editing for Grammatical Error Correction: Arabic as a Case Study

arXiv 2503.00985 ↗First posted 2 Mar 2025cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Text editing frames grammatical error correction (GEC) as a sequence tagging problem, where edit tags are assigned to input tokens, and applying these edits results in the corrected text. This approach has gained attention for its efficiency and interpretability. However, while extensively explored for English, text editing remains largely underexplored for morphologically rich languages like Arabic. In this paper, we introduce a text editing approach that derives edit tags directly from data, eliminating the need for language-specific edits. We demonstrate its effectiveness on Arabic, a diglossic and morphologically rich language, and investigate the impact of different edit representations on model performance. Our approach achieves SOTA results on two Arabic GEC benchmarks and performs on par with SOTA on two others. Additionally, our models are over six times faster than existing Arabic GEC systems, making our approach more practical for real-world applications. Finally, we explore ensemble models, demonstrating how combining different models leads to further performance improvements. We make our code, data, and pretrained models publicly available.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 37 of its 91 references that are in the map. First posted on arXiv 2 Mar 2025.

Builds on

37 of 91 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
  3. 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
  4. 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 164
  5. 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 118
  6. 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
  7. 2019Encode, Tag, Realize: High-Precision Text Editingcited by 99
  8. 2023Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluationcited by 97
  9. 2019Parallel Iterative Edit Models for Local Sequence Transductioncited by 81
  10. 2023ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmarkcited by 77
  11. 2023CoEdIT: Text Editing by Task-Specific Instruction Tuningcited by 67
  12. 2020Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correctioncited by 59
25 more
  1. 2020Felix: Flexible Text Editing Through Tagging and Insertioncited by 58
  2. 2020Seq2Edits: Sequence Transduction Using Span-level Edit Operationscited by 58
  3. 2018Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Taskcited by 56
  4. 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
  5. 2019Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Datacited by 50
  6. 2023Exploring Effectiveness of GPT-3 in Grammatical Error Correction: A Study on Performance and Controllability in Prompt-Based Methodscited by 37
  7. 2022EdiT5: Semi-Autoregressive Text-Editing with T5 Warm-Startcited by 35
  8. 2020Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Modelcited by 33
  9. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
  10. 2024Prompting open-source and commercial language models for grammatical error correction of English learner textcited by 24
  11. 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigationcited by 22
  12. 2021Automatic Error Type Annotation for Arabiccited by 21
  13. 2022Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyondcited by 20
  14. 2024GPT-3.5 for Grammatical Error Correctioncited by 18
  15. 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
  16. 2019Joint Diacritization, Lemmatization, Normalization, and Fine-Grained Morphological Taggingcited by 12
  17. 2023Beyond English: Evaluating LLMs for Arabic Grammatical Error Correctioncited by 12
  18. 2022Camelira: An Arabic Multi-Dialect Morphological Disambiguatorcited by 10
  19. 2023Non-autoregressive Text Editing with Copy-aware Latent Alignmentscited by 8
  20. 2023Improving Seq2Seq Grammatical Error Correction via Decoding Interventionscited by 8
  21. 2018Utilizing Character and Word Embeddings for Text Normalization with Sequence-to-Sequence Modelscited by 7
  22. 2021Character Transformations for Non-Autoregressive GEC Taggingcited by 7
  23. 2024Exploiting Dialect Identification in Automatic Dialectal Text Normalizationcited by 7
  24. 2023An Extended Sequence Tagging Vocabulary for Grammatical Error Correctioncited by 6
  25. 2024Gazelle: An Instruction Dataset for Arabic Writing Assistancecited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 3.

9 papers.