mlsanityData to 7 Oct 2026

Leveraging LLMs for Bangla Grammar Error Correction:Error Categorization, Synthetic Data, and Model Evaluation

arXiv 2406.14284 ↗First posted 20 Jun 2024cs.CL cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation

Abstract (arXiv)

Large Language Models (LLMs) perform exceedingly well in Natural Language Understanding (NLU) tasks for many languages including English. However, despite being the fifth most-spoken language globally, Grammatical Error Correction (GEC) in Bangla remains underdeveloped. In this work, we investigate how LLMs can be leveraged for improving Bangla GEC. For that, we first do an extensive categorization of 12 error classes in Bangla, and take a survey of native Bangla speakers to collect real-world errors. We next devise a rule-based noise injection method to create grammatically incorrect sentences corresponding to correct ones. The Vaiyakarana dataset, thus created, consists of 5,67,422 sentences of which 2,27,119 are erroneous. This dataset is then used to instruction-tune LLMs for the task of GEC in Bangla. Evaluations show that instruction-tuning with name improves GEC performance of LLMs by 3-7 percentage points as compared to the zero-shot setting, and makes them achieve human-like performance in grammatical error identification. Humans, though, remain superior in error correction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 16 of its 39 references that are in the map. First posted on arXiv 20 Jun 2024.

Builds on

16 of 39 references.

References · 16

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  4. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  5. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 711
  6. 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
  7. 2019Corpora Generation for Grammatical Error Correctioncited by 53
  8. 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 33
  9. 2021UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Languagecited by 19
  10. 2019Improving Grammatical Error Correction with Machine Translation Pairscited by 17
  11. 2021BNLP: Natural language processing toolkit for Bengali languagecited by 16
  12. 2022BanglaParaphrase: A High-Quality Bangla Paraphrase Datasetcited by 15
4 more
  1. 2024How Ready Are Generative Pre-trained Large Language Models for Explaining Bengali Grammatical Errors?cited by 11
  2. 2023Vacaspati: A Diverse Corpus of Bangla Literaturecited by 10
  3. 2017Auxiliary Objectives for Neural Error Detection Modelscited by 4
  4. 2022BSpell: A CNN-Blended BERT Based Bangla Spell Checkercited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction
  2. 2024ChatLang-8: An LLM-Based Synthetic Data Generation Framework for Grammatical Error Correction
  3. 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context
  4. 2024Evaluating LLMs at Detecting Errors in LLM Responses
  5. 2024Zero-shot Cross-Lingual Transfer for Synthetic Data Generation in Grammatical Error Detection
  6. 2025Harnessing Rule-Based Reinforcement Learning for Enhanced Grammatical Error Correction
  7. 2023Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis
  8. 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Models