mlsanityData to 7 Oct 2026

Grammatical Error Correction for Code-Switched Sentences by Learners of English

arXiv 2404.12489 ↗First posted 18 Apr 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Code-switching (CSW) is a common phenomenon among multilingual speakers where multiple languages are used in a single discourse or utterance. Mixed language utterances may still contain grammatical errors however, yet most existing Grammar Error Correction (GEC) systems have been trained on monolingual data and not developed with CSW in mind. In this work, we conduct the first exploration into the use of GEC systems on CSW text. Through this exploration, we propose a novel method of generating synthetic CSW GEC datasets by translating different spans of text within existing GEC corpora. We then investigate different methods of selecting these spans based on CSW ratio, switch-point factor and linguistic constraints, and identify how they affect the performance of GEC systems on CSW text. Our best model achieves an average increase of 1.57 F0.5 across 3 CSW test sets (English-Chinese, English-Korean and English-Japanese) without affecting the model's performance on a monolingual dataset. We furthermore discovered that models trained on one CSW language generalise relatively well to other typologically similar CSW languages.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 75 references that are in the map. First posted on arXiv 18 Apr 2024.

Builds on

21 of 75 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  5. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
  6. 2018Constituency Parsing with a Self-Attentive Encodercited by 196
  7. 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
  8. 2018Multilingual Constituency Parsing with Self-Attention and Pre-Trainingcited by 117
  9. 2019Parallel Iterative Edit Models for Local Sequence Transductioncited by 81
  10. 2023A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologiescited by 59
  11. 2020Seq2Edits: Sequence Transduction Using Span-level Edit Operationscited by 58
  12. 2021Are Multilingual Models Effective in Code-Switching?cited by 56
9 more
  1. 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
  2. 2019An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correctioncited by 55
  3. 2019Corpora Generation for Grammatical Error Correctioncited by 53
  4. 2021HinGE: A Dataset for Generation and Evaluation of Code-Mixed Hinglish Textcited by 28
  5. 2018Code-switching Sentence Generation by Generative Adversarial Networks and its Application to Data Augmentationcited by 26
  6. 2021Can You Traducir This? Machine Translation for Code-Switched Inputcited by 21
  7. 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
  8. 2017Artificial Error Generation with Machine Translation and Syntactic Patternscited by 11
  9. 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Datacited by 9

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.