mlsanityData to 7 Oct 2026

CALCS 2021 Shared Task: Machine Translation for Code-Switched Data

arXiv 2202.09625 ↗First posted 19 Feb 2022cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

To date, efforts in the code-switching literature have focused for the most part on language identification, POS, NER, and syntactic parsing. In this paper, we address machine translation for code-switched social media data. We create a community shared task. We provide two modalities for participation: supervised and unsupervised. For the supervised setting, participants are challenged to translate English into Hindi-English (Eng-Hinglish) in a single direction. For the unsupervised setting, we provide the following language pairs: English and Spanish-English (Eng-Spanglish), and English and Modern Standard Arabic-Egyptian Arabic (Eng-MSAEA) in both directions. We share insights and challenges in curating the "into" code-switching language evaluation data. Further, we provide baselines for all language pairs in the shared task. The leaderboard for the shared task comprises 12 individual system submissions corresponding to 5 different teams. The best performance achieved is 12.67% BLEU score for English to Hinglish and 25.72% BLEU score for MSAEA to English.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 19 Feb 2022.

Builds on

21 of 36 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  4. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  5. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  6. 2019Evaluating Gender Bias in Machine Translationcited by 247
  7. 2018A Dataset for Document Grounded Conversationscited by 104
  8. 2020LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluationcited by 92
  9. 2020Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problemcited by 86
  10. 2021A Primer on Pretrained Multilingual Language Modelscited by 49
  11. 2020Code-switching pre-training for neural machine translationcited by 43
  12. 2020PHINC: A Parallel Hinglish Social Media Code-Mixed Corpus for Machine Translationcited by 38
9 more
  1. 2019Overview for the Second Shared Task on Language Identification in Code-Switched Datacited by 33
  2. 2021From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Textcited by 29
  3. 2019Named Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Taskcited by 24
  4. 2021Can You Traducir This? Machine Translation for Code-Switched Inputcited by 21
  5. 2019From English to Code-Switching: Transfer Learning with Strong Morphological Cluescited by 18
  6. 2018Code-switched Language Models Using Dual RNNs and Same-Source Pretrainingcited by 16
  7. 2021Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixingcited by 16
  8. 2018Language Modeling for Code-Switching: Evaluation, Integration of Monolingual Data, and Discriminative Trainingcited by 14
  9. 2021Investigating Code-Mixed Modern Standard Arabic-Egyptian to English Machine Translationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 3; 2024: 2; 2025: 1; 2026: 1.

9 papers.

  1. 2023TADA: Task-Agnostic Dialect Adapters for Englishcited by 15
  2. 2022ArzEn-ST: A Three-way Speech Translation Corpus for Code-Switched Egyptian Arabic - Englishcited by 13
  3. 2022Exploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Textcited by 7
  4. 2024Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Textcited by 7
  5. 2023Overview of GUA-SPA at IberLEF 2023: Guarani-Spanish Code Switching Analysiscited by 5
  6. 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
  7. 2024Grammatical Error Correction for Code-Switched Sentences by Learners of Englishcited by 2
  8. 2023Detecting Propaganda Techniques in Code-Switched Social Media Textcited by 1
  9. 2026Neither Here Nor There: Cross-Lingual Representation Dynamics of Code-Mixed Text in Multilingual Encoderscited by 0