mlsanityData to 7 Oct 2026

Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Text

arXiv 2106.10123 ↗First posted 18 Jun 2021cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

Code-mixing is a frequent communication style among multilingual speakers where they mix words and phrases from two different languages in the same utterance of text or speech. Identifying and filtering code-mixed text is a challenging task due to its co-existence with monolingual and noisy text. Over the years, several code-mixing metrics have been extensively used to identify and validate code-mixed text quality. This paper demonstrates several inherent limitations of code-mixing metrics with examples from the already existing datasets that are popularly used across various experiments.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 5 of its 26 references that are in the map. First posted on arXiv 18 Jun 2021.

Builds on

5 of 26 references.

References · 5

  1. 2020SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweetscited by 62
  2. 2020PHINC: A Parallel Hinglish Social Media Code-Mixed Corpus for Machine Translationcited by 38
  3. 2016Towards Sub-Word Level Compositions for Sentiment Analysis of Hindi-English Code Mixed Textcited by 31
  4. 2020A New Dataset for Natural Language Inference from Code-mixed Conversationscited by 29
  5. 2018A Corpus of English-Hindi Code-Mixed Tweets for Sarcasm Detectioncited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 1; 2023: 2; 2024: 2; 2025: 5; 2026: 5.

18 papers.

Sort:

By area:

  1. 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
  2. 2021HinGE: A Dataset for Generation and Evaluation of Code-Mixed Hinglish Textcited by 28
  3. 2021MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluationcited by 7
  4. 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Textcited by 7
  5. 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixingcited by 6
  6. 2024Can Code-Switched Texts Activate a Knowledge Switch in LLMs? A Case Study on English-Korean Code-Switchingcited by 5
  7. 2024CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedbackcited by 5
  8. 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 4
  9. 2023MUTANT: A Multi-sentential Code-mixed Hinglish Datasetcited by 2
  10. 2023MMT: A Multilingual and Multi-Topic Indian Social Media Datasetcited by 2
  11. 2025Conditioning LLMs to Generate Code-Switched Textcited by 2
  12. 2025From Construction to Injection: Edit-Based Fingerprints for Large Language Modelscited by 2
6 more
  1. 2025VietMix: A Naturally-Occurring Parallel Corpus and Augmentation Framework for Vietnamese-English Code-Mixed Machine Translationcited by 1
  2. 2026LuxBorrow: From Pompier to Pompjee, Tracing Borrowing in Luxembourgishcited by 1
  3. 2026Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speechcited by 1
  4. 2026Code Mixologist : A Practitioner's Guide to Building Code-Mixed LLMscited by 0
  5. 2026Indi-RomCoM: Code-Mixed Benchmark for Evaluating LLMs on Romanized Indic-English Instructionscited by 0
  6. 2026AfriSwitch: A Benchmark for In-the-Wild African Code-Switched Speech Recognitioncited by 0