mlsanityData to 7 Oct 2026

Code Mixologist : A Practitioner's Guide to Building Code-Mixed LLMs

arXiv 2602.11181 ↗First posted 21 Jan 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Code-mixing and code-switching (CSW) remain challenging phenomena for large language models (LLMs). Despite recent advances in multilingual modeling, LLMs often struggle in mixed-language settings, exhibiting systematic degradation in grammaticality, factuality, and safety behavior. This work provides a comprehensive overview of CSW research in modern large language model settings. We introduce a unifying taxonomy that organizes prior work along dimensions of data, modeling, and evaluation, and we distill these findings into a practical playbook of actionable recommendations for building, adapting, and evaluating CSW-capable LLMs. We review modeling approaches ranging from CSW-tailored pre-training and task-specific post-training to prompting strategies and in-context learning. We analyze current evaluation practices, highlighting sources of instability and limited reproducibility, and we catalog existing benchmarks while critically examining their linguistic coverage and English-centric biases. Finally, we discuss emerging safety concerns, including use of code-mixing as a mechanism for bypassing model safeguards, and identify open research challenges.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

38 of 57 references.

References · 38

  1. 2020GLUECoS : An Evaluation Benchmark for Code-Switched NLPcited by 101
  2. 2020LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluationcited by 92
  3. 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
  4. 2023A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologiescited by 59
  5. 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 50
  6. 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
  7. 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understandingcited by 34
  8. 2024Code-Switching Curriculum Learning for Multilingual Transfer in LLMscited by 26
  9. 2021Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Textcited by 18
  10. 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
  11. 2025Krutrim LLM: Multilingual Foundational Model for over a Billion Peoplecited by 9
  12. 2025Lost in the Mix: Evaluating LLM Understanding of Code-Switched Textcited by 9
26 more
  1. 2024From Human Judgements to Predictive Models: Unravelling Acceptability in Code-Mixed Sentencescited by 8
  2. 2024Exploring the Role of Transliteration in In-Context Learning for Low-resource Languages Written in Non-Latin Scriptscited by 8
  3. 2025Mechanistic Understanding and Mitigation of Language Confusion in English-Centric Large Language Modelscited by 8
  4. 2023Code-Switched Text Synthesis in Unseen Language Pairscited by 7
  5. 2024Code-Mixer Ya Nahi: Novel Approaches to Measuring Multilingual LLMs' Code-Mixing Capabilitiescited by 7
  6. 2023Constructing Code-mixed Universal Dependency Forest for Unbiased Cross-lingual Relation Extractioncited by 6
  7. 2024Linguistics Theory Meets LLM: Code-Switched Text Generation via Equivalence Constrained Large Language Modelscited by 6
  8. 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixingcited by 6
  9. 2025Minimal Pair-Based Evaluation of Code-Switchingcited by 6
  10. 2018Intent Detection for code-mix utterances in task oriented dialogue systemscited by 5
  11. 2024Can Code-Switched Texts Activate a Knowledge Switch in LLMs? A Case Study on English-Korean Code-Switchingcited by 5
  12. 2024CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedbackcited by 5
  13. 2023Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindicited by 4
  14. 2021Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependenciescited by 3
  15. 2023Persona-aware Generative Model for Code-mixed Languagecited by 3
  16. 2025Gradual Code-Switching as Inference-Time Cross-Lingual Representational Alignment for LLMscited by 3
  17. 2018Exploring the importance of context and embeddings in neural NER models for task-oriented dialogue systemscited by 2
  18. 2025Conditioning LLMs to Generate Code-Switched Textcited by 2
  19. 2025CMLFormer: A Dual Decoder Transformer with Switching Point Learning for Code-Mixed Language Modelingcited by 2
  20. 2025CS-Sum: A Benchmark for Code-Switching Dialogue Summarization and the Limits of Large Language Modelscited by 2
  21. 2025SASFT: Sparse Autoencoder-guided Supervised Finetuning to Mitigate Unexpected Code-Switching in LLMscited by 2
  22. 2025Breaking Language Barriers: Equitable Performance in Multilingual Language Modelscited by 2
  23. 2025MUTANT: A Recipe for Multilingual Tokenizer Designcited by 2
  24. 2025BhashaKritika: Building Synthetic Pretraining Data at Scale for Indic Languagescited by 2
  25. 2024ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddingscited by 1
  26. 2025Evaluating Multilingual and Code-Switched Alignment in LLMs via Synthetic Natural Language Inferencecited by 1

Built on by

Not cited yet.