Code Mixologist : A Practitioner's Guide to Building Code-Mixed LLMs
Not on the map. Why?
Abstract (arXiv)
Code-mixing and code-switching (CSW) remain challenging phenomena for large language models (LLMs). Despite recent advances in multilingual modeling, LLMs often struggle in mixed-language settings, exhibiting systematic degradation in grammaticality, factuality, and safety behavior. This work provides a comprehensive overview of CSW research in modern large language model settings. We introduce a unifying taxonomy that organizes prior work along dimensions of data, modeling, and evaluation, and we distill these findings into a practical playbook of actionable recommendations for building, adapting, and evaluating CSW-capable LLMs. We review modeling approaches ranging from CSW-tailored pre-training and task-specific post-training to prompting strategies and in-context learning. We analyze current evaluation practices, highlighting sources of instability and limited reproducibility, and we catalog existing benchmarks while critically examining their linguistic coverage and English-centric biases. Finally, we discuss emerging safety concerns, including use of code-mixing as a mechanism for bypassing model safeguards, and identify open research challenges.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
38 of 57 references.
References · 38
- 2020GLUECoS : An Evaluation Benchmark for Code-Switched NLPcited by 101
- 2020LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluationcited by 92
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
- 2023A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologiescited by 59
- 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 50
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understandingcited by 34
- 2024Code-Switching Curriculum Learning for Multilingual Transfer in LLMscited by 26
- 2021Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Textcited by 18
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
- 2025Krutrim LLM: Multilingual Foundational Model for over a Billion Peoplecited by 9
- 2025Lost in the Mix: Evaluating LLM Understanding of Code-Switched Textcited by 9
26 more
- 2024From Human Judgements to Predictive Models: Unravelling Acceptability in Code-Mixed Sentencescited by 8
- 2024Exploring the Role of Transliteration in In-Context Learning for Low-resource Languages Written in Non-Latin Scriptscited by 8
- 2025Mechanistic Understanding and Mitigation of Language Confusion in English-Centric Large Language Modelscited by 8
- 2023Code-Switched Text Synthesis in Unseen Language Pairscited by 7
- 2024Code-Mixer Ya Nahi: Novel Approaches to Measuring Multilingual LLMs' Code-Mixing Capabilitiescited by 7
- 2023Constructing Code-mixed Universal Dependency Forest for Unbiased Cross-lingual Relation Extractioncited by 6
- 2024Linguistics Theory Meets LLM: Code-Switched Text Generation via Equivalence Constrained Large Language Modelscited by 6
- 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixingcited by 6
- 2025Minimal Pair-Based Evaluation of Code-Switchingcited by 6
- 2018Intent Detection for code-mix utterances in task oriented dialogue systemscited by 5
- 2024Can Code-Switched Texts Activate a Knowledge Switch in LLMs? A Case Study on English-Korean Code-Switchingcited by 5
- 2024CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedbackcited by 5
- 2023Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindicited by 4
- 2021Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependenciescited by 3
- 2023Persona-aware Generative Model for Code-mixed Languagecited by 3
- 2025Gradual Code-Switching as Inference-Time Cross-Lingual Representational Alignment for LLMscited by 3
- 2018Exploring the importance of context and embeddings in neural NER models for task-oriented dialogue systemscited by 2
- 2025Conditioning LLMs to Generate Code-Switched Textcited by 2
- 2025CMLFormer: A Dual Decoder Transformer with Switching Point Learning for Code-Mixed Language Modelingcited by 2
- 2025CS-Sum: A Benchmark for Code-Switching Dialogue Summarization and the Limits of Large Language Modelscited by 2
- 2025SASFT: Sparse Autoencoder-guided Supervised Finetuning to Mitigate Unexpected Code-Switching in LLMscited by 2
- 2025Breaking Language Barriers: Equitable Performance in Multilingual Language Modelscited by 2
- 2025MUTANT: A Recipe for Multilingual Tokenizer Designcited by 2
- 2025BhashaKritika: Building Synthetic Pretraining Data at Scale for Indic Languagescited by 2
- 2024ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddingscited by 1
- 2025Evaluating Multilingual and Code-Switched Alignment in LLMs via Synthetic Natural Language Inferencecited by 1
Built on by
Not cited yet.