Code-Switching Language Modeling using Syntax-Aware Multi-Task Learning
Not on the map. Why?
Abstract (arXiv)
Lack of text data has been the major issue on code-switching language modeling. In this paper, we introduce multi-task learning based language model which shares syntax representation of languages to leverage linguistic information and tackle the low resource data issue. Our model jointly learns both language modeling and Part-of-Speech tagging on code-switched utterances. In this way, the model is able to identify the location of code-switching points and improves the prediction of next word. Our approach outperforms standard LSTM based language model, with an improvement of 9.7% and 7.4% in perplexity on SEAME Phase I and Phase II dataset respectively.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 2; 2024: 2; 2025: 2; 2026: 2.
15 papers.
Sort:
By area:
- 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 66
- 2021Are Multilingual Models Effective in Code-Switching?cited by 56
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversationcited by 44
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2021Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillationcited by 13
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkiencited by 7
- 2021Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-Switchingcited by 5
- 2023IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languagescited by 5
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 5
- 2024ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddingscited by 1
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialoguescited by 1
3 more
- 2022BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformerscited by 0
- 2025Modeling Topics and Sociolinguistic Variation in Code-Switched Discourse: Insights from Spanish-English and Spanish-Guaran'icited by 0
- 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASRcited by 0
- 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR20 Jun 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Modeling Topics and Sociolinguistic Variation in Code-Switched Discourse: Insights from Spanish-English and Spanish-Guaran'i3 Dec 2025
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities8 Oct 2025
- 2024ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddings28 Aug 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2023IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages21 Nov 2023
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien21 Jan 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers17 Jun 2022
- 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia24 Mar 2022
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation12 Dec 2021
- 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 66
- 2021Are Multilingual Models Effective in Code-Switching?cited by 56
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversationcited by 44
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkiencited by 7
- 2021Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-Switchingcited by 5
- 2023IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languagescited by 5
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 5
- 2024ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddingscited by 1
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialoguescited by 1
- 2022BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformerscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR20 Jun 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Modeling Topics and Sociolinguistic Variation in Code-Switched Discourse: Insights from Spanish-English and Spanish-Guaran'i3 Dec 2025
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities8 Oct 2025
- 2024ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddings28 Aug 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2023IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages21 Nov 2023
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien21 Jan 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers17 Jun 2022
- 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia24 Mar 2022
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation12 Dec 2021
12 newest of 14 All 14 (JSON)