Overview for the Second Shared Task on Language Identification in Code-Switched Data
Not on the map. Why?
Abstract (arXiv)
We present an overview of the second shared task on language identification in code-switched data. For the shared task, we had code-switched data from two different language pairs: Modern Standard Arabic-Dialectal Arabic (MSA-DA) and Spanish-English (SPA-ENG). We had a total of nine participating teams, with all teams submitting a system for SPA-ENG and four submitting for MSA-DA. Through evaluation, we found that once again language identification is more difficult for the language pair that is more closely related. We also found that this year's systems performed better overall than the systems from the previous shared task indicating overall progress in the state of the art for this task.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 3; 2024: 5; 2025: 8.
33 papers.
Sort:
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2023ALDi: Quantifying the Arabic Level of Dialectness of Textcited by 24
- 2021Can You Traducir This? Machine Translation for Code-Switched Inputcited by 21
- 2023Language Variety Identification with True Labelscited by 12
- 2021Comparing Approaches to Dravidian Language Identificationcited by 11
- 2024MaskLID: Code-Switching Language Identification through Iterative Maskingcited by 10
- 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Datacited by 9
- 2021El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsingcited by 8
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
- 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Textcited by 7
- 2024Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Textcited by 7
- 2022Detecting Unassimilated Borrowings in Spanish: An Annotated Corpus and Approaches to Modelingcited by 6
21 more
- 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixingcited by 6
- 2021Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-Switchingcited by 5
- 2022Borrowing or Codeswitching? Annotating for Finer-Grained Distinctions in Language Mixingcited by 5
- 2022CST5: Data Augmentation for Code-Switched Semantic Parsingcited by 5
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
- 2021Overview of ADoBo 2021: Automatic Detection of Unassimilated Borrowings in the Spanish Presscited by 4
- 2024Estimating the Level of Dialectness Predicts Interannotator Agreement in Multi-dialect Arabic Datasetscited by 4
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 4
- 2022Language Identification for Austronesian Languagescited by 3
- 2024Code-Switched Language Identification is Harder Than You Thinkcited by 3
- 2025Low-resource Machine Translation for Code-switched Kazakh-Russian Language Paircited by 3
- 2025Conditioning LLMs to Generate Code-Switched Textcited by 2
- 2022niksss at HinglishEval: Language-agnostic BERT-based Contextual Embeddings with Catboost for Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Textcited by 1
- 2022Post-hoc analysis of Arabic transformer modelscited by 1
- 2022Automatic Identification of Motivation for Code-Switching in Speech Transcriptscited by 1
- 2023The Effect of Alignment Objectives on Code-Switching Translationcited by 1
- 2024Computational Approaches to Arabic-English Code-Switchingcited by 1
- 2022Interpreting Arabic Transformer Modelscited by 0
- 2022TuGeBiC: A Turkish German Bilingual Code-Switching Corpuscited by 0
- 2025Token Masking Improves Transformer-Based Text Classificationcited by 0
- 2025Modeling Topics and Sociolinguistic Variation in Code-Switched Discourse: Insights from Spanish-English and Spanish-Guaran'icited by 0
- 2025Modeling Topics and Sociolinguistic Variation in Code-Switched Discourse: Insights from Spanish-English and Spanish-Guaran'i3 Dec 2025
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities8 Oct 2025
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Token Masking Improves Transformer-Based Text Classification16 May 2025
- 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixing27 Mar 2025
- 2025Low-resource Machine Translation for Code-switched Kazakh-Russian Language Pair25 Mar 2025
- 2025Conditioning LLMs to Generate Code-Switched Text18 Feb 2025
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions23 Jan 2025
- 2024Computational Approaches to Arabic-English Code-Switching17 Oct 2024
- 2024MaskLID: Code-Switching Language Identification through Iterative Masking10 Jun 2024
- 2024Estimating the Level of Dialectness Predicts Interannotator Agreement in Multi-dialect Arabic Datasets18 May 2024
- 2024Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Text7 Mar 2024
21 more
- 2024Code-Switched Language Identification is Harder Than You Think2 Feb 2024
- 2023ALDi: Quantifying the Arabic Level of Dialectness of Text20 Oct 2023
- 2023The Effect of Alignment Objectives on Code-Switching Translation10 Sep 2023
- 2023Language Variety Identification with True Labels2 Mar 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022Automatic Identification of Motivation for Code-Switching in Speech Transcripts30 Nov 2022
- 2022CST5: Data Augmentation for Code-Switched Semantic Parsing14 Nov 2022
- 2022Post-hoc analysis of Arabic transformer models18 Oct 2022
- 2022niksss at HinglishEval: Language-agnostic BERT-based Contextual Embeddings with Catboost for Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Text17 Jun 2022
- 2022Borrowing or Codeswitching? Annotating for Finer-Grained Distinctions in Language Mixing10 Jun 2022
- 2022Language Identification for Austronesian Languages9 Jun 2022
- 2022TuGeBiC: A Turkish German Bilingual Code-Switching Corpus2 May 2022
- 2022Detecting Unassimilated Borrowings in Spanish: An Annotated Corpus and Approaches to Modeling30 Mar 2022
- 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Data19 Feb 2022
- 2022Interpreting Arabic Transformer Models19 Jan 2022
- 2021Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-Switching1 Nov 2021
- 2021Overview of ADoBo 2021: Automatic Detection of Unassimilated Borrowings in the Spanish Press29 Oct 2021
- 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Text4 Aug 2021
- 2021Can You Traducir This? Machine Translation for Code-Switched Input11 May 2021
- 2021Comparing Approaches to Dravidian Language Identification9 Mar 2021
- 2021El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing26 Jan 2021
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2023ALDi: Quantifying the Arabic Level of Dialectness of Textcited by 24
- 2021Can You Traducir This? Machine Translation for Code-Switched Inputcited by 21
- 2023Language Variety Identification with True Labelscited by 12
- 2021Comparing Approaches to Dravidian Language Identificationcited by 11
- 2024MaskLID: Code-Switching Language Identification through Iterative Maskingcited by 10
- 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Datacited by 9
- 2021El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsingcited by 8
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
- 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Textcited by 7
- 2024Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Textcited by 7
- 2022Detecting Unassimilated Borrowings in Spanish: An Annotated Corpus and Approaches to Modelingcited by 6
12 most cited of 33 All 33 (JSON)
- 2025Modeling Topics and Sociolinguistic Variation in Code-Switched Discourse: Insights from Spanish-English and Spanish-Guaran'i3 Dec 2025
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities8 Oct 2025
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Token Masking Improves Transformer-Based Text Classification16 May 2025
- 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixing27 Mar 2025
- 2025Low-resource Machine Translation for Code-switched Kazakh-Russian Language Pair25 Mar 2025
- 2025Conditioning LLMs to Generate Code-Switched Text18 Feb 2025
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions23 Jan 2025
- 2024Computational Approaches to Arabic-English Code-Switching17 Oct 2024
- 2024MaskLID: Code-Switching Language Identification through Iterative Masking10 Jun 2024
- 2024Estimating the Level of Dialectness Predicts Interannotator Agreement in Multi-dialect Arabic Datasets18 May 2024
- 2024Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Text7 Mar 2024
12 newest of 33 All 33 (JSON)