Computational Approaches to Arabic-English Code-Switching
Not on the map. Why?
Abstract (arXiv)
Natural Language Processing (NLP) is a vital computational method for addressing language processing, analysis, and generation. NLP tasks form the core of many daily applications, from automatic text correction to speech recognition. While significant research has focused on NLP tasks for the English language, less attention has been given to Modern Standard Arabic and Dialectal Arabic. Globalization has also contributed to the rise of Code-Switching (CS), where speakers mix languages within conversations and even within individual words (intra-word CS). This is especially common in Arab countries, where people often switch between dialects or between dialects and a foreign language they master. CS between Arabic and English is frequent in Egypt, especially on social media. Consequently, a significant amount of code-switched content can be found online. Such code-switched data needs to be investigated and analyzed for several NLP tasks to tackle the challenges of this multilingual phenomenon and Arabic language challenges. No work has been done before for several integral NLP tasks on Arabic-English CS data. In this work, we focus on the Named Entity Recognition (NER) task and other tasks that help propose a solution for the NER task on CS data, e.g., Language Identification. This work addresses this gap by proposing and applying state-of-the-art techniques for Modern Standard Arabic and Arabic-English NER. We have created the first annotated CS Arabic-English corpus for the NER task. Also, we apply two enhancement techniques to improve the NER tagger on CS data using CS contextual embeddings and data augmentation techniques. All methods showed improvements in the performance of the NER taggers on CS data. Finally, we propose several intra-word language identification approaches to determine the language type of a mixed text and identify whether it is a named entity or not.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 58 of its 269 references that are in the map. First posted on arXiv 17 Oct 2024.
Builds on
58 of 269 references.
References · 58
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2018Deep contextualized word representationscited by 2,290
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,060
- 2016An overview of gradient descent optimization algorithmscited by 1,033
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
38 more
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 546
- 2018Universal Sentence Encodercited by 489
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
- 2019HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networkscited by 261
- 2019Billion-scale semi-supervised learning for image classificationcited by 232
- 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
- 2015Visualizing and Understanding Neural Models in NLPcited by 200
- 2019Multilingual Universal Sentence Encoder for Semantic Retrievalcited by 193
- 2020Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learningcited by 185
- 2020Data Augmentation using Pre-trained Transformer Modelscited by 168
- 2014A Convolutional Neural Network for Modelling Sentencescited by 163
- 2018Dissecting Contextual Word Embeddings: Architecture and Representationcited by 146
- 2014Return of the Devil in the Details: Delving Deep into Convolutional Netscited by 122
- 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
- 2020GLUECoS : An Evaluation Benchmark for Code-Switched NLPcited by 102
- 2020LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluationcited by 93
- 2017Learning to Compose Domain-Specific Transformations for Data Augmentationcited by 91
- 2017Semi-supervised sequence tagging with bidirectional language modelscited by 86
- 2018Tensor2Tensor for Neural Machine Translationcited by 85
- 2017Comparative Study of CNN and RNN for Natural Language Processingcited by 82
- 2018Data augmentation instead of explicit regularizationcited by 63
- 2019Bayesian Generative Active Deep Learningcited by 57
- 2019Neural Arabic Question Answeringcited by 48
- 2020A Panoramic Survey of Natural Language Processing in the Arab Worldcited by 45
- 2019Overview for the Second Shared Task on Language Identification in Code-Switched Datacited by 33
- 2017AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networkscited by 29
- 2020Multi-Encoder-Decoder Transformer for Code-Switching Speech Recognitioncited by 28
- 2020ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generatorscited by 27
- 2019Named Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Taskcited by 24
- 2016Challenges of Computational Processing of Code-Switchingcited by 20
- 2014Multilingual Models for Compositional Distributed Semanticscited by 18
- 2014Lexicon Infused Phrase Embeddings for Named Entity Resolutioncited by 16
- 2020Contextual Embeddings: When Are They Worth It?cited by 15
- 2018Fortification of Neural Morphological Segmentation Models for Polysynthetic Minimal-Resource Languagescited by 13
- 2016Cross-lingual Models of Word Embeddings: An Empirical Comparisoncited by 12
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.