mlsanityData to 7 Oct 2026

Arabic Dialect Identification in the Wild

arXiv 2005.06557 ↗First posted 13 May 2020cs.CLcited by 45

Not on the map. Why?

Abstract (arXiv)

We present QADI, an automatically collected dataset of tweets belonging to a wide range of country-level Arabic dialects -covering 18 different countries in the Middle East and North Africa region. Our method for building this dataset relies on applying multiple filters to identify users who belong to different countries based on their account descriptions and to eliminate tweets that are either written in Modern Standard Arabic or contain inappropriate language. The resultant dataset contains 540k tweets from 2,525 users who are evenly distributed across 18 Arab countries. Using intrinsic evaluation, we show that the labels of a set of randomly selected tweets are 91.5% accurate. For extrinsic evaluation, we are able to build effective country-level dialect identification on tweets with a macro-averaged F1-score of 60.6% across 18 classes.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 8; 2023: 7; 2024: 9; 2025: 6; 2026: 8.

45 papers.

Sort:

By area:

  1. 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 118
  2. 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
  3. 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
  4. 2022ORCA: A Challenging Benchmark for Arabic Language Understandingcited by 46
  5. 2024AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMscited by 46
  6. 2021Pre-Training BERT on Arabic Tweets: Practical Considerationscited by 39
  7. 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
  8. 2023GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLPcited by 37
  9. 2023NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Taskcited by 29
  10. 2024Goldfish: Monolingual Language Models for 350 Languagescited by 27
  11. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  12. 2023ALDi: Quantifying the Arabic Level of Dialectness of Textcited by 24
33 more
  1. 2022NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Taskcited by 23
  2. 2024NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Taskcited by 23
  3. 2023LAraBench: Benchmarking Arabic AI with Large Language Modelscited by 16
  4. 2024EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Modelscited by 16
  5. 2022Emojis as Anchors to Detect Arabic Offensive Language and Hate Speechcited by 14
  6. 2023Arabic Dialect Identification under Scrutiny: Limitations of Single-label Classificationcited by 13
  7. 2024Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialectcited by 13
  8. 2024Exploiting Dialect Identification in Automatic Dialectal Text Normalizationcited by 7
  9. 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Taskcited by 7
  10. 2022Corpus-Guided Contrast Sets for Morphosyntactic Feature Detection in Low-Resource English Varietiescited by 6
  11. 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
  12. 2021Similarities between Arabic Dialects: Investigating Geographical Proximitycited by 5
  13. 2021Cross-lingual Emotion Detectioncited by 5
  14. 2024Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language Modelscited by 5
  15. 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
  16. 2021Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Taskcited by 4
  17. 2022ArCovidVac: Analyzing Arabic Tweets About COVID-19 Vaccinationcited by 3
  18. 2023Towards spoken dialect identification of Irishcited by 3
  19. 2022ArabGend: Gender Analysis and Inference on Arabic Twittercited by 2
  20. 2022Meta AI at Arabic Hate Speech 2022: MultiTask Learning with Self-Correction for Hate Speech Classificationcited by 2
  21. 2022A Benchmark Study of Contrastive Learning for Arabic Social Meaningcited by 2
  22. 2025Revisiting Common Assumptions about Arabic Dialects in NLPcited by 2
  23. 2026Tarab: A Multi-Dialect Corpus of Arabic Lyrics and Poetrycited by 2
  24. 2024On the importance of Data Scale in Pretraining Arabic Language Modelscited by 0
  25. 2025Arabic Dialect Classification using RNNs, Transformers, and Large Language Models: A Comparative Analysiscited by 0
  26. 2025Computational Linguistics Meets Libyan Dialect: A Study on Dialect Identificationcited by 0
  27. 2026Moonworks Lunara Aesthetic Datasetcited by 0
  28. 2026Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Modelscited by 0
  29. 2026Ramsa: A Large Sociolinguistically Rich Emirati Arabic Speech Corpus for ASR and TTScited by 0
  30. 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialoguescited by 0
  31. 2026Learning the Arabic Dialect Continuum as a Continuous Space: A Regression Approach to Speaker Origin Predictioncited by 0
  32. 2026ArabicDialectSafety: A Dialect-Aware Benchmark for Arabic Content Safety Classificationcited by 0
  33. 2026Enemray: Toward Capable Language Models for Hassaniyacited by 0