mlsanityData to 7 Oct 2026

NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Task

arXiv 2407.04910 ↗First posted 6 Jul 2024cs.CL cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

We describe the findings of the fifth Nuanced Arabic Dialect Identification Shared Task (NADI 2024). NADI's objective is to help advance SoTA Arabic NLP by providing guidance, datasets, modeling opportunities, and standardized evaluation conditions that allow researchers to collaboratively compete on pre-specified tasks. NADI 2024 targeted both dialect identification cast as a multi-label task (Subtask~1), identification of the Arabic level of dialectness (Subtask~2), and dialect-to-MSA machine translation (Subtask~3). A total of 51 unique teams registered for the shared task, of whom 12 teams have participated (with 76 valid submissions during the test phase). Among these, three teams participated in Subtask~1, three in Subtask~2, and eight in Subtask~3. The winning teams achieved 50.57 Ftextsubscript1 on Subtask~1, 0.1403 RMSE for Subtask~2, and 20.44 BLEU in Subtask~3, respectively. Results show that Arabic dialect processing tasks such as dialect identification and machine translation remain challenging. We describe the methods employed by the participating teams and briefly offer an outlook for NADI.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 23 of its 69 references that are in the map. First posted on arXiv 6 Jul 2024.

Builds on

23 of 69 references.

References · 23

  1. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  2. 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
  3. 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 164
  4. 2021To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translationcited by 161
  5. 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
  6. 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claudecited by 57
  7. 2020NADI 2020: The First Nuanced Arabic Dialect Identification Shared Taskcited by 47
  8. 2022ORCA: A Challenging Benchmark for Arabic Language Understandingcited by 46
  9. 2020Arabic Dialect Identification in the Wildcited by 45
  10. 2021NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Taskcited by 32
  11. 2023NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Taskcited by 29
  12. 2022AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarizationcited by 24
11 more
  1. 2023ALDi: Quantifying the Arabic Level of Dialectness of Textcited by 24
  2. 2018Arap-Tweet: A Large Multi-Dialect Twitter Corpus for Gender, Age and Language Variety Identificationcited by 23
  3. 2022NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Taskcited by 23
  4. 2023Dolphin: A Challenging and Diverse Benchmark for Arabic NLGcited by 22
  5. 2016A Large Scale Corpus of Gulf Arabiccited by 17
  6. 2023TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varietiescited by 16
  7. 2023On the Robustness of Arabic Speech Dialect Identificationcited by 13
  8. 2023Arabic Dialect Identification under Scrutiny: Limitations of Single-label Classificationcited by 13
  9. 2023CODET: A Benchmark for Contrastive Dialectal Evaluation of Machine Translationcited by 9
  10. 2023A Parameter-Efficient Learning Approach to Arabic Dialect Identification with Pre-Trained General-Purpose Speech Modelcited by 8
  11. 2023Yet Another Model for Arabic Dialect Identificationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 10; 2026: 9.

23 papers.

Sort:

  1. 2024Casablanca: Data and Models for Multidialectal Arabic Speech Recognitioncited by 20
  2. 2025Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMscited by 15
  3. 2024AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabiccited by 11
  4. 2024Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarkscited by 10
  5. 2025Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asiacited by 8
  6. 2025Advancing Dialectal Arabic to Modern Standard Arabic Machine Translationcited by 6
  7. 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
  8. 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
  9. 2026LQM: Linguistically Motivated Multidimensional Quality Metrics for Machine Translationcited by 3
  10. 2025Multi-label Scandinavian Language Identification (SLIDE)cited by 2
  11. 2025Revisiting Common Assumptions about Arabic Dialects in NLPcited by 2
  12. 2025Ara-HOPE: Human-Centric Post-Editing Evaluation for Dialectal Arabic to Modern Standard Arabic Translationcited by 2
11 more
  1. 2025The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectnesscited by 1
  2. 2026ARCADE: A City-Scale Corpus for Fine-Grained Arabic Dialect Taggingcited by 1
  3. 2026Aslema at NADI 2026: Data Augmentation for Intent Recognition and Slot Fillingcited by 1
  4. 2024dzNLP at NADI 2024 Shared Task: Multi-Classifier Ensemble with Weighted Voting and TF-IDF Featurescited by 0
  5. 2025Exploring Data and Parameter Efficient Strategies for Arabic Dialect Identificationscited by 0
  6. 2026Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Modelscited by 0
  7. 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Surveycited by 0
  8. 2026Context-Aware Dialectal Arabic Machine Translation with Interactive Region and Register Selectioncited by 0
  9. 2026Learning the Arabic Dialect Continuum as a Continuous Space: A Regression Approach to Speaker Origin Predictioncited by 0
  10. 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Taskcited by 0
  11. 2026BARRAC: Adaptation of an English Aspect-based Sentiment Analysis Approach for Classification Tasks in Arabic Dialectscited by 0