NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Task
Not on the map. Why?
Abstract (arXiv)
We describe the findings of the fourth Nuanced Arabic Dialect Identification Shared Task (NADI 2023). The objective of NADI is to help advance state-of-the-art Arabic NLP by creating opportunities for teams of researchers to collaboratively compete under standardized conditions. It does so with a focus on Arabic dialects, offering novel datasets and defining subtasks that allow for meaningful comparisons between different approaches. NADI 2023 targeted both dialect identification (Subtask 1) and dialect-to-MSA machine translation (Subtask 2 and Subtask 3). A total of 58 unique teams registered for the shared task, of whom 18 teams have participated (with 76 valid submissions during test phase). Among these, 16 teams participated in Subtask 1, 5 participated in Subtask 2, and 3 participated in Subtask 3. The winning teams achieved 87.27 F1 on Subtask 1, 14.76 Bleu in Subtask 2, and 21.10 Bleu in Subtask 3, respectively. Results show that all three subtasks remain challenging, thereby motivating future work in this area. We describe the methods employed by the participating teams and briefly offer an outlook for NADI.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 19 of its 70 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
19 of 70 references.
References · 19
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 509
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
- 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 276
- 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 166
- 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
- 2020NADI 2020: The First Nuanced Arabic Dialect Identification Shared Taskcited by 47
- 2022ORCA: A Challenging Benchmark for Arabic Language Understandingcited by 47
- 2020Arabic Dialect Identification in the Wildcited by 45
- 2020AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understandingcited by 43
- 2021NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Taskcited by 32
- 2022AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarizationcited by 24
7 more
- 2018Arap-Tweet: A Large Multi-Dialect Twitter Corpus for Gender, Age and Language Variety Identificationcited by 23
- 2022NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Taskcited by 23
- 2023Dolphin: A Challenging and Diverse Benchmark for Arabic NLGcited by 22
- 2016A Large Scale Corpus of Gulf Arabiccited by 17
- 2023TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varietiescited by 16
- 2020Automatic Arabic Dialect Identification Systems for Written Texts: A Surveycited by 10
- 2021Investigating Code-Mixed Modern Standard Arabic-Egyptian to English Machine Translationcited by 10
Built on by
Citing papers per year: 2023: 2; 2024: 12; 2025: 7; 2026: 8.
29 papers.
Sort:
- 2024AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMscited by 46
- 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
- 2024NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Taskcited by 23
- 2024AraFinNLP 2024: The First Arabic Financial NLP Shared Taskcited by 12
- 2024Voices Unheard: NLP Resources and Models for Yor`ub'a Regional Dialectscited by 11
- 2024AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabiccited by 11
- 2024Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarkscited by 10
- 2025Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Taskscited by 9
- 2024Exploiting Dialect Identification in Automatic Dialectal Text Normalizationcited by 7
- 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Taskcited by 7
- 2024WojoodNER 2024: The Second Arabic Named Entity Recognition Shared Taskcited by 6
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
17 more
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
- 2024Estimating the Level of Dialectness Predicts Interannotator Agreement in Multi-dialect Arabic Datasetscited by 4
- 2023USTHB at NADI 2023 shared task: Exploring Preprocessing and Feature Engineering Strategies for Arabic Dialect Identificationcited by 3
- 2026MENASpeechBank: A Reference Voice Bank with Persona-Conditioned Multi-Turn Conversations for AudioLLMscited by 3
- 2024ArabicNLU 2024: The First Arabic Natural Language Understanding Shared Taskcited by 2
- 2025Revisiting Common Assumptions about Arabic Dialects in NLPcited by 2
- 2025Dialect Normalization using Large Language Models and Morphological Rulescited by 2
- 2025The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectnesscited by 1
- 2026AlexandriaX 2026: The First Shared Task on Dialectal Arabic Machine Translationcited by 1
- 2023Mavericks at NADI 2023 Shared Task: Unravelling Regional Nuances through Dialect Identification using Transformer-based Approachcited by 0
- 2024dzNLP at NADI 2024 Shared Task: Multi-Classifier Ensemble with Weighted Voting and TF-IDF Featurescited by 0
- 2026Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Modelscited by 0
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Surveycited by 0
- 2026Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMscited by 0
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditingcited by 0
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Taskcited by 0
- 2026BARRAC: Adaptation of an English Aspect-based Sentiment Analysis Approach for Classification Tasks in Arabic Dialectscited by 0
- 2026BARRAC: Adaptation of an English Aspect-based Sentiment Analysis Approach for Classification Tasks in Arabic Dialects30 Sep 2026
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task22 Sep 2026
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026AlexandriaX 2026: The First Shared Task on Dialectal Arabic Machine Translation19 Sep 2026
- 2026Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs4 Jul 2026
- 2026Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Models12 Feb 2026
- 2026MENASpeechBank: A Reference Voice Bank with Persona-Conditioned Multi-Turn Conversations for AudioLLMs3 Feb 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Models31 Oct 2025
- 2025Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Tasks24 Sep 2025
- 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Task2 Sep 2025
- 2025The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectness24 Aug 2025
17 more
- 2025Dialect Normalization using Large Language Models and Morphological Rules10 Jun 2025
- 2025Revisiting Common Assumptions about Arabic Dialects in NLP27 May 2025
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions23 Jan 2025
- 2024AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic5 Dec 2024
- 2024Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarks2 Nov 2024
- 2024AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs17 Sep 2024
- 2024ArabicNLU 2024: The First Arabic Natural Language Understanding Shared Task30 Jul 2024
- 2024dzNLP at NADI 2024 Shared Task: Multi-Classifier Ensemble with Weighted Voting and TF-IDF Features18 Jul 2024
- 2024WojoodNER 2024: The Second Arabic Named Entity Recognition Shared Task13 Jul 2024
- 2024AraFinNLP 2024: The First Arabic Financial NLP Shared Task13 Jul 2024
- 2024NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Task6 Jul 2024
- 2024Exploiting Dialect Identification in Automatic Dialectal Text Normalization3 Jul 2024
- 2024Voices Unheard: NLP Resources and Models for Yor`ub'a Regional Dialects27 Jun 2024
- 2024Estimating the Level of Dialectness Predicts Interannotator Agreement in Multi-dialect Arabic Datasets18 May 2024
- 2024Natural Language Processing for Dialects of a Language: A Survey11 Jan 2024
- 2023USTHB at NADI 2023 shared task: Exploring Preprocessing and Feature Engineering Strategies for Arabic Dialect Identification16 Dec 2023
- 2023Mavericks at NADI 2023 Shared Task: Unravelling Regional Nuances through Dialect Identification using Transformer-based Approach30 Nov 2023
- 2024AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMscited by 46
- 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
- 2024NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Taskcited by 23
- 2024AraFinNLP 2024: The First Arabic Financial NLP Shared Taskcited by 12
- 2024Voices Unheard: NLP Resources and Models for Yor`ub'a Regional Dialectscited by 11
- 2024AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabiccited by 11
- 2024Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarkscited by 10
- 2025Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Taskscited by 9
- 2024Exploiting Dialect Identification in Automatic Dialectal Text Normalizationcited by 7
- 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Taskcited by 7
- 2024WojoodNER 2024: The Second Arabic Named Entity Recognition Shared Taskcited by 6
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
12 most cited of 29 All 29 (JSON)
- 2026BARRAC: Adaptation of an English Aspect-based Sentiment Analysis Approach for Classification Tasks in Arabic Dialects30 Sep 2026
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task22 Sep 2026
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026AlexandriaX 2026: The First Shared Task on Dialectal Arabic Machine Translation19 Sep 2026
- 2026Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs4 Jul 2026
- 2026Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Models12 Feb 2026
- 2026MENASpeechBank: A Reference Voice Bank with Persona-Conditioned Multi-Turn Conversations for AudioLLMs3 Feb 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Models31 Oct 2025
- 2025Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Tasks24 Sep 2025
- 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Task2 Sep 2025
- 2025The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectness24 Aug 2025
12 newest of 29 All 29 (JSON)