mlsanityData to 7 Oct 2026

Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

arXiv 2103.01065 ↗First posted 1 Mar 2021cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

In this paper, we tackle the Nuanced Arabic Dialect Identification (NADI) shared task (Abdul-Mageed et al., 2021) and demonstrate state-of-the-art results on all of its four subtasks. Tasks are to identify the geographic origin of short Dialectal (DA) and Modern Standard Arabic (MSA) utterances at the levels of both country and province. Our final model is an ensemble of variants built on top of MARBERT that achieves an F1-score of 34.03% for DA at the country-level development set -- an improvement of 7.63% from previous work.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 11 of its 18 references that are in the map. First posted on arXiv 1 Mar 2021.

Builds on

11 of 18 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  4. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
  5. 2020AdapterHub: A Framework for Adapting Transformerscited by 441
  6. 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
  7. 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 239
  8. 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 164
  9. 2020NADI 2020: The First Nuanced Arabic Dialect Identification Shared Taskcited by 47
  10. 2020Arabic Dialect Identification in the Wildcited by 45
  11. 2020Multi-Dialect Arabic BERT for Country-Level Dialect Identificationcited by 15

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 0; 2025: 1.

4 papers.

  1. 2021NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Taskcited by 32
  2. 2022Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classificationcited by 9
  3. 2025Revisiting Common Assumptions about Arabic Dialects in NLPcited by 2
  4. 2023Mavericks at NADI 2023 Shared Task: Unravelling Regional Nuances through Dialect Identification using Transformer-based Approachcited by 0