mlsanityData to 7 Oct 2026

Arabic Diacritics in the Wild: Exploiting Opportunities for Improved Diacritization

arXiv 2406.05760 ↗First posted 9 Jun 2024cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

The widespread absence of diacritical marks in Arabic text poses a significant challenge for Arabic natural language processing (NLP). This paper explores instances of naturally occurring diacritics, referred to as "diacritics in the wild," to unveil patterns and latent information across six diverse genres: news articles, novels, children's books, poetry, political documents, and ChatGPT outputs. We present a new annotated dataset that maps real-world partially diacritized words to their maximal full diacritization in context. Additionally, we propose extensions to the analyze-and-disambiguate approach in Arabic NLP to leverage these diacritics, resulting in notable improvements. Our contributions encompass a thorough analysis, valuable datasets, and an extended diacritization algorithm. We release our code and datasets as open source.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 18 of its 57 references that are in the map. First posted on arXiv 9 Jun 2024.

Builds on

18 of 57 references.

References · 18

  1. 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigationcited by 22
  2. 2019Arabic Text Diacritization Using Deep Neural Networkscited by 18
  3. 2021Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its Dialectscited by 14
  4. 2019Learning meters of Arabic and English poems with Recurrent Neural Networks: a step forward for language understanding and synthesiscited by 13
  5. 2019Joint Diacritization, Lemmatization, Normalization, and Fine-Grained Morphological Taggingcited by 12
  6. 2020A Multitask Learning Approach for Diacritic Restorationcited by 12
  7. 2019Neural Arabic Text Diacritization: State of the Art Results and a Novel Approach for Machine Translationcited by 11
  8. 2020Deep Diacritization: Efficient Hierarchical Recurrence for Improved Arabic Diacritizationcited by 11
  9. 2022Camelira: An Arabic Multi-Dialect Morphological Disambiguatorcited by 10
  10. 2019Adversarial Multitask Learning for Joint Multi-Feature and Multi-Dialect Morphological Modelingcited by 9
  11. 2020Arabic Diacritic Recovery Using a Feature-Rich biLSTM Modelcited by 7
  12. 2022NatiQ: An End-to-end Text-to-Speech System for Arabiccited by 7
6 more
  1. 2021Improving Arabic Diacritization by Learning to Diacritize and Translatecited by 6
  2. 2019Homograph Disambiguation Through Selective Diacritic Restorationcited by 5
  3. 2021Automatic Romanization of Arabic Bibliographic Recordscited by 3
  4. 2018Diacritization of Maghrebi Arabic Sub-Dialectscited by 2
  5. 2023Take the Hint: Improving Arabic Diacritization with Partially-Diacritized Textcited by 2
  6. 2024A Context-Contrastive Inference Approach To Partial Diacritizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 1.

8 papers.

  1. 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Taskcited by 7
  2. 2024Guidelines for Fine-grained Sentence-level Arabic Readability Annotationcited by 3
  3. 2025Abjad AI at NADI 2025: CATT-Whisper: Multimodal Diacritic Restoration Using Text and Speech Representationscited by 3
  4. 2025Proper Noun Diacritization for Arabic Wikipedia: A Benchmark Datasetcited by 1
  5. 2025A Tale of Two Scripts: Transliteration and Post-Correction for Judeo-Arabiccited by 1
  6. 2025Lemmatization as a Classification Task: Results from Arabic across Multiple Genrescited by 0
  7. 2025Hebrew Diacritics Restoration using Visual Representationcited by 0
  8. 2026SHAMS: An Audio-Grounded Pronunciation Benchmark for Levantine Arabiccited by 0