mlsanityData to 7 Oct 2026

1.5 billion words Arabic Corpus

arXiv 1611.04033 ↗First posted 12 Nov 2016cs.CL cs.DL cs.IRcited by 35

Not on the map. Why?

Abstract (arXiv)

This study is an attempt to build a contemporary linguistic corpus for Arabic language. The corpus produced, is a text corpus includes more than five million newspaper articles. It contains over a billion and a half words in total, out of which, there is about three million unique words. The data were collected from newspaper articles in ten major news sources from eight Arabic countries, over a period of fourteen years. The corpus was encoded with two types of encoding, namely: UTF-8, and Windows CP-1256. Also it was marked with two mark-up languages, namely: SGML, and XML.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Nov 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 9; 2022: 7; 2023: 11; 2024: 5; 2025: 1; 2026: 2.

35 papers.

Sort:

By area:

  1. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  2. 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
  3. 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 118
  4. 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
  5. 2022ORCA: A Challenging Benchmark for Arabic Language Understandingcited by 46
  6. 2021Pre-Training BERT on Arabic Tweets: Practical Considerationscited by 39
  7. 2022Wojood: Nested Arabic Named Entity Corpus and Recognition using BERTcited by 32
  8. 2024Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarkscited by 32
  9. 2021ZEN 2.0: Continue Training and Adaption for N-gram Enhanced Text Encoderscited by 22
  10. 2021Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extractioncited by 16
  11. 2021Evaluating Various Tokenizers for Arabic Text Classificationcited by 14
  12. 2022JASMINE: Arabic GPT Models for Few-Shot Learningcited by 11
23 more
  1. 2024Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarkscited by 10
  2. 2023A Transformer-based Approach for Arabic Offline Handwritten Text Recognitioncited by 9
  3. 2023A Parameter-Efficient Learning Approach to Arabic Dialect Identification with Pre-Trained General-Purpose Speech Modelcited by 8
  4. 2023ArBanking77: Intent Detection Neural Model and a New Dataset in Modern and Dialectical Arabiccited by 8
  5. 2024AraPoemBERT: A Pretrained Language Model for Arabic Poetry Analysiscited by 8
  6. 2023Revisiting Entropy Rate Constancy in Textcited by 7
  7. 2023AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processingcited by 7
  8. 2024SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corporacited by 7
  9. 2021On the Role of Images for Analyzing Claims in Social Mediacited by 6
  10. 2023Octopus: A Multitask Model and Toolkit for Arabic Natural Language Generationcited by 6
  11. 2024EgyBERT: A Large Language Model Pretrained on Egyptian Dialect Corporacited by 5
  12. 2021Transformers to Fight the COVID-19 Infodemiccited by 4
  13. 2022Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understandingcited by 2
  14. 2026Revisiting Data Compression with Language Modelingcited by 2
  15. 2022Post-hoc analysis of Arabic transformer modelscited by 1
  16. 2023Ashaar: Automatic Analysis and Generation of Arabic Poetry Using Deep Learning Approachescited by 1
  17. 2025Towards the Development of Balanced Synthetic Data for Correcting Grammatical Errors in Arabic: An Approach Based on Error Tagging Model and Synthetic Data Generating Modelcited by 1
  18. 2021New Arabic Medical Dataset for Diseases Classificationcited by 0
  19. 2022Interpreting Arabic Transformer Modelscited by 0
  20. 2022A Large and Diverse Arabic Corpus for Language Modelingcited by 0
  21. 2023ANER: Arabic and Arabizi Named Entity Recognition using Transformer-Based Approachcited by 0
  22. 2023Dotless Representation of Arabic Text: Analysis and Modelingcited by 0
  23. 2026CANDLE: CTC-based Arabic Noisy-character Deduplication using a Lightweight Encodercited by 0