mlsanityData to 7 Oct 2026

Toxic language detection: a systematic review of Arabic datasets

arXiv 2312.07228 ↗First posted 12 Dec 2023cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

The detection of toxic language in the Arabic language has emerged as an active area of research in recent years, and reviewing the existing datasets employed for training the developed solutions has become a pressing need. This paper offers a comprehensive survey of Arabic datasets focused on online toxic language. We systematically gathered a total of 54 available datasets and their corresponding papers and conducted a thorough analysis, considering 18 criteria across four primary dimensions: availability details, content, annotation process, and reusability. This analysis enabled us to identify existing gaps and make recommendations for future research works. For the convenience of the research community, the list of the analysed datasets is maintained in a GitHub repository (https://github.com/Imene1/Arabic-toxic-language).

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 45 of its 127 references that are in the map. First posted on arXiv 12 Dec 2023.

Builds on

45 of 127 references.

References · 45

  1. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
  2. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
  3. 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
  4. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
  5. 2022Towards a Cleaner Document-Oriented Multilingual Crawled Corpuscited by 143
  6. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
  7. 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
  8. 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
  9. 2017Deceiving Google's Perspective API Built for Detecting Toxic Commentscited by 99
  10. 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
  11. 2018Thou shalt not hate: Countering Online Hate Speechcited by 64
  12. 2023SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)cited by 52
33 more
  1. 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
  2. 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
  3. 2022ORCA: A Challenging Benchmark for Arabic Language Understandingcited by 46
  4. 2022Handling and Presenting Harmful Text in NLP Researchcited by 43
  5. 2020Fighting the COVID-19 Infodemic in Social Media: A Holistic Perspective and a Call to Armscited by 41
  6. 2023Analyzing Dataset Annotation Quality Management in the Wildcited by 39
  7. 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 32
  8. 2020Arabic Offensive Language on Twitter: Analysis and Experimentscited by 28
  9. 2021"Garbage In, Garbage Out" Revisited: What Do Machine Learning Application Papers Report About Human-Labeled Training Data?cited by 24
  10. 2020Countering hate on social media: Large scale classification of hate and counter speechcited by 22
  11. 2022Perplexed by Quality: A Perplexity-based Method for Adult and Harmful Content Detection in Multilingual Heterogeneous Web Datacited by 22
  12. 2021Masader: Metadata Sourcing for Arabic Text and Speech Data Resourcescited by 20
  13. 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
  14. 2013Arabizi Detection and Conversion to Arabiccited by 16
  15. 2021Let-Mi: An Arabic Levantine Twitter Dataset for Misogynistic Languagecited by 15
  16. 2021Findings of the NLP4IF-2021 Shared Tasks on Fighting the COVID-19 Infodemic and Censorship Detectioncited by 14
  17. 2022Emojis as Anchors to Detect Arabic Offensive Language and Hate Speechcited by 14
  18. 2022Towards Responsible Natural Language Annotation for the Varieties of Arabiccited by 14
  19. 2020Understanding and Detecting Dangerous Speech in Social Mediacited by 12
  20. 2020Impact and dynamics of hate and counter speech onlinecited by 11
  21. 2018Degree based Classification of Harmful Speech using Twitter Datacited by 8
  22. 2022Masader Plus: A New Interface for Exploring +500 Arabic NLP Datasetscited by 8
  23. 2023Cyberbullying Detection for Low-resource Languages and Dialects: Review of the State of the Artcited by 8
  24. 2021A Second Pandemic? Analysis of Fake News About COVID-19 Vaccines in Qatarcited by 5
  25. 2018Automatic Detection of Online Jihadist Hate Speechcited by 4
  26. 2022Offensive Language Detection in Under-resourced Algerian Dialectal Arabic Languagecited by 4
  27. 2022Which one is more toxic? Findings from Jigsaw Rate Severity of Toxic Commentscited by 4
  28. 2022Deradicalizing YouTube: Characterization, Detection, and Personalization of Religiously Intolerant Arabic Videoscited by 4
  29. 2023Enriching the NArabizi Treebank: A Multifaceted Approach to Supporting an Under-Resourced Languagecited by 4
  30. 2019Hateful People or Hateful Bots? Detection and Characterization of Bots Spreading Religious Hatred in Arabic Social Mediacited by 3
  31. 2021A feast for trolls -- Engagement analysis of counternarratives against online toxicitycited by 3
  32. 2023Transformers and Ensemble methods: A solution for Hate Speech Detection in Arabic languagescited by 2
  33. 2021TEET! Tunisian Dataset for Toxic Speech Detectioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.

  1. 2024Arabic Dataset for LLM Safeguard Evaluationcited by 17
  2. 2025Towards Inclusive Toxic Content Moderation: Addressing Vulnerabilities to Adversarial Attacks in Toxicity Classifiers Tackling LLM-generated Contentcited by 0
  3. 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Modelscited by 0