ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Content
Not on the map. Why?
Abstract (arXiv)
We present an overview of the second edition of the ArAIEval shared task, organized as part of the ArabicNLP 2024 conference co-located with ACL 2024. In this edition, ArAIEval offers two tasks: (i) detection of propagandistic textual spans with persuasion techniques identification in tweets and news articles, and (ii) distinguishing between propagandistic and non-propagandistic memes. A total of 14 teams participated in the final evaluation phase, with 6 and 9 teams participating in Tasks 1 and 2, respectively. Finally, 11 teams submitted system description papers. Across both tasks, we observed that fine-tuning transformer models such as AraBERT was at the core of the majority of the participating systems. We provide a description of the task setup, including a description of the dataset construction and the evaluation setup. We further provide a brief overview of the participating systems. All datasets and evaluation scripts are released to the research community (https://araieval.gitlab.io/). We hope this will enable further research on these important tasks in Arabic.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 15 of its 41 references that are in the map. First posted on arXiv 5 Jul 2024.
Builds on
15 of 41 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
- 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 164
- 2019Fine-Grained Analysis of Propaganda in News Articlescited by 130
- 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 118
- 2020KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Mediacited by 84
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2018Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learningcited by 43
- 2024Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articlescited by 21
- 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Textcited by 19
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 4.
11 papers.
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMscited by 8
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memescited by 8
- 2025PropXplain: Can LLMs Enable Explainable Propaganda Detection?cited by 7
- 2026MemeLens: Multilingual Multitask VLMs for Memescited by 5
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
- 2025Arabic Multimodal Machine Learning: Datasets, Applications, Approaches, and Challengescited by 1
- 2024MemeMind at ArAIEval Shared Task: Spotting Persuasive Spans in Arabic Text with Persuasion Techniques Identificationcited by 0
- 2025Detecting Hope, Hate, and Emotion in Arabic Textual Speech and Multi-modal Memes Using Large Language Modelscited by 0
- 2026AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memescited by 0
- 2026ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Promptscited by 0
- 2026ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts24 Sep 2026
- 2026AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memes29 Jul 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026MemeLens: Multilingual Multitask VLMs for Memes18 Jan 2026
- 2025Arabic Multimodal Machine Learning: Datasets, Applications, Approaches, and Challenges17 Aug 2025
- 2025Detecting Hope, Hate, and Emotion in Arabic Textual Speech and Multi-modal Memes Using Large Language Models15 Aug 2025
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memes23 Feb 2025
- 2025PropXplain: Can LLMs Enable Explainable Propaganda Detection?23 Feb 2025
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMs11 Sep 2024
- 2024MemeMind at ArAIEval Shared Task: Spotting Persuasive Spans in Arabic Text with Persuasion Techniques Identification8 Aug 2024