ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Text
Not on the map. Why?
Abstract (arXiv)
We present an overview of the ArAIEval shared task, organized as part of the first ArabicNLP 2023 conference co-located with EMNLP 2023. ArAIEval offers two tasks over Arabic text: (i) persuasion technique detection, focusing on identifying persuasion techniques in tweets and news articles, and (ii) disinformation detection in binary and multiclass setups over tweets. A total of 20 teams participated in the final evaluation phase, with 14 and 16 teams participating in Tasks 1 and 2, respectively. Across both tasks, we observed that fine-tuning transformer models such as AraBERT was at the core of the majority of the participating systems. We provide a description of the task setup, including a description of the dataset construction and the evaluation setup. We further give a brief overview of the participating systems. All datasets and evaluation scripts from the shared task are released to the research community. (https://araieval.gitlab.io/) We hope this will enable further research on these important tasks in Arabic.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 22 of its 52 references that are in the map. First posted on arXiv 6 Nov 2023.
Builds on
22 of 52 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
- 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 166
- 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
- 2019Fine-Grained Analysis of Propaganda in News Articlescited by 133
- 2020KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Mediacited by 84
- 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 81
- 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
10 more
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 50
- 2020AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understandingcited by 43
- 2021Pre-Training BERT on Arabic Tweets: Practical Considerationscited by 39
- 2017Argotario: Computational Argumentation Meets Serious Gamescited by 30
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2023QCRI at SemEval-2023 Task 3: News Genre, Framing and Persuasion Techniques Detection using Multilingual Modelscited by 5
- 2023Detecting and Reasoning of Deleted Tweets before they are Postedcited by 4
- 2023Legend at ArAIEval Shared Task: Persuasion Technique Detection using a Language-Agnostic Text Representation Modelcited by 4
- 2022ArCovidVac: Analyzing Arabic Tweets About COVID-19 Vaccinationcited by 3
Built on by
Citing papers per year: 2023: 4; 2024: 9; 2025: 3; 2026: 3.
19 papers.
Sort:
By area:
- 2024Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articlescited by 21
- 2023Large Language Models for Propaganda Span Annotationcited by 19
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Contentcited by 11
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memescited by 10
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMscited by 8
- 2025PropXplain: Can LLMs Enable Explainable Propaganda Detection?cited by 8
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Contentcited by 6
- 2023Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognitioncited by 5
- 2024ArMeme: Propagandistic Content in Arabic Memescited by 5
- 2023USTHB at NADI 2023 shared task: Exploring Preprocessing and Feature Engineering Strategies for Arabic Dialect Identificationcited by 3
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
7 more
- 2023Mavericks at ArAIEval Shared Task: Towards a Safer Digital Space -- Transformer Ensemble Models Tackling Deception and Persuasioncited by 1
- 2024A Roadmap for Multilingual, Multimodal Domain Independent Deception Detectioncited by 1
- 2024Investigating Persuasion Techniques in Arabic: An Empirical Study Leveraging Large Language Modelscited by 1
- 2024Nullpointer at ArAIEval Shared Task: Arabic Propagandist Technique Detection with Token-to-Word Mapping in Sequence Taggingcited by 1
- 2024MemeMind at ArAIEval Shared Task: Spotting Persuasive Spans in Arabic Text with Persuasion Techniques Identificationcited by 0
- 2026From Emotion to Expression: Theoretical Foundations and Resources for Fear Speechcited by 0
- 2026ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Promptscited by 0
- 2026ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts24 Sep 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026From Emotion to Expression: Theoretical Foundations and Resources for Fear Speech23 Jan 2026
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memes23 Feb 2025
- 2025PropXplain: Can LLMs Enable Explainable Propaganda Detection?23 Feb 2025
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content20 Oct 2024
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMs11 Sep 2024
- 2024MemeMind at ArAIEval Shared Task: Spotting Persuasive Spans in Arabic Text with Persuasion Techniques Identification8 Aug 2024
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Content5 Jul 2024
- 2024Nullpointer at ArAIEval Shared Task: Arabic Propagandist Technique Detection with Token-to-Word Mapping in Sequence Tagging1 Jul 2024
- 2024ArMeme: Propagandistic Content in Arabic Memes6 Jun 2024
7 more
- 2024Investigating Persuasion Techniques in Arabic: An Empirical Study Leveraging Large Language Models21 May 2024
- 2024A Roadmap for Multilingual, Multimodal Domain Independent Deception Detection7 May 2024
- 2024Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles27 Feb 2024
- 2023USTHB at NADI 2023 shared task: Exploring Preprocessing and Feature Engineering Strategies for Arabic Dialect Identification16 Dec 2023
- 2023Mavericks at ArAIEval Shared Task: Towards a Safer Digital Space -- Transformer Ensemble Models Tackling Deception and Persuasion30 Nov 2023
- 2023Large Language Models for Propaganda Span Annotation16 Nov 2023
- 2023Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition16 Nov 2023
- 2024Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articlescited by 21
- 2023Large Language Models for Propaganda Span Annotationcited by 19
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Contentcited by 11
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memescited by 10
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMscited by 8
- 2025PropXplain: Can LLMs Enable Explainable Propaganda Detection?cited by 8
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Contentcited by 6
- 2023Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognitioncited by 5
- 2024ArMeme: Propagandistic Content in Arabic Memescited by 5
- 2023USTHB at NADI 2023 shared task: Exploring Preprocessing and Feature Engineering Strategies for Arabic Dialect Identificationcited by 3
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
12 most cited of 18 All 18 (JSON)
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026From Emotion to Expression: Theoretical Foundations and Resources for Fear Speech23 Jan 2026
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memes23 Feb 2025
- 2025PropXplain: Can LLMs Enable Explainable Propaganda Detection?23 Feb 2025
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content20 Oct 2024
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMs11 Sep 2024
- 2024MemeMind at ArAIEval Shared Task: Spotting Persuasive Spans in Arabic Text with Persuasion Techniques Identification8 Aug 2024
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Content5 Jul 2024
- 2024Nullpointer at ArAIEval Shared Task: Arabic Propagandist Technique Detection with Token-to-Word Mapping in Sequence Tagging1 Jul 2024
- 2024ArMeme: Propagandistic Content in Arabic Memes6 Jun 2024
- 2024Investigating Persuasion Techniques in Arabic: An Empirical Study Leveraging Large Language Models21 May 2024
12 newest of 18 All 18 (JSON)