Detecting Hope, Hate, and Emotion in Arabic Textual Speech and Multi-modal Memes Using Large Language Models
Not on the map. Why?
Abstract (arXiv)
The rise of social media and online communication platforms has led to the spread of Arabic textual posts and memes as a key form of digital expression. While these contents can be humorous and informative, they are also increasingly being used to spread offensive language and hate speech. Consequently, there is a growing demand for precise analysis of content in Arabic text and memes. This paper explores the potential of large language models to effectively identify hope, hate speech, offensive language, and emotional expressions within such content. We evaluate the performance of base LLMs, fine-tuned LLMs, and pre-trained embedding models. The evaluation is conducted using a dataset of Arabic textual speech and memes proposed in the ArabicNLP MAHED 2025 challenge. The results underscore the capacity of LLMs such as GPT-4o-mini, fine-tuned with Arabic textual speech, and Gemini Flash 2.5, fine-tuned with Arabic memes, to deliver the superior performance. They achieve up to 72.1%, 57.8%, and 79.6% macro F1 scores for tasks 1, 2, and 3, respectively, and secure first place overall in the Mahed 2025 challenge. The proposed solutions offer a more nuanced understanding of both text and memes for accurate and efficient Arabic content moderation systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 29 references that are in the map. First posted on arXiv 15 Aug 2025.
Builds on
6 of 29 references.
References · 6
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Contentcited by 11
- 2024Advancing Content Moderation: Evaluating Large Language Models for Detecting Sensitive Content Across Text, Images, and Videoscited by 10
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMscited by 8
- 2024ArMeme: Propagandistic Content in Arabic Memescited by 5
- 2022AlexU-AIC at Arabic Hate Speech 2022: Contrast to Classifycited by 3
Built on by
Not cited yet.