Multi-task Learning with Active Learning for Arabic Offensive Speech Detection
Not on the map. Why?
Abstract (arXiv)
The rapid growth of social media has amplified the spread of offensive, violent, and vulgar speech, which poses serious societal and cybersecurity concerns. Detecting such content in Arabic text is particularly complex due to limited labeled data, dialectal variations, and the language's inherent complexity. This paper proposes a novel framework that integrates multi-task learning (MTL) with active learning to enhance offensive speech detection in Arabic social media text. By jointly training on two auxiliary tasks, violent and vulgar speech, the model leverages shared representations to improve the detection accuracy of the offensive speech. Our approach dynamically adjusts task weights during training to balance the contribution of each task and optimize performance. To address the scarcity of labeled data, we employ an active learning strategy through several uncertainty sampling techniques to iteratively select the most informative samples for model training. We also introduce weighted emoji handling to better capture semantic cues. Experimental results on the OSACT2022 dataset show that the proposed framework achieves a state-of-the-art macro F1-score of 85.42%, outperforming existing methods while using significantly fewer fine-tuning samples. The findings of this study highlight the potential of integrating MTL with active learning for efficient and accurate offensive language detection in resource-constrained settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 71 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
20 of 71 references.
References · 20
- 2017A Survey on Multi-Task Learningcited by 840
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 375
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
- 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
- 2018Deep Bayesian Active Learning for Natural Language Processing: Results of a Large-Scale Empirical Studycited by 90
- 2020KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Mediacited by 84
- 2020Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Datacited by 50
- 2022Emotion Based Hate Speech Detection using Multimodal Learningcited by 18
- 2022Emojis as Anchors to Detect Arabic Offensive Language and Hate Speechcited by 14
- 2020OSACT4 Shared Task on Offensive Language Detection: Intensive Preprocessing-Based Approachcited by 11
8 more
- 2020Leveraging Affective Bidirectional Transformers for Offensive Language Detectioncited by 11
- 2022Active learning using adaptable task-based prioritisationcited by 6
- 2021Exploring multi-task multi-lingual learning of transformer models for hate speech and offensive speech identification in social mediacited by 5
- 2019Empirical Evaluation of Multi-task Learning in Deep Neural Networks for Natural Language Processingcited by 4
- 2020SalamNET at SemEval-2020 Task12: Deep Learning Approach for Arabic Offensive Language Detectioncited by 3
- 2022AlexU-AIC at Arabic Hate Speech 2022: Contrast to Classifycited by 3
- 2022Explainable and High-Performance Hate and Offensive Speech Detectioncited by 2
- 2024MHS-STMA: Multimodal Hate Speech Detection via Scalable Transformer-Based Multilevel Attention Frameworkcited by 2
Built on by
Not cited yet.