An Explainable System for Offensive Content Detection in Nastaliq Urdu: Corpus Curation, Transformer Benchmarking, and Word-Level Attribution
Not on the map. Why?
Abstract (arXiv)
Automated moderation systems are deployed at scale, yet they remain opaque to the users and moderators affected by their decisions, and their coverage is almost entirely confined to English. For Urdu written in the Nastaliq script, no such system exists, and the annotated resources it would be built on are drawn largely from Twitter/X, where character limits constrain how users write. Interpretability has received little attention, leaving it unclear what such models actually learn. This study addresses these gaps in three steps. First, we curate and publicly release a corpus of 7604 Nastaliq Urdu Facebook comments, extending an earlier corpus by correcting text-level inconsistencies and re-examining the original labels. Second, we fine-tune four Urdu-capable transformers under a common grid-search protocol and compare them against twelve feature-classifier baselines on identical data partitions. The best configuration, Multilingual Representations for Indian Languages (MuRIL), reaches 87.05% accuracy and 87.06% macro F1, improving on the strongest baseline by 5.52 percentage points, a margin that exceeds the 95% confidence interval on test accuracy; the two leading transformers differ by less than the test set can resolve, and performance is stable across five optimizers. Third, we compute word-level SHAP attributions adapted to right-to-left rendering. Attribution mass concentrates on high-frequency slurs but extends to syntactically neutral function words and to political vocabulary characteristic of the source pages, indicating that aggregate performance may rest partly on lexical and topical regularities rather than a generalizable representation of offensiveness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 66 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
22 of 66 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 367
- 2018Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learningcited by 207
- 2017Interpretable Convolutional Neural Networkscited by 162
- 2020Offensive Language Identification in Greekcited by 50
- 2019Offensive Language and Hate Speech Detection for Danishcited by 49
10 more
- 2022TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twittercited by 45
- 2020Arabic Offensive Language on Twitter: Analysis and Experimentscited by 29
- 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 27
- 2017Simple rules for complex decisionscited by 15
- 2019Balancing the Tradeoff Between Clustering Value and Interpretabilitycited by 12
- 2022Greybox XAI: a Neural-Symbolic learning framework to produce interpretable predictions for image classificationcited by 12
- 2021AcME -- Accelerated Model-agnostic Explanations: Fast Whitening of the Machine-Learning Black Boxcited by 9
- 2024HateCOT: An Explanation-Enhanced Dataset for Generalizable Offensive Speech Detection via Large Language Modelscited by 5
- 2024Chinese Offensive Language Detection:Current Status and Future Directionscited by 5
- 2022Abusive and Threatening Language Detection in Urdu using Supervised Machine Learning and Feature Combinationscited by 2
Built on by
Not cited yet.