From Triage to Impact: A Multi-Hop Reasoning Benchmark for Explainable Persian Hate Speech
New in LLM reasoning; no direction yet. LLM reasoning
Abstract (arXiv)
Hate speech has become increasingly prevalent on social media, raising concerns about its detection, interpretation, and moderation. Persian, a relatively low-resource language, lacks sufficient annotated data and computational resources for fine-grained hate speech analysis. In this study, we introduce a fine-grained, multi-hop benchmark for explainable Persian hate speech analysis, covering content triage, target identification, hate tactic and moral foundation analysis, textual evidence extraction, harmful narrative inference, and severity assessment. By evaluating state-of-the-art large language models (LLMs), we find that performance generally declines as tasks require more fine-grained semantic and inferential reasoning. Proprietary models generally outperform open-weight models, while reasoning-oriented models show no consistent advantage. Incorporating intermediate reasoning steps substantially improves severity prediction compared with one-shot assessment. Our analysis further reveals that Incitement to Violence or Harm is most strongly associated with higher severity, while political-affiliation targets are particularly associated with subversion-based moral framing. Overall, this work provides insights into LLM-based hate speech analysis and supports more accountable moderation of Persian-language social media. The benchmark is publicly available at https://github.com/kalhorghazal/From-Triage-to-Impact.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 26 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
6 of 26 references.
References · 6
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2020ParsBERT: Transformer-based Model for Persian Language Understandingcited by 93
- 2024From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasetscited by 25
- 2025MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanationcited by 8
- 2025Culture Matters in Toxic Language Detection in Persiancited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026X-MuTeST: A Multilingual Benchmark for Explainable Hate Speech Detection and A Novel LLM-consulted Explanation Framework
- 2023Probing LLMs for hate speech detection: strengths and vulnerabilities
- 2023HateRephrase: Zero- and Few-Shot Reduction of Hate Intensity in Online Posts using Large Language Models
- 2025HatePrototypes: Interpretable and Transferable Representations for Implicit and Explicit Hate Speech Detection
- 2025Rethinking Hate Speech Detection on Social Media: Can LLMs Replace Traditional Models?
- 2023HARE: Explainable Hate Speech Detection with Step-by-Step Reasoning
- 2023Revisiting Hate Speech Benchmarks: From Data Curation to System Deployment
- 2023THOS: A Benchmark Dataset for Targeted Hate and Offensive Speech