Language, Culture, and Ideology: Personalizing Offensiveness Detection in Political Tweets with Reasoning LLMs
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
We explore how large language models (LLMs) assess offensiveness in political discourse when prompted to adopt specific political and cultural perspectives. Using a multilingual subset of the MD-Agreement dataset centered on tweets from the 2020 US elections, we evaluate several recent LLMs - including DeepSeek-R1, o4-mini, GPT-4.1-mini, Qwen3, Gemma, and Mistral - tasked with judging tweets as offensive or non-offensive from the viewpoints of varied political personas (far-right, conservative, centrist, progressive) across English, Polish, and Russian contexts. Our results show that larger models with explicit reasoning abilities (e.g., DeepSeek-R1, o4-mini) are more consistent and sensitive to ideological and cultural variation, while smaller models often fail to capture subtle distinctions. We find that reasoning capabilities significantly improve both the personalization and interpretability of offensiveness judgments, suggesting that such mechanisms are key to adapting LLMs for nuanced sociopolitical text classification across languages and ideologies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 25 of its 65 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
25 of 65 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2023Mistral 7Bcited by 3,164
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
- 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 207
12 more
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
- 2019On the Apparent Conflict Between Individual and Group Fairnesscited by 126
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
- 2021Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreementcited by 72
- 2023"HOT" ChatGPT: The promise of ChatGPT in detecting and discriminating hateful, offensive, and toxic comments on social mediacited by 45
- 2021MUDES: Multilingual Detection of Offensive Spanscited by 30
- 2023Disentangling Perceptions of Offensiveness: Cultural and Moral Correlatescited by 26
- 2021Multilingual Offensive Language Identification for Low-resource Languagescited by 22
- 2023Modeling Uncertainty in Personalized Emotion Prediction with Normalizing Flowscited by 5
- 2023Towards Model-Based Data Acquisition for Subjective Multi-Task NLP Problemscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Are LLMs Enough for Hyperpartisan, Fake, Polarized and Harmful Content Detection? Evaluating In-Context Learning vs. Fine-Tuning
- 2025Confident, Calibrated, or Complicit: Safety Alignment and Ideological Bias in LLM Hate Speech Detection
- 2026Political Alignment in Large Language Models: A Multidimensional Audit of Psychometric Identity and Behavioral Bias
- 2026LLM-Ideoplasticity: Measuring Ideological Plasticity in the Political Behavior of LLMs as a Context-Conditioned Distribution
- 2026LinGO: A Linguistic Graph Optimization Framework with LLMs for Interpreting Intents of Online Uncivil Discourse
- 2026LLMs Can Infer Political Alignment from Online Conversations
- 2025Generative Exaggeration in LLM Social Agents: Consistency, Bias, and Toxicity
- 2025Steering Towards Fairness: Mitigating Political Bias in LLMs