PartisanLens: A Multilingual Dataset of Hyperpartisan and Conspiratorial Immigration Narratives in European Media
Not on the map. Why?
Abstract (arXiv)
Detecting hyperpartisan narratives and Population Replacement Conspiracy Theories (PRCT) is essential to addressing the spread of misinformation. These complex narratives pose a significant threat, as hyperpartisanship drives political polarisation and institutional distrust, while PRCTs directly motivate real-world extremist violence, making their identification critical for social cohesion and public safety. However, existing resources are scarce, predominantly English-centric, and often analyse hyperpartisanship, stance, and rhetorical bias in isolation rather than as interrelated aspects of political discourse. To bridge this gap, we introduce textscPartisanLens, the first multilingual dataset of num1617 hyperpartisan news headlines in Spanish, Italian, and Portuguese, annotated in multiple political discourse aspects. We first evaluate the classification performance of widely used Large Language Models (LLMs) on this dataset, establishing robust baselines for the classification of hyperpartisan and PRCT narratives. In addition, we assess the viability of using LLMs as automatic annotators for this task, analysing their ability to approximate human annotation. Results highlight both their potential and current limitations. Next, moving beyond standard judgments, we explore whether LLMs can emulate human annotation patterns by conditioning them on socio-economic and ideological profiles that simulate annotator perspectives. At last, we provide our resources and evaluation, textscPartisanLens supports future research on detecting partisan and conspiratorial narratives in European contexts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 63 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
23 of 63 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
- 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 348
- 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 264
- 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 81
- 2023Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Promptingcited by 81
- 2016Stance and Sentiment in Tweetscited by 62
- 2022MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Datasetcited by 61
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 61
- 2025Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotationcited by 50
11 more
- 2020Detecting Stance in Media on Global Warmingcited by 48
- 2020BanFakeNews: A Dataset for Detecting Fake News in Banglacited by 40
- 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Promptingcited by 22
- 2024Personas with Attitudes: Controlling LLMs for Diverse Data Annotationcited by 21
- 2024The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detectioncited by 15
- 2023Automated stance detection in complex topics and small languages: the challenging case of immigration in polarizing news mediacited by 14
- 2024EUvsDisinfo: A Dataset for Multilingual Detection of Pro-Kremlin Disinformation in News Articlescited by 10
- 2024Which Demographics do LLMs Default to During Annotation?cited by 10
- 2023COVID-19 Vaccine Misinformation in Middle Income Countriescited by 2
- 2025Beyond the Explicit: A Bilingual Dataset for Dehumanization Detection in Social Mediacited by 2
- 2025FakeZero: Real-Time, Privacy-Preserving Misinformation Detection for Facebook and Xcited by 1
Built on by
Not cited yet.