To Lie or Not to Lie? Investigating The Biased Spread of Global Lies by LLMs
Not on the map. Why?
Abstract (arXiv)
Misinformation is on the rise, and the strong writing capabilities of LLMs lower the barrier for malicious actors to produce and disseminate false information. We study how LLMs behave when prompted to spread misinformation across languages and target countries, and introduce GlobalLies, a multilingual parallel dataset of 440 misinformation generation prompt templates and 6,867 entities, spanning 8 languages and 195 countries. Using both human annotations and large-scale LLM-as-a-judge evaluations across hundreds of thousands of generations from state-of-the-art models, we show that misinformation generation varies systematically based on the country being discussed. Propagation of lies by LLMs is substantially higher in many lower-resource languages and for countries with a lower Human Development Index (HDI). We find that existing mitigation strategies provide uneven protection: input safety classifiers exhibit cross-lingual gaps, and retrieval-augmented fact-checking remains inconsistent across regions due to unequal information availability. We release GlobalLies for research purposes, aiming to support the development of mitigation strategies to reduce the spread of global misinformation: https://github.com/zohaib-khan5040/globallies
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
23 of 35 references.
References · 23
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 278
- 2022Are Large Pre-Trained Language Models Leaking Your Personal Information?cited by 195
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 124
- 2024Revisiting Jailbreaking for Large Language Models: A Representation Engineering Perspectivecited by 44
- 2024DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detectioncited by 41
- 2024Decoding Echo Chambers: LLM-Powered Simulations Revealing Polarization in Social Networkscited by 31
- 2024Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversationscited by 24
- 2025AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computationcited by 24
- 2024Multilingual Blending: LLM Safety Alignment Evaluation with Language Mixturecited by 22
- 2024Arabic Dataset for LLM Safeguard Evaluationcited by 17
11 more
- 2022Stanceosaurus: Classifying Stance Towards Multilingual Misinformationcited by 8
- 2025Tailored Truths: Optimizing LLM Persuasion with Personalization and Fabricated Statisticscited by 8
- 2025Evaluating & Reducing Deceptive Dialogue From Language Models with Multi-turn RLcited by 7
- 2025Watching the AI Watchdogs: A Fairness and Robustness Analysis of AI Safety Moderation Classifierscited by 5
- 2025Prompt, Divide, and Conquer: Bypassing Large Language Model Safety Filters via Segmented and Distributed Prompt Processingcited by 5
- 2024Content Moderation Justice and Fairness on Social Media: Comparisons Across Different Contexts and Platformscited by 3
- 2024Echo Chambers in the Age of Algorithms: An Audit of Twitter's Friend Recommender Systemcited by 3
- 2024Stanceosaurus 2.0: Classifying Stance Towards Russian and Spanish Misinformationcited by 2
- 2025Qorgau: Evaluating LLM Safety in Kazakh-Russian Bilingual Contextscited by 2
- 2025LiteLMGuard: Seamless and Lightweight On-Device Prompt Filtering for Safeguarding Small Language Models against Quantization-induced Risks and Vulnerabilitiescited by 1
- 2025An Audit and Analysis of LLM-Assisted Health Misinformation Jailbreaks Against LLMscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Understanding Inequality of LLM Fact-Checking over Geographic Regions with Agent and Retrieval models
- 2024From Deception to Detection: The Dual Roles of Large Language Models in Fake News
- 2025CANDY: Benchmarking LLMs' Limitations and Assistive Potential in Chinese Misinformation Fact-Checking
- 2025How LLMs Fail to Support Fact-Checking
- 2026BLUFF: Benchmarking the Detection of False and Synthetic Content across 58 Low-Resource Languages
- 2023Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation
- 2025How does Misinformation Affect Large Language Model Behaviors and Preferences?
- 2023The Perils & Promises of Fact-checking with Large Language Models