mlsanityData to 14 Oct 2026

How Far Will They Go? Red-Teaming Online Influence with Large Language Models

arXiv 2605.22880 ↗First posted 20 May 2026cs.CL cs.AI cs.CYcited by 0

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

As large language model (LLM)-based agents increasingly participate in online discourse, red-teaming their capacity to support political influence campaigns is critical for information integrity. In pursuit of this goal, we focus on locally deployed open-source LLMs, as opposed to frontier API-only models, given their superior alignment with the operational constraints of privacy-conscious malicious actors deployed in social media environments. We introduce an empirical red-teaming framework for measuring LLM Overton Windows (OWs), defined as the range of political opinions a model can reliably express on controversial topics, and for quantifying how simple natural-language jailbreaks expand that range. We evaluate more than 30 LLMs spanning 10 model families and five countries of origin. We find systematic asymmetries in political expressivity: open-source LLMs are typically more willing to generate left-leaning social media content, OWs tend to contract inversely to model size, and regional differences are substantial despite uneven representation in the open-source ecosystem. Jailbreak potency also varies sharply across model families, motivating a workflow for identifying effective combinations of jailbreak techniques. Taken together, our results establish a practical framework for auditing the political steerability of open-source LLMs and for helping future researchers design stronger countermeasures against LLM-enabled influence campaigns.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 14 of its 90 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

14 of 90 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Refusal in Language Models Is Mediated by a Single Direction17 Jun

Other references · 13

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  4. 2023Whose Opinions Do Language Models Reflect?cited by 773
  5. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  6. 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
  7. 2025Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performancecited by 57
  8. 2024Evaluating the Prompt Steerability of Large Language Modelscited by 27
  9. 2025How malicious AI swarms can threaten democracy: The fusion of agentic AI and LLMs marks a new frontier in information warfarecited by 20
  10. 2025Emergent Coordinated Behaviors in Networked LLM Agents: Modeling the Strategic Dynamics of Information Operationscited by 6
  11. 2025Political Ideology Shifts in Large Language Modelscited by 5
  12. 2025AI Propaganda factories with language modelscited by 4
1 more
  1. 2025POW: Political Overton Windows of Large Language Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026@GrokSet: multi-party Human-LLM Interactions in Social Media ↗
  2. 2025Generative Exaggeration in LLM Social Agents: Consistency, Bias, and Toxicity
  3. 2026Ignore All Previous Instructions: Jailbreaking as a de-escalatory peace building practise to resist LLM social media bots
  4. 2026An Empirical Study of Collective Behaviors and Social Dynamics in Large Language Model Agents
  5. 2025SocialHarmBench: Revealing LLM Vulnerabilities to Socially Harmful Requests
  6. 2026LLMs Can Infer Political Alignment from Online Conversations
  7. 2026Can Multi-Agent LLMs Identify Their Peers? Stylometric Fingerprinting in Role-Constrained Political Analysis
  8. 2026How Far Did They Go? The Persuasive Tactics of Covert LLM Agents in a Discontinued Field Experiment