mlsanityData to 14 Oct 2026

Prompt Injection Vulnerability of Consensus Generating Applications in Digital Democracy

arXiv 2508.04281 ↗First posted 6 Aug 2025cs.CY cs.CRcited by 2

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Large Language Models (LLMs) are gaining traction as a method to generate consensus statements and aggregate preferences in digital democracy experiments. Yet, LLMs could introduce critical vulnerabilities in these systems. Here, we examine the vulnerability and robustness of off-the-shelf consensus-generating LLMs to prompt-injection attacks, in which texts are injected to amplify particular viewpoints, erase certain opinions, or divert consensus toward unrelated or irrelevant topics. We construct attack-free and adversarial variants of prompts containing public policy questions and opinion texts, classify opinion and consensus valences with a fine-tuned BERT model, and estimate LLM-human majority agreement rates. Across topics, default LLaMA 3.1 8B Instruct, GPT-4.1 Nano, and Apertus 8B exhibit widespread vulnerability, specially when disagreement and disagreement are finely balanced, for attacks that shift consensus toward positions aligned with GB-unionist conservative manifestos relative to pro-independence left manifestos, and for rational, instruction-like rhetorical strategies. A robustness pipeline combining GPT-OSS-SafeGuard injection detection, structured opinion representations, and GSPO-based reinforcement learning substantially reduces directional failures whenever the underlying consensus has a clear positive or negative valence. These findings advance our understanding of both the vulnerabilities and the potential defenses of consensus-generating LLMs in digital democracy applications.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 14 of its 46 references that are in the map. First posted on arXiv 6 Aug 2025.

Builds on

14 of 46 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024SecAlign: Defending Against Prompt Injection with Preference Optimization7 Oct
  2. 2024Neural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attacks6 Mar
  3. 2024StruQ: Defending Against Prompt Injection with Structured Queries9 Feb

Other references · 11

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  5. 2023Membership Inference Attacks against Language Models via Neighbourhood Comparisoncited by 258
  6. 2024Persistent Pre-Training Poisoning of LLMscited by 48
  7. 2024Generative AI voting: fair collective choice is resilient to LLM biases and inconsistenciescited by 8
  8. 2025Scaling Human Judgment in Community Notes with LLMscited by 8
  9. 2025A Replica for our Democracies? On Using Digital Twins to Enhance Deliberative Democracycited by 4
  10. 2025Recommender Systems for Democracy: Toward Adversarial Robustness in Voting Advice Applicationscited by 1
  11. 2025Community Notes undermoderate polarizing content by design creating risks in electoral processescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Inference-Time Mitigation of Adversarial Political Bias in Large Language Models
  2. 2026Large Language Models and Augmented Democracy
  3. 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancy
  4. 2025SocialHarmBench: Revealing LLM Vulnerabilities to Socially Harmful Requests
  5. 2025Poison Once, Refuse Forever: Weaponizing Alignment for Injecting Bias in LLMs
  6. 2025PReSS: An Automated Black-Box Framework for Evaluating Political Stance Stability in LLMs
  7. 2025Uncovering the Persuasive Fingerprint of LLMs in Jailbreaking Attacks
  8. 2024Automatic and Universal Prompt Injection Attacks against Large Language Models