Propaganda AI: An Analysis of Semantic Divergence in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) can exhibit concept-conditioned semantic divergence: common high-level cues (e.g., ideologies, public figures) elicit unusually uniform, stance-like responses that evade token-trigger audits. This behavior falls in a blind spot of current safety evaluations, yet carries major societal stakes, as such concept cues can steer content exposure at scale. We formalize this phenomenon and present RAVEN (Response Anomaly Vigilance), a black-box audit that flags cases where a model is simultaneously highly certain and atypical among peers by coupling semantic entropy over paraphrastic samples with cross-model disagreement. In a controlled LoRA fine-tuning study, we implant a concept-conditioned stance using a small biased corpus, demonstrating feasibility without rare token triggers. Auditing five LLM families across twelve sensitive topics (360 prompts per model) and clustering via bidirectional entailment, RAVEN surfaces recurrent, model-specific divergences in 9/12 topics. Concept-level audits complement token-level defenses and provide a practical early-warning signal for release evaluation and post-deployment monitoring against propaganda-like influence.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 15 Apr 2025.
Builds on
13 of 23 references.
References · 13
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
- 2020Weight Poisoning Attacks on Pre-trained Modelscited by 341
- 2020ONION: A Simple and Effective Defense Against Textual Backdoor Attackscited by 263
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 235
- 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 157
- 2023Backdoor Attacks for In-Context Learning with Language Modelscited by 96
- 2023Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Modelscited by 94
- 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 73
- 2022Hidden Poison: Machine Unlearning Enables Camouflaged Poisoning Attackscited by 43
- 2024Mitigating Backdoor Threats to Large Language Models: Advancement and Challengescited by 15
1 more
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.