Thought Virus: Viral Misalignment via Subliminal Prompting in Multi-Agent Systems
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Subliminal prompting is a phenomenon in which language models are biased towards certain concepts or traits through prompting with semantically unrelated tokens. While prior work has examined subliminal prompting in user-LLM interactions, potential bias transfer in multi-agent systems and its associated security implications remain unexplored. In this work, we show that a single subliminally prompted agent can spread a weakening but persisting bias throughout its entire network. We measure this phenomenon across 6 agents using two different topologies, observing that the transferred concept maintains an elevated response rate throughout the network. To exemplify potential misalignment risks, we assess network performance on multiple-choice TruthfulQA, showing that subliminal prompting of a single agent may degrade the truthfulness of other agents. Our findings reveal that subliminal prompting introduces a new attack vector in multi-agent security, with implications for the alignment of such systems. The implementation of all experiments is publicly available at https://github.com/Multi-Agent-Security-Initiative/thought_virus .
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 28 of its 29 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
28 of 29 references.
Closest ancestors · 1
Same direction, newest first
Other references · 27
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
- 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 172
- 2025Multi-Agent Risks from Advanced AIcited by 163
- 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 149
- 2025LlamaFirewall: An open source guardrail system for building secure AI agentscited by 127
15 more
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agentscited by 125
- 2025Red-Teaming LLM Multi-Agent Systems via Communication Attackscited by 122
- 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 99
- 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMscited by 95
- 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in datacited by 95
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 71
- 2025PromptShield: Deployable Detection for Prompt Injection Attackscited by 50
- 2025Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systemscited by 43
- 2025textitAgents Under Siege: Breaking Pragmatic Multi-Agent LLM Systems with Optimized Prompt Attackscited by 34
- 2025Towards Understanding Subliminal Learning: When and How Hidden Biases Transfercited by 34
- 2024An Early Categorization of Prompt Injection Attacks on Large Language Modelscited by 30
- 2025Promptception: How Sensitive Are Large Multimodal Models to Prompts?cited by 13
- 2024Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroringcited by 12
- 2024Talking Nonsense: Probing Large Language Models' Understanding of Adversarial Gibberish Inputscited by 11
- 2024A Troublemaker with Contagious Jailbreak Makes Chaos in Honest Townscited by 9
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Subliminal Learning Is Steering Vector Distillationcited by 13
- 2026Emergent and Subliminal Misalignment Through the Lens of Data-Mediated Transfercited by 8
- 2026Mind Viruses: Self-Propagating Ideas in Multi-Agent LLM Systemscited by 4
- 2026Architecture Matters for Multi-Agent Securitycited by 3
- 2026Mitigating Misalignment Contagion by Steering with Implicit Traitscited by 1
- 2026Model Hypnosis: Strong control of AI via additive subliminal effectscited by 1
- 2026Testing Interchangeability in LLM Agent Teamscited by 1
- 2026Can Data Attribution Filter Out Subliminal Learning? Not Reliablycited by 0
- 2026Disentangling Models from Personas in Heterogeneous LLM Simulationscited by 0
- 2026Disentangling Models from Personas in Heterogeneous LLM Simulations6 Oct 2026
- 2026Can Data Attribution Filter Out Subliminal Learning? Not Reliably17 Sep 2026
- 2026Testing Interchangeability in LLM Agent Teams4 Sep 2026
- 2026Model Hypnosis: Strong control of AI via additive subliminal effects17 Aug 2026
- 2026Mind Viruses: Self-Propagating Ideas in Multi-Agent LLM Systems10 Aug 2026
- 2026Subliminal Learning Is Steering Vector Distillation31 May 2026
- 2026Emergent and Subliminal Misalignment Through the Lens of Data-Mediated Transfer12 May 2026
- 2026Mitigating Misalignment Contagion by Steering with Implicit Traits4 May 2026
- 2026Architecture Matters for Multi-Agent Security25 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Subliminal Transfer of Unsafe Behaviors in AI Agent Distillation
- 2025Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems
- 2025Demonstrations of Integrity Attacks in Multi-Agent Systems
- 2025Subliminal Corruption: Mechanisms, Thresholds, and Interpretability
- 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systems
- 2025Thought Crime: Backdoors and Emergent Misalignment in Reasoning Models
- 2025Preventing Prompt Injection with Type-Directed Privilege Separation