mlsanityData to 7 Oct 2026

Subliminal Transfer of Unsafe Behaviors in AI Agent Distillation

arXiv 2604.15559 ↗First posted 16 Apr 2026cs.AIcited by 4

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Recent work on subliminal learning demonstrates that language models can transmit semantic traits through data that is semantically unrelated to those traits. However, it remains unclear whether behavioral traits can transfer in agentic systems, where policies are learned from trajectories rather than static text. In this work, we provide the first empirical evidence that unsafe agent behaviors can transfer subliminally through model distillation across two complementary experimental settings. In our primary setting, we construct a teacher agent exhibiting a strong deletion bias, a tendency to perform destructive file-system actions via an API-style tool interface, and distill it into a student using only trajectories from ostensibly safe tasks, with all explicit deletion keywords rigorously filtered. In our secondary setting, we replicate the threat model in a native Bash environment, replacing API tool calls with shell commands and operationalizing the bias as a preference for issuing chmod as the first permission-related command over semantically equivalent alternatives such as chown or setfacl. Despite full keyword sanitation in both settings, students inherit measurable behavioral biases. In the API setting the student's deletion rate reaches 100% (versus a 5% baseline) under homogeneous distillation; in the Bash setting the student's chmod-first rate reaches 30%-55% (versus a 0%-10% baseline), with the strongest transfer observed in large-to-small distillation. Our results demonstrate that explicit data sanitation is an insufficient defense, and behavioral biases are encoded implicitly in trajectory dynamics regardless of the tool interface.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 18 of its 22 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

18 of 22 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Agentic Misalignment: How LLMs Could Be Insider Threats5 Oct
  2. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan

Other references · 16

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  4. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  5. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  6. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
  7. 2023Who's Harry Potter? Approximate Unlearning in LLMscited by 366
  8. 2021Unsolved Problems in ML Safetycited by 291
  9. 2023Model evaluation for extreme riskscited by 167
  10. 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
  11. 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 91
  12. 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in datacited by 89
4 more
  1. 2025Distilling LLM Agent into Small Models with Retrieval and Code Toolscited by 41
  2. 2024Diffusion Policy Attacker: Crafting Adversarial Attacks for Diffusion-based Policiescited by 17
  3. 2024Bias Amplification: Large Language Models as Increasingly Biased Mediacited by 12
  4. 2025FACET: Teacher-Centred LLM-Based Multi-Agent Systems-Towards Personalized Educational Worksheetscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thought Virus: Viral Misalignment via Subliminal Prompting in Multi-Agent Systems
  2. 2026Distilling Agentic Systems: A Roadmap across Models, Artifacts, and Harnesses
  3. 2026FORTIS: Benchmarking Over-Privilege in Agent Skills
  4. 2025AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Models
  5. 2026RAISED: Self-Distillation for Robustness to Prompt Injection in LLM Agents
  6. 2026Beyond Owls: Subliminal Learning Can Transfer Learned Capabilities and Backdoors
  7. 2026AgentLeak: Cloning Stronger LLM Agent Capabilities onto Weaker Agents Beyond Skill Stealing
  8. 2026Agent Safety From Within: Detecting Harmful Trajectories from LLM Internal States