Honeypot Protocol
Not on the map. Why?
Abstract (arXiv)
Trusted monitoring, the standard defense in AI control, is vulnerable to adaptive attacks, collusion, and strategic attack selection. All of these exploit the fact that monitoring is passive: it observes model behavior but never probes whether the model would behave differently under different perceived conditions. We introduce the honeypot protocol, which tests for context-dependent behavior by varying only the system prompt across three conditions (evaluation, synthetic deployment, explicit no-monitoring) while holding the task, environment, and scoring identical. We evaluate Claude Opus 4.6 in BashArena across all three conditions in both honest and attack modes. The model achieved 100% main task success and triggered zero side tasks uniformly across conditions, providing a baseline for future comparisons with stronger attack policies and additional models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 20 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
17 of 20 references.
References · 17
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
- 2024Alignment faking in large language modelscited by 360
- 2024Frontier Models are Capable of In-context Schemingcited by 287
- 2023AI Control: Improving Safety Despite Intentional Subversioncited by 229
- 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 145
- 2025Large Language Models Often Know When They Are Being Evaluatedcited by 128
- 2024Sabotage Evaluations for Frontier Modelscited by 52
- 2025Ctrl-Z: Controlling AI Agents via Resamplingcited by 44
- 2024Towards evaluations-based safety cases for AI schemingcited by 33
- 2025Adaptive Attacks on Trusted Monitors Subvert AI Control Protocolscited by 30
- 2025BashArena: A Control Setting for Highly Privileged AI Agentscited by 17
- 2025Evaluating Control Protocols for Untrusted AI Agentscited by 11
5 more
- 2024LLM Honeypot: Leveraging Large Language Models as Advanced Interactive Honeypot Systemscited by 10
- 2026When can we trust untrusted monitoring? A safety case sketch across collusion strategiescited by 10
- 2026Attack Selection Reduces Safety in Concentrated AI Control Settings against Trusted Monitoringcited by 6
- 2025Factor(T,U): Factored Cognition Strengthens Monitoring of Untrusted AIcited by 5
- 2026Basic Legibility Protocols Improve Trusted Monitoringcited by 3
Built on by
Not cited yet.