Factor(U,T): Controlling Untrusted AI by Monitoring their Plans
Not on the map. Why?
Abstract (arXiv)
As AI capabilities advance, we increasingly rely on powerful models to decompose complex tasks unicodex2013 but what if the decomposer itself is malicious? Factored cognition protocols decompose complex tasks into simpler child tasks: one model creates the decomposition, while other models implement the child tasks in isolation. Prior work uses trusted (weaker but reliable) models for decomposition, which limits usefulness for tasks where decomposition itself is challenging. We introduce Factor(U,T), in which an untrusted (stronger but potentially malicious) model decomposes while trusted models implement child tasks. Can monitors detect malicious activity when observing only natural language task instructions, rather than complete solutions? We baseline and red team Factor(U,T) in control evaluations on BigCodeBench, a dataset of Python coding tasks. Monitors distinguishing malicious from honest decompositions perform poorly (AUROC 0.52) compared to monitors evaluating complete Python solutions (AUROC 0.96). Furthermore, Factor(D,U), which uses a trusted decomposer and monitors concrete child solutions, achieves excellent discrimination (AUROC 0.96) and strong safety (1.2% ASR), demonstrating that implementation-context monitoring succeeds where decomposition-only monitoring fails.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 15 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
2 of 15 references.
References · 2
- 2023AI Control: Improving Safety Despite Intentional Subversioncited by 229
- 2024Adaptive Deployment of Untrusted LLMs Reduces Distributed Threatscited by 31
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Factor(T,U): Factored Cognition Strengthens Monitoring of Untrusted AI
- 2026Basic Legibility Protocols Improve Trusted Monitoring
- 2026Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- 2025CoT Red-Handed: Stress Testing Chain-of-Thought Monitoring
- 2026Trust No Tool: Evaluating and Defending LLM Agents under Untrusted Tool Feedback
- 2024Adversaries Can Misuse Combinations of Safe Models
- 2025When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors
- 2026When Small Models Are Right for Wrong Reasons: Process Verification for Trustworthy Agents