mlsanityData to 14 Oct 2026

Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages

arXiv 2607.06596 ↗First posted 6 Jul 2026cs.CR cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Trusted monitoring is a central defense in AI control: a cheaper trusted model scores an untrusted model's actions for sabotage, and the most suspicious are audited or deferred. Such monitors are evaluated against one or two untrusted models, and the accuracy is reported as a property of the monitor. We ask whether it is partly a property of the pairing. We make the untrusted policy family the controlled axis: we fit a monitor on family A's transcripts, apply it to family B, and decompose the cross-family AUROC into how obvious each family's sabotage is, how capable each monitor is, and the residual own-family advantage after both are removed: the interaction. On code-backdoor transcripts the interaction is positive and survives the dominant confounds: +0.172 (95% CI [+0.158, +0.185]) on four open-weight families on a strict leak-free basis, holding across an eight-family matrix spanning four frontier vendors, blatancy-matched controls, a trained transcript-reading monitor up to 34B parameters, and a second code benchmark. The gap is geometric: each lineage's sabotage occupies a different scoring direction, and rotating the monitor's scoring direction toward the target lineage recovers most of the lost detection while a matched random rotation recovers nothing. At a 1% audit budget under defer-to-trusted, an off-lineage monitor catches 19% of attack attempts where an in-lineage monitor catches 41% at the same audit cost, a +21.7-point gap. Control evaluations should report cross-family transfer matrices: a single-pairing accuracy overstates the safety a monitor delivers against a lineage it was not calibrated on. We give a four-step protocol that acts on the gap, with each step a measured result.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 18 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

16 of 18 references.

References · 16

  1. 2021Measuring Coding Challenge Competence With APPScited by 902
  2. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
  3. 2023AI Control: Improving Safety Despite Intentional Subversioncited by 229
  4. 2025SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agentscited by 71
  5. 2025Reliable Weak-to-Strong Monitoring of LLM Agentscited by 31
  6. 2025Adaptive Attacks on Trusted Monitors Subvert AI Control Protocolscited by 30
  7. 2025Async Control: Stress-testing Asynchronous Control Measures for LLM Agentscited by 22
  8. 2026How does information access affect LLM monitors' ability to detect sabotage?cited by 14
  9. 2025Evaluating Control Protocols for Untrusted AI Agentscited by 11
  10. 2025Control Tax: The Price of Keeping AI in Checkcited by 10
  11. 2025Practical challenges of control monitoring in frontier AI deploymentscited by 8
  12. 2026Attack Selection Reduces Safety in Concentrated AI Control Settings against Trusted Monitoringcited by 6
4 more
  1. 2026Ensemble Monitoring for AI Control: Diverse Signals Outweigh More Computecited by 6
  2. 2026CIAware-Bench: Benchmarking Control Intervention Awareness Across Frontier LLMscited by 3
  3. 2026Classifier Context Rot: Monitor Performance Degrades with Context Lengthcited by 2
  4. 2025Cross-LLM Generalization of Behavioral Backdoor Detection in AI Agent Supply Chainscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Bootstrapped Monitoring: Leveraging Transparent Reasoning to Oversee Stronger AI Agents
  2. 2025Factor(U,T): Controlling Untrusted AI by Monitoring their Plans
  3. 2026Recognition Without Enforcement: Configuration-Dependent Failures in LLM Agent Instruction Arbitration and External Control
  4. 2026Basic Legibility Protocols Improve Trusted Monitoring
  5. 2026ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D
  6. 2025CoT Red-Handed: Stress Testing Chain-of-Thought Monitoring
  7. 2025Factor(T,U): Factored Cognition Strengthens Monitoring of Untrusted AI
  8. 2026A False Average: Pooled CoT-Monitor Accuracy Conceals a Reasoning-Dependent Fragility