mlsanityData to 7 Oct 2026

Retrying vs Resampling in AI Control

arXiv 2605.26047 ↗First posted 25 May 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

AI coding scaffolds like Claude Code and Codex use retrying: blocking actions flagged as risky and continuing the trajectory. We study retrying from an AI control perspective, which treats the model as potentially adversarial. We find that while retrying reduces honest suspicion scores, the untrusted model can exploit monitor rationale to construct sneakier attacks, negating safety gains. We also study resampling: drawing multiple samples from the same context, which does not leak exploitable information. We disentangle design choices that previous work on resampling had bundled together. In BashArena, with Claude Opus 4.6 as the untrusted model and MiMo-V2-Flash as the trusted monitor, drawing five samples per step and auditing on the maximum suspicion score raises safety from 61% to 71% at a 0.3% audit budget, at no cost to usefulness. Selectively resampling only the steps that look suspicious on the first draw recovers 6.2 percentage points of the gain while drawing only 10% as many extra samples. Two of our findings in this setting contradict earlier work on resampling. The first is that auditing based on the maximum across resampled suspicion scores outperforms using the minimum, which is the opposite of what Ctrl-Z found. The second is that executing the least suspicious sample, which is the central mechanism in earlier defer-to-resample protocols, gives only a small empirical safety gain in our setting (+3.9 pp, with the confidence interval overlapping zero).

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 6 of its 13 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

6 of 13 references.

References · 6

  1. 2023AI Control: Improving Safety Despite Intentional Subversioncited by 207
  2. 2023Scheming AIs: Will AIs fake alignment during training in order to get power?cited by 90
  3. 2025Ctrl-Z: Controlling AI Agents via Resamplingcited by 40
  4. 2025BashArena: A Control Setting for Highly Privileged AI Agentscited by 15
  5. 2025Evaluating Control Protocols for Untrusted AI Agentscited by 9
  6. 2025Practical challenges of control monitoring in frontier AI deploymentscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.