When Evaluation Becomes a Side Channel: Regime Leakage and Structural Mitigations for Alignment Assessment
Not on the map. Why?
Abstract (arXiv)
Safety evaluation for advanced AI systems assumes that behavior observed under evaluation predicts behavior in deployment. This assumption weakens for agents with situational awareness, which may exploit regime leakage, cues distinguishing evaluation from deployment, to implement conditional policies that comply under oversight while defecting in deployment-like regimes. We recast alignment evaluation as a problem of information flow under partial observability and show that divergence between evaluation-time and deployment-time behavior is bounded by the regime information extractable from decision-relevant internal representations. We study regime-blind mechanisms, training-time interventions that restrict access to regime cues through adversarial invariance constraints without assuming complete information erasure. We evaluate this approach across multiple open-weight language models and controlled failure modes including scientific sycophancy, temporal sleeper agents, and data leakage. Regime-blind training reduces regime-conditioned failures without measurable loss of task utility, but exhibits heterogeneous and model-dependent dynamics. Sycophancy shows a sharp representational and behavioral transition at moderate intervention strength, consistent with a stability cliff. In sleeper-style constructions and certain cross-model replications, suppression occurs without a clean collapse of regime decodability and may display non-monotone or oscillatory behavior as invariance pressure increases. These findings indicate that representational invariance is a meaningful but limited control lever. It can raise the cost of regime-conditioned strategies but cannot guarantee elimination or provide architecture-invariant thresholds. Behavioral evaluation should therefore be complemented with white-box diagnostics of regime awareness and internal information flow.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
19 of 31 references.
References · 19
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2019Invariant Risk Minimizationcited by 1,832
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2019Machine Unlearningcited by 1,020
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2019Designing and Interpreting Probes with Control Taskscited by 608
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2024Alignment faking in large language modelscited by 316
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 250
- 2020Information-Theoretic Probing for Linguistic Structurecited by 204
7 more
- 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 131
- 2025Large Language Models Often Know When They Are Being Evaluatedcited by 105
- 2025Tell me about yourself: LLMs are aware of their learned behaviorscited by 86
- 2025Probing and Steering Evaluation Awareness of Language Modelscited by 31
- 2025Steering Evaluation-Aware Language Models to Act Like They Are Deployedcited by 30
- 2025Detecting Proxy Gaming in RL and LLM Alignment via Evaluator Stress Testscited by 19
- 2026Alignment Verifiability in Large Language Models: Normative Indistinguishability under Behavioral Evaluationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Adversarial Pragmatics for AI Safety Evaluation: A Diagnostic Framework and Seed Benchmark for Language-Mediated Control
- 2026Evaluation Blindness: How Silent Measurement Failures Corrupt AI Systems from Training to Deployment
- 2026Alignment Risks from Capability-Seeking RL Training
- 2026Aligned Alone, Misaligned Together: Forecasting Adversarial Capture in LLM Agent Populations
- 2026The Compliance Trap: How Structural Constraints Degrade Frontier AI Metacognition Under Adversarial Pressure
- 2026Epistemic Traps: Rational Misalignment Driven by Model Misspecification
- 2025Evaluation Faking: Unveiling Observer Effects in Safety Evaluation of Frontier AI Systems
- 2026AI Alignment Breaks at the Edge