mlsanityData to 14 Oct 2026

Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands

arXiv 2605.15164 ↗First posted 14 May 2026cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

This position paper argues that behavioural assurance, even when carefully designed, is being asked to carry safety claims it cannot verify. AI governance frameworks enacted between 2019 and early 2026 require reviewable evidence of properties such as the absence of hidden objectives, resistance to loss-of-control precursors, and bounded catastrophic capability; current assurance methodologies (primarily behavioural evaluations and red-teaming) are epistemically limited to observable model outputs and cannot verify the latent representations or long-horizon agentic behaviours these frameworks presume to regulate. We formalize this structural mismatch as the audit gap, the divergence between required and achievable verification access, and introduce the concept of fragile assurance to describe cases where the evidential structure does not support the asserted safety claim. Through an analysis of a 21-instrument inventory, we identify an incentive gradient where geopolitical and industrial pressures systematically reward surface-level behavioral proxies over deep structural verification. Finally, we propose a technical pivot: bounding the weight of behavioral evidence in legal text and extending voluntary pre-deployment access with mechanistic-evidence classes, specifically linear probes, activation patching, and before/after-training comparisons.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 36 of its 81 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

36 of 81 references.

References · 36

  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  2. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  3. 2022Toy Models of Superpositioncited by 971
  4. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 422
  5. 2024Frontier Models are Capable of In-context Schemingcited by 287
  6. 2019Analyzing the Structure of Attention in a Transformer Language Modelcited by 243
  7. 2025AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoderscited by 218
  8. 2025Open Problems in Mechanistic Interpretabilitycited by 179
  9. 2023Model evaluation for extreme riskscited by 177
  10. 2025Agentic Misalignment: How LLMs Could Be Insider Threatscited by 158
  11. 2025Measuring AI Ability to Complete Long Software Taskscited by 156
  12. 2023Auditing large language models: a three-layered approachcited by 137
24 more
  1. 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 126
  2. 2025Are Sparse Autoencoders Useful? A Case Study in Sparse Probingcited by 115
  3. 2025Stress Testing Deliberative Alignment for Anti-Scheming Trainingcited by 86
  4. 2025Auditing language models for hidden objectivescited by 83
  5. 2025Detecting Strategic Deception Using Linear Probescited by 68
  6. 2024Open Problems in Technical AI Governancecited by 49
  7. 2025An Approach to Technical AGI Safety and Securitycited by 45
  8. 2022Structured access: an emerging paradigm for safe AI deploymentcited by 41
  9. 2025A sketch of an AI control safety casecited by 39
  10. 2026AuditBench: Evaluating Alignment Auditing Techniques on Models with Hidden Behaviorscited by 38
  11. 2025Sparse Autoencoders for Hypothesis Generationcited by 26
  12. 2024Linear Explanations for Individual Neuronscited by 19
  13. 2024Safety cases for frontier AIcited by 18
  14. 2025STACK: Adversarial Attacks on LLM Safeguard Pipelinescited by 14
  15. 2026Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?cited by 14
  16. 2025Verifying International Agreements on AI: Six Layers of Verification for Rules on Large-Scale AI Development and Deploymentcited by 11
  17. 2025Refusal Falls off a Cliff: How Safety Alignment Fails in Reasoning?cited by 11
  18. 2025Attestable Audits: Verifiable AI Safety Benchmarks Using Trusted Execution Environmentscited by 8
  19. 2025The Secret Agenda: LLMs Strategically Lie and Our Current Safety Tools Are Blindcited by 8
  20. 2026A Structured Approach to Safety Case Construction for AI Systemscited by 6
  21. 2026UK AISI Alignment Evaluation Case-Studycited by 6
  22. 2026When the Coffee Feature Activates on Coffins: An Analysis of Feature Extraction and Steering for Mechanistic Interpretabilitycited by 3
  23. 2026Trusting What You Cannot See: Auditable Fine-Tuning and Inference for Proprietary AIcited by 3
  24. 2026Expanding External Access To Frontier AI Models For Dangerous Capability Evaluationscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Trustworthy AI Posture (TAIP): A Framework for Continuous AI Assurance of Agentic Systems at Horizontal and Vertical scale
  2. 2026The Missing Layer: Specification Infrastructure for AI Oversight ↗
  3. 2025Interpretability as Alignment: Making Internal Understanding a Design Principle
  4. 2026The Moral Check: Strategic AI Governance for the Pacing Problem
  5. 2026Beyond Training: A Feasibility Taxonomy for Inference-Time AI Governance
  6. 2026Agentic Safety is an Epistemic Property, Not a Behavioral One
  7. 2026Beyond Task Success: An Evidence-Synthesis Framework for Evaluating, Governing, and Orchestrating Agentic AI
  8. 2026The Alignment Flywheel: A Governance-Centric Hybrid MAS for Architecture-Agnostic Safety