mlsanityData to 14 Oct 2026

Beyond Training: A Feasibility Taxonomy for Inference-Time AI Governance

arXiv 2609.10105 ↗First posted 9 Sep 2026cs.CY cs.AI cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Compute governance today is a governance of training: the thresholds, reporting requirements, and frontier-AI regimes now in force attach to training compute and treat the trained model as the regulatory unit. That picture is incomplete: capability increasingly migrates to the deployment stage through inference-time scaling, agentic scaffolding, and compression onto consumer hardware. This paper asks which mechanisms are available once the regulatory object shifts from the training run to the inference call. We develop a feasibility taxonomy of twenty inference-time mechanisms across monitoring, verification, and enforcement, each rated on a four-point readiness scale against a documented four-vendor evidence base. We then stress the taxonomy against a two-dimensional adversary model (three capability tiers crossed with four adversary roles) and map each mechanism to four governance scenarios (domestic regulation, bilateral or multilateral coordination, industry self-regulation, and compute-marketplace governance). Fifteen of the twenty mechanisms have commercial technical substrates in production today, although governance-grade assurance and adversarial robustness vary substantially. The adversary analysis shows that this readiness holds only against a cooperative deployer and a low-to-medium-capability user: no mechanism rates adequate against a high-capability state-level deployer, and fine-tuning removes the model-internal components of the enforcement cluster, although platform-external controls can persist. A substitution analysis connects the taxonomy to a companion hardware paper as a conditional substitution principle describing when inference-stage and hardware-stage mechanisms provide comparable regulatory coverage under stated conditions. A second-rater reliability check on a random subset of the readiness ratings returned a quadratic-weighted Cohen's kappa of 0.74.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 129 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

46 of 129 references.

References · 46

  1. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  2. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
  3. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
  4. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
  5. 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
  6. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
  7. 2024Open Problems in Technical AI Governancecited by 49
  8. 2024Computing Power and the Governance of Artificial Intelligencecited by 40
  9. 2025MI9: An Integrated Runtime Governance Framework for Agentic AIcited by 19
  10. 2024On the Limitations of Compute Thresholds as a Governance Strategycited by 18
  11. 2025Governance-as-a-Service: A Multi-Agent Framework for AI System Compliance and Policy Enforcementcited by 17
  12. 2024Verifiable evaluations of machine learning models using zkSNARKscited by 16
34 more
  1. 2025Policy-as-Prompt: Turning AI Governance Rules into Guardrails for AI Agentscited by 14
  2. 2023Oversight for Frontier AI through a Know-Your-Customer Scheme for Compute Providerscited by 13
  3. 2026Before the Tool Call: Deterministic Pre-Action Authorization for Autonomous AI Agentscited by 13
  4. 2025The Art of Scaling Test-Time Compute for Large Language Modelscited by 12
  5. 2025Verifying International Agreements on AI: Six Layers of Verification for Rules on Large-Scale AI Development and Deploymentcited by 11
  6. 2026Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and Security Practices at Leading AI Companiescited by 11
  7. 2024Governing Through the Cloud: The Intermediary Role of Compute Providers in AI Regulationcited by 10
  8. 2024Laminator: Verifiable ML Property Cards using Hardware-assisted Attestationscited by 10
  9. 2024Verification methods for international AI agreementscited by 10
  10. 2026Analyzing and Improving Chain-of-Thought Monitorability Through Information Theorycited by 10
  11. 2023International Institutions for Advanced AIcited by 9
  12. 2025Trusted AI Agents in the Cloudcited by 6
  13. 2026PAL*M: Property Attestation for Large Generative Modelscited by 5
  14. 2025International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treatycited by 4
  15. 2025Policy Cards: Machine-Readable Runtime Governance for Autonomous AI Agentscited by 4
  16. 2026OpenPort Protocol: A Security Governance Specification for AI Agent Tool Accesscited by 4
  17. 2026Hardware-Level Governance of AI Compute: A Feasibility Taxonomy for Regulatory Compliance and Treaty Verificationcited by 4
  18. 2026AgenTEE: Confidential LLM Agent Execution on Edge Devicescited by 4
  19. 2025Practical Principles for AI Cost and Compute Accountingcited by 3
  20. 2025Distributed and Decentralised Training: Technical Governance Challenges in a Shifting AI Landscapecited by 3
  21. 2025Internal Deployment in the AI Actcited by 3
  22. 2026AEX: Non-Intrusive Multi-Hop Attestation and Provenance for LLM APIscited by 3
  23. 2026SentinelAgent: Intent-Verified Delegation Chains for Securing Federal Multi-Agent AI Systemscited by 3
  24. 2026A Formal Security Framework for MCP-Based AI Agents: Threat Taxonomy, Verification Models, and Defense Mechanismscited by 3
  25. 2025International Security Applications of Flexible Hardware-Enabled Guaranteescited by 2
  26. 2025Defending Compute Thresholds Against Legal Loopholescited by 1
  27. 2025From Turing to Tomorrow: The UK's Approach to AI Regulationcited by 1
  28. 2025DSperse: A Framework for Targeted Verification in Zero-Knowledge Machine Learningcited by 1
  29. 2025Evaluating the Safety and Skill Reasoning of Large Reasoning Models Under Compute Constraintscited by 1
  30. 2025Optimistic TEE-Rollups: A Hybrid Architecture for Scalable and Verifiable Generative AI Inference on Blockchaincited by 1
  31. 2026Small models, big threats: Characterizing safety challenges from low-compute AI modelscited by 1
  32. 2026LatentAudit: Real-Time White-Box Faithfulness Monitoring for Retrieval-Augmented Generation with Verifiable Deploymentcited by 1
  33. 2026Governed Capability Evolution: Lifecycle-Time Compatibility Checking and Rollback for AI-Component-Based Systems, with a Proof-of-Concept Evaluation on Embodied Agentscited by 1
  34. 2026The Open-Weight Paradox: Why Restricting Access to AI Models May Undermine the Safety It Seeks to Protectcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Behavioral Governance for Autonomous AI Agents: The AgentBound Framework
  2. 2026Runtime Governance for AI Agents: Policies on Paths
  3. 2026Beyond Task Success: An Evidence-Synthesis Framework for Evaluating, Governing, and Orchestrating Agentic AI
  4. 2026The Moral Check: Strategic AI Governance for the Pacing Problem
  5. 2026A pragmatic approach to regulating AI agents
  6. 2026The Cognitive Penalty: Ablating System 1 and System 2 Reasoning in Edge-Native SLMs for Decentralized Consensus
  7. 2025Towards Adaptive Categories: Dimensional Governance for Agentic AI
  8. 2026AGL-1: The Enterprise AI Governance Layer as a Control Plane for Trusted Enterprise Intelligence