mlsanityData to 14 Oct 2026

Exploring Systems-Thinking Approaches to Loss of Control Risk

arXiv 2606.13474 ↗First posted 11 Jun 2026cs.CYcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Internal deployment of agentic AI systems for coding and research creates a sociotechnical control problem that extends beyond model behaviour. We treat internal-deployment Loss of Control as the inability to reliably constrain, audit, reverse, or halt AI-mediated changes to code, infrastructure, evaluation, or deployment processes in time to prevent serious organisational or societal harms. We ask whether established systems-safety methods can identify risks that model-level evaluations may miss. Using a generic frontier-lab coding-agent scenario reconstructed from public materials, we apply STECA, STPA, and FRAM. The analyses surface complementary findings: published frameworks can leave governance responsibilities and feedback loops externally unverifiable; delays in monitoring and intervention can make otherwise valid control actions ineffective; and routine operational variability can gradually erode the calibration and independence of safeguards. We argue that frontier-AI risk management should pair model-focused evaluations with systems-level hazard analysis and operational assurance that tracks whether controls remain effective over time.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. First posted on arXiv 11 Jun 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Controllability Trap: A Governance Framework for Military AI Agents
  2. 2026Beyond single-channel agentic benchmarking
  3. 2026The CASE Framework: A Multi-Disciplinary Control Architecture for Governing Enterprise Agentic AI
  4. 2026The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systems
  5. 2025A Safety and Security Framework for Real-World Agentic Systems
  6. 2026Risk Architecture for AI-Native Engineering Teams: An Organizational Framework for Agentic System Governance
  7. 2025With Great Capabilities Come Great Responsibilities: Introducing the Agentic Risk & Capability Framework for Governing Agentic AI Systems
  8. 2025Risk Analysis Techniques for Governed LLM-based Multi-Agent Systems