mlsanityData to 14 Oct 2026

Agentic Safety is an Epistemic Property, Not a Behavioral One

arXiv 2606.28347 ↗First posted 2 Jun 2026cs.CY cs.AI cs.LGcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Contemporary AI safety spans pre-training interventions, post-training alignment, deployment-time controls, monitoring, and red-teaming. These methods are necessary, but they primarily certify snapshots of system behavior. As AI systems become more capable, dynamic, embodied, and self-improving, this snapshot view becomes incomplete: safety depends not only on whether a system behaves acceptably now, but whether it remains correctable as it learns, adapts, acts, and modifies itself over time. This paper argues that safety should therefore be treated as an epistemic property of the evolving learner, not merely a behavioral property of the current policy. We introduce teachability as the capacity to preserve future corrective leverage under bounded human, institutional, or environmental intervention. We argue that advanced systems can retain visible competence while eroding the representational, algorithmic, or meta-decision conditions needed for future correction. Safe advanced AI systems must not only behave acceptably now; they must remain teachable later.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 8 of its 27 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

8 of 27 references.

References · 8

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  2. 2017Deep reinforcement learning from human preferencescited by 3,912
  3. 2018Model Cards for Model Reportingcited by 1,080
  4. 2019Introduction to Online Convex Optimizationcited by 803
  5. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  6. 2016Cooperative Inverse Reinforcement Learningcited by 300
  7. 2023Directions of Curvature as an Explanation for Loss of Plasticitycited by 26
  8. 2025Reinitializing weights vs units for maintaining plasticity in neural networkscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond single-channel agentic benchmarking
  2. 2026The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systems
  3. 2025Safety Must Precede the Deployment of Open-Ended AI
  4. 2025From Refusal to Recovery: A Control-Theoretic Approach to Generative AI Guardrails
  5. 2026Agentic Microphysics: A Manifesto for Generative AI Safety
  6. 2026Position: AI Safety Requires Effective Controllability
  7. 2026Breaking the Epistemic Trap: Active Perception Under Compound Uncertainty
  8. 2026Safety from Honesty in a Disinterested AI Predictor