mlsanityData to 7 Oct 2026

Toward Pre-Deployment Assurance for Enterprise AI Agents: Ontology-Grounded Simulation and Trust Certification

arXiv 2606.04037 ↗First posted 2 Jun 2026cs.AI cs.LG cs.SEcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Pre-deployment verification of enterprise artificial intelligence (AI) agents remains a critical gap between large language model (LLM) capability benchmarking and production deployment. Post-deployment monitoring, human-in-the-loop controls, and prompt-level guardrails offer limited assurance once an agent is operating in production. We present an ontology-grounded verification framework -- to our knowledge the first to combine three components: an Agent Operational Envelope formalizing the certification space across permissions, domain constraints, safety properties, governance rules, and autonomy levels; an ontology-to-scenario generation pipeline that derives regulatory, operational, and adversarial test scenarios automatically; and a machine-verifiable Trust Certificate with graduated deployment verdicts. A controlled pilot across four regulated industries (Fintech, Banking, Insurance, Healthcare), instantiated as five industry-by-regulatory-regime cells across the United States and Vietnam (where Vietnam's 2025 AI Law makes such verification legally mandated for financial services), generated 1,800 scenarios evaluated against 125 primary-source regulatory requirements and 25 injected faults. Ontology-grounded generation significantly outperformed the dominant persona-based baseline on regulatory coverage (48.3% versus 33.1%; corrected p_c = .0006) and attained the highest domain specificity (4.77/5.0; p = 2e-6); transparently, its advantage over plain and retrieval-augmented prompting did not survive Bonferroni correction. Cross-validation across three LLM families (Claude Sonnet 4, Qwen 2.5 72B, Gemma 4 26B; 5,400 total scenarios) replicated the persona-versus-ontology pattern. The framework offers a reproducible, regulation-grounded route to pre-deployment assurance for enterprise AI agents, complementing runtime governance with an auditable deployment gate.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 55 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

25 of 55 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
  2. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  3. 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents17 Dec
  4. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  5. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
  6. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 19

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2017Deep reinforcement learning from human preferencescited by 3,846
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  5. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  6. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  7. 2016Concrete Problems in AI Safetycited by 1,582
  8. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  9. 2024A Survey on LLM-as-a-Judgecited by 1,384
  10. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  11. 2022Red Teaming Language Models with Language Modelscited by 983
  12. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
7 more
  1. 2020Knowledge Graphscited by 619
  2. 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
  3. 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 142
  4. 2020NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systemscited by 128
  5. 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 94
  6. 2024Visibility into AI Agentscited by 77
  7. 2026Ontology-Constrained Neural Reasoning in Enterprise Agentic Systems: A Neurosymbolic Architecture for Domain-Grounded AI Agentscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026From CRUD to Autonomous Agents: Formal Validation and Zero-Trust Security for Semantic Gateways in AI-Native Enterprise Systems
  2. 2026Trustworthy AI Posture (TAIP): A Framework for Continuous AI Assurance of Agentic Systems at Horizontal and Vertical scale
  3. 2026AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems
  4. 2026TRACE: A Metrologically-Grounded Engineering Framework for Trustworthy Agentic AI Systems in Operationally Critical Domains
  5. 2026AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environments
  6. 2026The Semantic Training Gap: Ontology-Grounded Tool Architectures for Industrial AI Agent Systems
  7. 2026A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents
  8. 2026AGL-1: The Enterprise AI Governance Layer as a Control Plane for Trusted Enterprise Intelligence