mlsanityData to 14 Oct 2026

ADMITBench: A Safety-Governed Reference Framework for Evaluating the Admissibility of Industrial LLM Advisories

arXiv 2608.03866 ↗First posted 4 Aug 2026cs.AI cs.SY eess.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

This white paper presents ADMITBench, a reference framework for evaluating industrial LLM advisories at the level of the proposed action. The framework implements a versioned, safety-governed evaluation contract that checks whether a recommendation is supported by the available evidence, permitted under the stated authority and procedure, and acceptable under the plant-specific consequence checks encoded in the selected evaluation profile. In this report, safety-governed means that eligibility is determined through explicit, non-compensatory checks derived from a versioned plant profile; it does not mean that the evaluator, model, or plant has been safety-certified. Release 0.1.0 is a public reference implementation for technical and research evaluation, not an authorisation for physical execution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 29 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

14 of 29 references.

References · 14

  1. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  2. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
  3. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  4. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agentscited by 223
  5. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoningcited by 151
  6. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoningcited by 124
  7. 2024Autonomous Industrial Control using an Agentic Framework with Large Language Modelscited by 19
  8. 2025AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenancecited by 15
  9. 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plantscited by 9
  10. 2021The Black-Box Simplex Architecture for Runtime Assurance of Autonomous CPScited by 8
  11. 2025Autonomous Control Leveraging LLMs: An Agentic Framework for Next-Generation Industrial Automationcited by 8
  12. 2026PHMForge: Evaluating LLM Agents on Industrial Prognostics through MCP-Native, Algorithm-Grounded Toolscited by 4
2 more
  1. 2025PHM-Bench: A Domain-Specific Benchmarking Framework for Systematic Evaluation of Large Models in Prognostics and Health Managementcited by 3
  2. 2026From Detection to Action: Using LLM Agents for Fault-Tolerant Controlcited by 2

Built on by

Not cited yet.