mlsanityData to 14 Oct 2026

Engineering Reliable Commit Gates for Agentic AI: Cost-Aware Verification Portfolios under Common-Mode Data Failures

arXiv 2609.10969 ↗First posted 10 Sep 2026cs.SEcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Agentic systems commit state-changing actions, but additional verifiers can inherit the same upstream fault. We present VP-CONTROL, a runtime-assurance design and deterministic benchmark for cost-aware commit gates. Its 48 task templates yield 2,880 scenarios across six fault regimes. A fixed-call 2 x 2 experiment separates verifier-model diversity from evidence-source diversity. On frozen proposals from two local actor families, a cross-model vote over shared evidence approves 62.9% of unsafe proposals, versus 22.9% with an independent source. The source effect is 40.9 percentage points, compared with 11.3 for model diversity. A portfolio controller selects verification plans using only deployment-observable metadata. Approximate cluster-adjusted calibration at a nominal 5% per-task target yields 1.9% unsafe execution and 38.2% automated safe coverage on the locked test. Matched-budget portfolios also improve on fixed verification policies. Transfer remains conditional: unseen fault families yield 16-26% risk, and a FinQA check fails to reproduce the source effect with the tested small verifiers. A preregistered live HTTP/SQLite study tests concurrent writes and lost responses. After-check races defeat verifier-only gates; transactional partial guards prevent only covered failures, while a full atomic guard records no unsafe effects across 216 episodes. Idempotent request identifiers prevent duplicate effects after lost responses. The results motivate explicit evidence lineage, cost-aware selection, and commit-time enforcement, while exposing the limits of approximate calibration and local-tool generalization.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 19 of its 21 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

19 of 21 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026ProvenanceGuard: Source-Aware Factuality Verification for MCP-Based LLM Agents16 Jun
  2. 2025LM Agents May Fail to Act on Their Own Risk Knowledge19 Aug

Other references · 17

  1. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  2. 2022Conformal Risk Controlcited by 299
  3. 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 271
  4. 2025Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifierscited by 62
  5. 2026LLM-as-a-Verifier: A General-Purpose Verification Frameworkcited by 30
  6. 2025Verify when Uncertain: Beyond Self-Consistency in Black Box Hallucination Detectioncited by 18
  7. 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agentscited by 17
  8. 2026ToolGate: Contract-Grounded and Verified Tool Execution for LLMscited by 15
  9. 2025Sherlock: Reliable and Efficient Agentic Workflow Executioncited by 11
  10. 2026The Replay Gap: Static Evaluation of Model Switching in LLM Agents Scores the Wrong Worldcited by 8
  11. 2026CORA: Conformal Risk-Controlled Agents for Safeguarded Mobile GUI Automationcited by 7
  12. 2026Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliabilitycited by 7
5 more
  1. 2026A Large-Scale Study on the Development and Issues of Multi-Agent AI Systemscited by 6
  2. 2026SafeCommit: Certifying When Memory-Grounded Agents May Safely Actcited by 6
  3. 2026When Knowledge Is Not Free: Cost-Aware Evidence Selection in Retrieval-Augmented Generationcited by 3
  4. 2026Epistemic Sybil Resistance: Multiplying AI Agents Without Multiplying Evidencecited by 3
  5. 2026Partially Correlated Verifier Cascades in LLM Harnesses: Concave Log-Odds, Polynomial Reliability, and Blind-Spot Ceilingscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Trust Is Not a Score: Runtime Assurance Contracts for High-Risk AI Agents
  2. 2026A Trace-Based Assurance Framework for Agentic AI Orchestration: Contracts, Testing, and Governance
  3. 2026A Policy Algebra for Trust-Preserving Agentic AI Execution
  4. 2026Mnemosyne: Agentic Transaction Processing for Validating and Repairing AI-generated Workflows
  5. 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Tasks
  6. 2026Compositional Policy Violations: When Step-Level Compliance Fails In Agentic AI Workflows
  7. 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core
  8. 2026Schwarz: Solver-Aware Agentic Program Verification