When May an Agent Stop? Evidence-Carrying Termination for Tool-Using LLMs
Not on the map. Why?
Abstract (arXiv)
Tool-using agents must decide when to stop. Existing systems already gate terminal success, certify execution traces, or enforce runtime polici es, but do not test this particular receipt-, scope-, and closed-replay design at the COMPLETE boundary across controlled termination faults. W e instantiate and evaluate Evidence-Carrying Termination (ECT): an agent may return COMPLETE only when a typed certificate binds every required answer claim to valid, in-scope trace evidence and a deterministic replay reconstructs the claimed value. A locked static study crosses 48 ful ly synthetic tasks in six tool-use families with clean execution and eight faults. ECT produced 0/288 unsafe completions versus 252/288 for the inspected termination-critic core (difference -87.50 pp, 95% task-cluster interval [-87.50, -87.50] pp). A fresh, prespecified and frozen 576- trajectory study then compares ECT with the critic core, its faithful controller, and a full-trace LLM critic. On 22 primary held-out task clus ters, ECT produced 0/66 premature unsupported terminations versus 40/66 for the controller (difference -60.61 pp, 95% interval [-78.79, -40.91] pp), while supported completion was 97/132 versus 92/132 (difference 3.79 pp, interval [0.00, 9.09] pp), satisfying a -10-point noninferiority margin. ECT executed successful recovery in 18/66 trajectories, of which 17 subsequently completed with support; all three closed-loop gates p assed. ECT certifies support in a recorded trace under declared assumptions, not external truth, safety, or alignment.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 17 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
17 of 17 references.
References · 17
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agentscited by 223
- 2023Model evaluation for extreme riskscited by 177
- 2024ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Modelscited by 25
- 2026Agentic Abstention: Do Agents Know When to Stop Instead of Act?cited by 15
- 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Taskscited by 13
- 2025Benchmarking Failures in Tool-Augmented Language Modelscited by 9
- 2026GroundEval: A Deterministic Replacement for LLM-as-Judge in Stateful Agent Evaluationcited by 6
- 2026Getting Better at Working With You: Compiling User Corrections into Runtime Enforcement for Coding Agentscited by 5
5 more
- 2026TRACER: Verifiable Generative Provenance for Multimodal Tool-Using Agentscited by 3
- 2026Proof-Carrying Certificates for LLM Pipelines: A Trust-Boundary Architecturecited by 2
- 2026No Certificate, No Execution: Certified Traces as a Foundation for Trustworthy AI Agentscited by 2
- 2026Goal-Autopilot: A Verifiable Anti-Fabrication Firewall for Unattended Long-Horizon Agentscited by 1
- 2026Auditing Emergent LLM-Agent Collaboration through Cooperation-Obligation Couplingcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026LLM Parkinsonism: Executive-Control Failure, Token-Inefficient Persistence, and an Uncertainty-Aware Global Executive Control Architecture for Autonomous Language-Model Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agentscited by 0
- 2026Judged Useless, Queried Anyway: Tool-Using Agents Rarely Turn Their Own Evidence Judgments into Stopping Decisionscited by 0
- 2026Judged Useless, Queried Anyway: Tool-Using Agents Rarely Turn Their Own Evidence Judgments into Stopping Decisions5 Oct 2026
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026LLM Parkinsonism: Executive-Control Failure, Token-Inefficient Persistence, and an Uncertainty-Aware Global Executive Control Architecture for Autonomous Language-Model Agents25 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agents
- 2026Validation Evidence in LLM Repair Agents: How Much of What Passes Actually Tests the Bug?
- 2026Auditing Agent Harness Safety
- 2026AgentCheck: A Reproduce-Intervene-Mitigate Workbench for LLM Agents over MCP
- 2026Silence Is Endorsement: Verification-Status Laundering in LLM Agent Pipelines
- 2025More Vulnerable than You Think: On the Stability of Tool-Integrated LLM Agents
- 2026CatchBench: When Can an Agent Failure Be Caught?
- 2026LLM Agents Can Easily Tamper With Their Own Traces