mlsanityData to 14 Oct 2026

Semantic Early-Stopping for Iterative LLM Agent Loops

arXiv 2606.27009 ↗First posted 25 Jun 2026cs.AI cs.LG cs.MAcited by 3

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Multi-agent large language model (LLM) loops, for example a Writer that drafts and a Critic that revises, are almost always terminated by a fixed iteration cap (max_iterations). This is a syntactic kill-switch: it is blind to whether the answer is still improving, so it over-spends tokens on easy inputs and truncates hard ones. We study semantic early-stopping: the loop halts when consecutive draft embeddings stop changing in meaning (cosine distance with a patience window) and the answer's measured quality stops improving. Our work makes three contributions. First, an honest theoretical footing: we prove deterministic termination and well-definedness and machine-check these claims, while treating the convergence of the distance sequence as an empirically tested conjecture rather than a (previously over-claimed) Banach contraction. Second, a judge-efficient evaluation protocol: we generate each question's full trajectory once, replay every stopping policy over the identical drafts, and cache every LLM-judge call, yielding a strictly paired efficiency-versus-quality comparison at low cost; we further separate operational tokens (charged to a policy) from evaluation tokens (a measurement instrument). Third, an empirical study on multi-hop retrieval-augmented question answering (HotpotQA). On the 60-question test split, a judge-free semantic stopper reduces operational tokens by 38% relative to max_iterations at parity quality (Delta-IS = -0.004, p = 0.81), whereas the full quality-gated variant is counter-productive because its per-round judging dominates cost. An oracle that selects the best round attains +0.115 Information Score over every practical policy (p ~ 4e-11), reframing the problem from "when to stop" (easy) to "which round is best" (open).

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 5 of its 12 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

5 of 12 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Phase-Scheduled Multi-Agent Systems for Token-Efficient Coordination19 Apr
  2. 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence18 Feb

Other references · 3

  1. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  2. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
  3. 2025Alpay Algebra V: Multi-Layered Semantic Games and Transfinite Fixed-Point Simulationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
  2. 2025Early Stopping Chain-of-thoughts in Large Language Models
  3. 2026Monitoring latent reasoning in looped language models
  4. 2025seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMs
  5. 2026A Mechanistic Analysis of Looped Reasoning Language Models
  6. 2024Designing Algorithms Empowered by Language Models: An Analytical Framework, Case Studies, and Insights
  7. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
  8. 2026Adaptive Stopping for Multi-Turn LLM Reasoning