mlsanityData to 7 Oct 2026

Token Budgets: An Empirical Catalog of 63 LLM-Agent Budget-Overrun Incidents, with an Affine-Typed Rust Mitigation as a Case Study

arXiv 2606.04056 ↗First posted 2 Jun 2026cs.SE cs.MA cs.PLcited by 4

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

LLM-agent budget overruns are a documented production failure class: a single retry loop can spend thousands of dollars before an operator notices, and the in-process integrity properties that would prevent it (no aliasing, no double-spend, no use-after-delegation of a cost-bearing value) are enforced, if at all, by ad-hoc wrappers rather than by the type system. Our central contribution is empirical: a catalog of 63 confirmed production incidents from 21 orchestration frameworks (2023-2026), each backed by a quoted GitHub issue and, where reported, a dollar loss, organized into an eight-cluster failure taxonomy (inter-rater Cohen's kappa = 0.837, N = 113), plus 47 supplementary structural entries. As one mitigation evaluated against this taxonomy, we build token-budgets, an 1,180-line Rust crate (no unsafe) that operationalizes affine ownership so that cloning, double-spending, or using a budget after delegating it are compile errors rather than runtime hazards an operator must remember to avoid. The dollar cap is runtime arithmetic under an estimator assumption; the affine layer makes that arithmetic non-bypassable. On single-agent workloads a 4-line Python counter matches the crate at 0/30 overshoot, so the distinguishing value is non-bypassability under operator error in multi-agent delegation: the delegation-fanout race documented in 11 incidents is rejected by the borrow checker at compile time, while the same pattern under asyncio overshoots 30/30 and three disciplined alternatives overshoot 0/30. Across five runtimes, three providers, and a temperature-stratified live-API test (N = 160), the approach reports zero cap violations and zero false refusals, at operational parity with concurrent work. Static over-reservation is 4-6x (2.11x adaptive). Binary-level cap-soundness on the running binary is left open.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 16 of its 89 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

16 of 89 references.

References · 16

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2016Deep Learning with Differential Privacycited by 2,682
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  6. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  7. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  8. 2017Renyi Differential Privacycited by 643
  9. 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
  10. 2023Verus: Verifying Rust Programs using Linear Ghost Types (extended version)cited by 50
  11. 2026Agent Contracts: A Formal Framework for Resource-Bounded Autonomous AI Systemscited by 12
  12. 2020RustHorn: CHC-based Verification for Rust Programs (full version)cited by 5
4 more
  1. 2017Linear Haskell: practical linearity in a higher-order polymorphic languagecited by 2
  2. 2019Proving Expected Sensitivity of Probabilistic Programs with Randomized Variable-Dependent Termination Timecited by 2
  3. 2018Running on Fumes--Preventing Out-of-Gas Vulnerabilities in Ethereum Smart Contracts using Static Resource Analysiscited by 1
  4. 2020Raising Expectations: Automating Expected Cost Analysis with Typescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime
  2. 2026Agent Mesh: Reliability Primitives for Non-Idempotent Agent Delegation - Identity Adequacy and Evidence Adequacy
  3. 2026Why Retrying Fails: Context Contamination in LLM Agent Pipelines
  4. 2026Evaluating and Improving Automated Repository-Level Rust Issue Resolution with LLM-based Agents
  5. 2026ChainCaps: Composition-Safe Tool-Using Agents via Monotonic Capability Attenuation
  6. 2026FailureAtlas: A Taxonomy of Failure Modes in Multi-Provider LLM Serving Infrastructure
  7. 2026OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality
  8. 2026When to Compile a Computer-Use Agent? Measuring Payback and Making Compilation Decisions for Token Efficiency