mlsanityData to 14 Oct 2026

Stateful CARS: Exact Cross-History Reuse for Policy-Constrained LLM Agents

arXiv 2608.08282 ↗First posted 8 Aug 2026cs.LGcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Tool-using language-model agents face constraints whose meaning changes with observations and prior actions. We study exact sampling from the model distribution conditioned on a hard stateful validator while reusing invalidity certificates across histories. Stateful CARS freezes a bank of sound state--continuation schemas within each attempt and removes every trajectory containing a certified continuation at a matching abstract state. An exact residual Doob transform samples from the resulting proposal. We give a checkable future-validity bisimulation condition, prove schema soundness, adaptive exactness, i.i.d. outputs, almost-sure termination, monotone acceptance, and compression invariance, and characterize computation by the number of reachable full-history product states. This number can be exponential for a history-dependent language model; the evaluated method therefore makes no generic finite-trie scalability claim. On enumerable workflows, its analytic law matches the valid conditional to 10-16 at validity probability 6×10-8, whereas state-aware local decoding can be 0.97 away. A matched comparison is negative: observation-keyed official CARS is cheaper in sampler steps (root/Stateful ratio 0.942 [0.934,0.951]), and the Qwen comparison is null (0.99 [0.90,1.08]). Cross-history transfer helps only in an internal matched-key ablation (1.27×). Thus the evidence supports exact schema-induced conditioning, not a systems advantage over CARS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 14 of its 27 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

14 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun

Other references · 13

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  7. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  8. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 411
  9. 2024Probabilistic Inference in Language Models via Twisted Sequential Monte Carlocited by 90
  10. 2024SynCode: LLM Generation with Grammar Augmentationcited by 69
  11. 2025Enforcing Temporal Constraints for LLM Agentscited by 34
  12. 2026ToolGate: Contract-Grounded and Verified Tool Execution for LLMscited by 15
1 more
  1. 2026Future Validity is the Missing Statistic: From Impossibility to Phi-Estimation for Grammar-Faithful Speculative Decodingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LOGIGEN: Logic-Driven Generation of Verifiable Agentic Tasks
  2. 2026From Natural Language Policies to Executable Obligations: A Verification Harness for Dependable In-Car LLM Agents
  3. 2026Harnessing LLMs as Agents: What Does It Cost?
  4. 2026Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability
  5. 2026AutoRefine: Compiling Trajectories into Validated Typed Agent Artifacts
  6. 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
  7. 2026Toward Scalable Verifiable Reward: Proxy State-Based Evaluation for Multi-turn Tool-Calling LLM Agents
  8. 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core