Stateful CARS: Exact Cross-History Reuse for Policy-Constrained LLM Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Tool-using language-model agents face constraints whose meaning changes with observations and prior actions. We study exact sampling from the model distribution conditioned on a hard stateful validator while reusing invalidity certificates across histories. Stateful CARS freezes a bank of sound state--continuation schemas within each attempt and removes every trajectory containing a certified continuation at a matching abstract state. An exact residual Doob transform samples from the resulting proposal. We give a checkable future-validity bisimulation condition, prove schema soundness, adaptive exactness, i.i.d. outputs, almost-sure termination, monotone acceptance, and compression invariance, and characterize computation by the number of reachable full-history product states. This number can be exponential for a history-dependent language model; the evaluated method therefore makes no generic finite-trie scalability claim. On enumerable workflows, its analytic law matches the valid conditional to 10-16 at validity probability 6×10-8, whereas state-aware local decoding can be 0.97 away. A matched comparison is negative: observation-keyed official CARS is cheaper in sampler steps (root/Stateful ratio 0.942 [0.934,0.951]), and the Qwen comparison is null (0.99 [0.90,1.08]). Cross-history transfer helps only in an internal matched-key ablation (1.27×). Thus the evidence supports exact schema-induced conditioning, not a systems advantage over CARS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 14 of its 27 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
14 of 27 references.
Closest ancestors · 1
Same direction, newest first
Other references · 13
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 411
- 2024Probabilistic Inference in Language Models via Twisted Sequential Monte Carlocited by 90
- 2024SynCode: LLM Generation with Grammar Augmentationcited by 69
- 2025Enforcing Temporal Constraints for LLM Agentscited by 34
- 2026ToolGate: Contract-Grounded and Verified Tool Execution for LLMscited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LOGIGEN: Logic-Driven Generation of Verifiable Agentic Tasks
- 2026From Natural Language Policies to Executable Obligations: A Verification Harness for Dependable In-Car LLM Agents
- 2026Harnessing LLMs as Agents: What Does It Cost?
- 2026Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability
- 2026AutoRefine: Compiling Trajectories into Validated Typed Agent Artifacts
- 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
- 2026Toward Scalable Verifiable Reward: Proxy State-Based Evaluation for Multi-turn Tool-Calling LLM Agents
- 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core