G-CARB: Graph-Localized Conformal Agent Risk Budget for Compositional Harm
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Small language model (SLM) agents need safety controls that track consequences across tool calls with little monitoring overhead. A private read, for example, becomes a leak when a later action sends that data outside the system. We introduce CARB (Conformal Agent Risk Budget), which calibrates when to stop an agent using a ledger of harm incurred before stopping. Under exchangeable episodes, standard conformal risk control bounds this declared loss in expectation over calibration and a future episode. G-CARB selects scorer evidence along observable dependencies from private sources to outgoing actions. The ledger still covers the entire executed history, and computing the gate score requires no additional language-model inference. On AgentDojo replay with two 14B backbones, G-CARB roughly halves scorer-input records at intermediate risk budgets while improving autonomous task completion relative to full-prefix scoring; random context of the same size achieves similar gains. Controlled examples show how retaining the relevant dependency can further avoid stopping benign work.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. First posted on arXiv 4 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agent Safety From Within: Detecting Harmful Trajectories from LLM Internal States
- 2026Beyond Aggregate Risk: Role-Stratified Conformal Risk Control for LLM Tool Calls
- 2026Toward a Principled Framework for Agent Safety Measurement
- 2026SafeClawBench: Separating Semantic, Audit-Evidence, and Sandbox Harm in Tool-Using LLM Agents
- 2026PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety
- 2026Organising Trajectory Evidence for Language-Model Agent Assurance: Fragments, Methods, and the Residual
- 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystems
- 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents