SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Despite rapid progress in LLM agents, performance on long-horizon, tool-using tasks remains fragile. To better understand this fragility, we ask a simple question: do all actions contribute equally to failure? Analyzing execution traces on τ-Bench (Airline/Retail) and SWE-Bench Verified, we decompose trajectories into mutating (environment-changing) vs. non-mutating steps and formalize decisive deviations, earliest action, level divergences that flip success to failure. A logistic regression reveals that each additional deviation in a mutating action reduces the odds of success by upto 92% on Airline and upto 96% on Retail for SoTA models. In contrast, deviations in non-mutating actions have little to no effect. Errors also grow with context length as agents drift from role and act on stale constraints. Motivated by these observations, we introduce cm, a model-agnostic, gradient-free, test-time safeguard that (i) adds mutation-gated verification, (ii) injects Targeted Reflection before mutating steps, and (iii) performs block-based context cleaning. cm delivers consistent gains, e.g., Qwen3-Thinking: +28% relative on Airline, +11% on Retail, and +7% on SWE-Bench Verified; Claude: +9%/+7%. We further identify ceiling effects in τ-Bench, where annotation errors and underspecified tasks artificially cap model performance. To address this, we release τ-Bench Verified, which restores benchmark headroom through targeted revisions. Our results argue for action-level analysis, targeted safeguards, and reliable evaluations as prerequisites for robust multi-turn agents.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 27 of its 39 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
27 of 39 references.
Closest ancestors · 7
Same direction, newest first
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
- 2024MarsCode Agent: AI-native Automated Bug Fixing2 Sep
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
- 2024Executable Code Actions Elicit Better LLM Agents1 Feb
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
Other references · 20
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
8 more
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 100
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 82
- 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 81
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 55
- 2024USimAgent: Large Language Models for Simulating Search Userscited by 32
- 2024ChatShop: Interactive Information Seeking with Language Agentscited by 24
- 2025HiMA-Ecom: Enabling Joint Training of Hierarchical Multi-Agent E-commerce Assistantscited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 20.
21 papers.
Sort:
By area:
- 2026From Confident Closing to Silent Failure: Characterizing False Success in LLM Agentscited by 15
- 2026Log analysis is necessary for credible evaluation of AI agentscited by 10
- 2025Agentic Software Issue Resolution with Large Language Models: A Surveycited by 6
- 2026Near-Miss: Latent Policy Failure Detection in Agentic Workflowscited by 4
- 2026Sell Me This Stock: Unsafe Recommendation Drift in LLM Agentscited by 2
- 2026Don't Make Models Guess Security and Safety: Symbolic Guardrails for Domain-Specific AI Agentscited by 2
- 2026When Should Service Agents Reconsider? Difficulty-Routed Control in Customer-Service Operationscited by 2
- 2026Flat Score, Amplified Failures: How the Error Budget Masks Damage in Quantized LLM Agentscited by 2
- 2026Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agentscited by 1
- 2026MidTool: Mid-training Data Synthesis for Agentic Tool Usecited by 1
- 2026TwinCheck: Evidence-Grounded Negative-Twin Verification for Stateful Tool Agentscited by 1
- 2026A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarkscited by 0
9 more
- 2026SEATauBench: Progressively Adapting Tool-Agent-User Evaluation Into Low-Resource Southeast Asian Languagescited by 0
- 2026No Task Fails Every Time: Why One-Shot Audits Are Structurally Blind to Agent Damagecited by 0
- 2026World Model Science: Self-Organized Criticality, Weak Chaos, and Metastable Belief Dynamics in Long-Horizon LLM Agentscited by 0
- 2026How Strongly Should Task State Influence an LLM Agent?cited by 0
- 2026When Agents Act Unwatched: The Reduced-Supervision Paradox in Agentic AIcited by 0
- 2026Clarify the User or Verify the World? Uncertainty Routing for Proactive Agentscited by 0
- 2026From Attack Success to Attack Severity: Counterfactual Memory Attacks on LLM Agentscited by 0
- 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agents29 Sep 2026
- 2026From Attack Success to Attack Severity: Counterfactual Memory Attacks on LLM Agents28 Sep 2026
- 2026Clarify the User or Verify the World? Uncertainty Routing for Proactive Agents26 Sep 2026
- 2026TwinCheck: Evidence-Grounded Negative-Twin Verification for Stateful Tool Agents22 Sep 2026
- 2026How Strongly Should Task State Influence an LLM Agent?22 Sep 2026
- 2026When Agents Act Unwatched: The Reduced-Supervision Paradox in Agentic AI28 Aug 2026
- 2026MidTool: Mid-training Data Synthesis for Agentic Tool Use20 Aug 2026
- 2026No Task Fails Every Time: Why One-Shot Audits Are Structurally Blind to Agent Damage15 Aug 2026
- 2026Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agents6 Aug 2026
- 2026Flat Score, Amplified Failures: How the Error Budget Masks Damage in Quantized LLM Agents29 Jul 2026
- 2026World Model Science: Self-Organized Criticality, Weak Chaos, and Metastable Belief Dynamics in Long-Horizon LLM Agents12 Jul 2026
9 more
- 2026When Should Service Agents Reconsider? Difficulty-Routed Control in Customer-Service Operations1 Jul 2026
- 2026SEATauBench: Progressively Adapting Tool-Agent-User Evaluation Into Low-Resource Southeast Asian Languages27 Jun 2026
- 2026From Confident Closing to Silent Failure: Characterizing False Success in LLM Agents1 Jun 2026
- 2026A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks27 May 2026
- 2026Log analysis is necessary for credible evaluation of AI agents8 May 2026
- 2026Don't Make Models Guess Security and Safety: Symbolic Guardrails for Domain-Specific AI Agents16 Apr 2026
- 2026Near-Miss: Latent Policy Failure Detection in Agentic Workflows31 Mar 2026
- 2026Sell Me This Stock: Unsafe Recommendation Drift in LLM Agents13 Mar 2026
- 2025Agentic Software Issue Resolution with Large Language Models: A Survey24 Dec 2025
- 2026From Confident Closing to Silent Failure: Characterizing False Success in LLM Agentscited by 15
- 2025Agentic Software Issue Resolution with Large Language Models: A Surveycited by 6
- 2026Near-Miss: Latent Policy Failure Detection in Agentic Workflowscited by 4
- 2026Sell Me This Stock: Unsafe Recommendation Drift in LLM Agentscited by 2
- 2026Flat Score, Amplified Failures: How the Error Budget Masks Damage in Quantized LLM Agentscited by 2
- 2026Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agentscited by 1
- 2026MidTool: Mid-training Data Synthesis for Agentic Tool Usecited by 1
- 2026TwinCheck: Evidence-Grounded Negative-Twin Verification for Stateful Tool Agentscited by 1
- 2026A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarkscited by 0
- 2026No Task Fails Every Time: Why One-Shot Audits Are Structurally Blind to Agent Damagecited by 0
- 2026How Strongly Should Task State Influence an LLM Agent?cited by 0
- 2026When Agents Act Unwatched: The Reduced-Supervision Paradox in Agentic AIcited by 0
12 most cited of 15 All 15 (JSON)
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026From Attack Success to Attack Severity: Counterfactual Memory Attacks on LLM Agents28 Sep 2026
- 2026Clarify the User or Verify the World? Uncertainty Routing for Proactive Agents26 Sep 2026
- 2026TwinCheck: Evidence-Grounded Negative-Twin Verification for Stateful Tool Agents22 Sep 2026
- 2026How Strongly Should Task State Influence an LLM Agent?22 Sep 2026
- 2026When Agents Act Unwatched: The Reduced-Supervision Paradox in Agentic AI28 Aug 2026
- 2026MidTool: Mid-training Data Synthesis for Agentic Tool Use20 Aug 2026
- 2026No Task Fails Every Time: Why One-Shot Audits Are Structurally Blind to Agent Damage15 Aug 2026
- 2026Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agents6 Aug 2026
- 2026Flat Score, Amplified Failures: How the Error Budget Masks Damage in Quantized LLM Agents29 Jul 2026
- 2026From Confident Closing to Silent Failure: Characterizing False Success in LLM Agents1 Jun 2026
- 2026A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks27 May 2026
12 newest of 15 All 15 (JSON)
- 2026Log analysis is necessary for credible evaluation of AI agentscited by 10
- 2026When Should Service Agents Reconsider? Difficulty-Routed Control in Customer-Service Operationscited by 2
- 2026SEATauBench: Progressively Adapting Tool-Agent-User Evaluation Into Low-Resource Southeast Asian Languagescited by 0
- 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agentscited by 0
- 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agents29 Sep 2026
- 2026When Should Service Agents Reconsider? Difficulty-Routed Control in Customer-Service Operations1 Jul 2026
- 2026SEATauBench: Progressively Adapting Tool-Agent-User Evaluation Into Low-Resource Southeast Asian Languages27 Jun 2026
- 2026Log analysis is necessary for credible evaluation of AI agents8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Error-Propagation Modeling for Failure Attribution in LLM-Based Multi-Agent Systems
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search
- 2026Maintaining Benchmarks Against Increasingly Capable Agents: Detection and Remediation of Unearned Passes
- 2026Calibration Is Not Control: Why LLM-Agent Oversight Needs Intervention
- 2026When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime
- 2026Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labels
- 2026Same Winners, Different Success Rates: Evaluating How LLM Agents Recover from Failures
- 2026Accurate Failure Prediction in Agents Does Not Imply Effective Failure Prevention