Feedback That Backfires: Why Small Language Model Agents Repeat the Call They Just Watched Fail
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Agent harnesses record a failed tool call and its error message in the transcript and ask the model to continue, on the assumption that the error is corrective information. We measure whether it is. Defining the corrective gain of a failure record as the change in log-probability of re-emitting the action that just failed, we find the gain is negative for every instruction-tuned model we tested (6 checkpoints, 135M-1.7B, 4 families) in two environments: simulated tool calling and MBPP program repair. Normalised by action length the effect is about -1.03 nats per action token, a factor of 2.8 in the odds of each token, and holds on 90%-100% of individual items, not only on average. Over a fixed candidate set the probability of repeating the failed call rises from 0.06 to 0.54, and greedy decoding reproduces it token for token on 19% of items after the failure versus 0% before. Counterfactuals pairing the same call with a failure message, a success message, or a neutral acknowledgement separate two effects: the failed call's surface form accounts for 83% of the damage, while the semantic contribution of marking it failed is small and inconsistent in sign across environments. The problem is in the harness, not the model's grasp of error messages, and that predicts which remedies work. Replacing the verbatim call with a runtime-generated description of the failure removes 76% of the inversion at no token cost, and making previously-failed strings unreachable at the decoder acts on the same term. Two plausible remedies do not: an explicit "do not repeat" instruction leaves the measured quantity where it was, and deleting the failed attempt to retry from a clean context, the standard prescription for context contamination, is the worst harness we measured for repetition, because it restores the context that produced the failure. The study runs end to end on a CPU; all artefacts are released.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 41 of its 48 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
41 of 48 references.
Closest ancestors · 3
Same direction, newest first
- 2026Constraint Tax in Open-Weight LLMs: An Empirical Study of Tool Calling Suppression Under Structured Output Constraints24 Jun
- 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback19 Sep
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
Other references · 38
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
26 more
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2019Neural Text Generation with Unlikelihood Trainingcited by 489
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
- 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
- 2025Small Language Models are the Future of Agentic AIcited by 254
- 2023Efficient Guided Generation for Large Language Modelscited by 192
- 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 107
- 2022Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generationcited by 90
- 2023Copy Suppression: Comprehensively Understanding an Attention Headcited by 73
- 2024The Limits of Inference Scaling Through Resamplingcited by 51
- 2024Suppressing Pink Elephants with Direct Principle Feedbackcited by 13
- 2026Learning Agent-Compatible Context Management for Long-Horizon Taskscited by 12
- 2025Negation: A Pink Elephant in the Large Language Models' Room?cited by 7
- 2025Hell or High Water: Evaluating Agentic Recovery from External Failurescited by 6
- 2025Don't Adapt Small Language Models for Tools; Adapt Tool Schemas to the Modelscited by 6
- 2026When Agents Do Not Stop: Uncovering Infinite Agentic Loops in LLM Agentscited by 6
- 2025Understanding and Controlling Repetition Neurons and Induction Heads in In-Context Learningcited by 5
- 2024Do not think about pink elephant!cited by 3
- 2026Why Retrying Fails: Context Contamination in LLM Agent Pipelinescited by 3
- 2026Probing an Embodied LLM: When Higher Observation Fidelity Hurts Problem Solvingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model Agents
- 2026Tool Calling is Linearly Readable and Steerable in Language Models
- 2026Recoverability Has a Law: The ERR Measure for Tool-Augmented Agents
- 2026RESKILL: Explicit Failure Attribution and Structured Repair for Interactive Language Agents
- 2026Don't Blindly Trust It: How Unreliable Feedback Breaks Tool-Using LLM Agents
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time
- 2026Structured Feedback Improves Repair in an LLM Agent Loop
- 2026The Knowing-Saying Gap: When Probes See Errors that Confidence Misses