PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Cases
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Tool-augmented language agents frequently fail in real-world deployment due to tool malfunctions--timeouts, API exceptions, or inconsistent outputs--triggering cascading reasoning errors and task abandonment. Existing agent training pipelines optimize only for success trajectories, failing to expose models to the tool failures that dominate real-world usage. We propose PALADIN, a generalizable framework for equipping language agents with robust failure recovery capabilities. PALADIN trains on 50,000+ recovery-annotated trajectories constructed via systematic failure injection and expert demonstrations on an enhanced ToolBench dataset. Training uses LoRA-based fine-tuning to retain base capabilities while injecting recovery competence. At inference, PALADIN detects execution-time errors and retrieves the most similar case from a curated bank of 55+ failure exemplars aligned with ToolScan's taxonomy, then executes the corresponding recovery action. This approach generalizes to novel failures beyond the training distribution, retaining 95.2% recovery performance on unseen tool APIs. Evaluation across PaladinEval and ToolReflectEval demonstrates consistent improvements in Recovery Rate (RR), Task Success Rate (TSR), Catastrophic Success Rate (CSR), and Efficiency Score (ES). PALADIN improves RR from 32.76% to 89.68% (+57% relative) over ToolBench and outperforms the strongest baseline CRITIC (76.34%) by +13.3%. Against vanilla agents, PALADIN achieves 89.86% RR (+66% relative improvement from 23.75%). These results establish PALADIN as an effective method for building fault-tolerant agents capable of robust recovery in real-world tool environments.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 29 of its 56 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
29 of 56 references.
Closest ancestors · 5
Same direction, newest first
- 2024ToolScan: A Benchmark for Characterizing Errors in Tool-Use LLMs20 Nov
- 2024Tool Learning with Large Language Models: A Survey28 May
- 2024StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models12 Mar
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
Other references · 24
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2021A White Paper on Neural Network Quantizationcited by 472
- 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
- 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learningcited by 110
12 more
- 2024Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problemscited by 50
- 2024AGILE: A Novel Reinforcement Learning Framework of LLM Agentscited by 45
- 2024m&m's: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Taskscited by 38
- 2024Advancing Tool-Augmented Large Language Models: Integrating Insights from Errors in Inference Treescited by 38
- 2024ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Modelscited by 36
- 2024AEGIS: An Agent-based Framework for General Bug Reproduction from Issue Descriptionscited by 16
- 2025SHIELDA: Structured Handling of Exceptions in LLM-Driven Agentic Workflowscited by 13
- 2025Multi-Mission Tool Bench: Assessing the Robustness of LLM based Agents through Related and Dynamic Missionscited by 12
- 2024Towards Agentic Runtime Healingcited by 7
- 2025iTool: Reinforced Fine-Tuning with Dynamic Deficiency Calibration for Advanced Tool Usecited by 7
- 2025BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesiscited by 6
- 2023Enhancing Multi-Agent Coordination through Common Operating Picture Integrationcited by 2
Built on by
Citing papers per year: 2026: 22.
22 papers.
Sort:
By area:
- 2026AgentNoiseBench: Benchmarking Robustness of Tool-Using LLM Agents Under Noisy Conditioncited by 23
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agentscited by 21
- 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agentscited by 17
- 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agentscited by 14
- 2026Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errorscited by 10
- 2026DART: Semantic Recoverability for Structured Tool Agentscited by 10
- 2026Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMscited by 9
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environmentscited by 6
- 2026Safeguarding LLM Agents from Misalignment through Provenance Analysiscited by 6
- 2026Where Does Exactly-Once Live? Model, Harness, and Tool-Contract Effects on Duplicate Side Effects in LLM Agentscited by 3
- 2026RIVA: Leveraging LLM Agents for Reliable Configuration Drift Detectioncited by 2
- 2026Retry, Switch, or Abstain? Learning Strategy-Aware Tool-Use Policies via Controlled Error Injectioncited by 2
10 more
- 2026Outcome Monitors: Recovery Affordances for Silent Tool Failurescited by 2
- 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Projectcited by 1
- 2026Bounded Autonomy for Enterprise AI: Typed Action Contracts and Consumer-Side Executioncited by 1
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gapscited by 1
- 2026CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agentscited by 1
- 2026When the Database Fails: Prompting LLM Dialogue Agents for Safe Recovery in Task-Oriented Dialoguecited by 0
- 2026What Stops a Small Language Model From Driving a Database Agentcited by 0
- 2026When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agentscited by 0
- 2026Understanding and Mitigating Hallucination Escape in Tool-Using LLM Agentscited by 0
- 2026Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model Agentscited by 0
- 2026Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model Agents7 Oct 2026
- 2026Understanding and Mitigating Hallucination Escape in Tool-Using LLM Agents3 Oct 2026
- 2026When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agents29 Sep 2026
- 2026Where Does Exactly-Once Live? Model, Harness, and Tool-Contract Effects on Duplicate Side Effects in LLM Agents24 Sep 2026
- 2026What Stops a Small Language Model From Driving a Database Agent18 Sep 2026
- 2026CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents31 Aug 2026
- 2026Outcome Monitors: Recovery Affordances for Silent Tool Failures19 Aug 2026
- 2026Retry, Switch, or Abstain? Learning Strategy-Aware Tool-Use Policies via Controlled Error Injection12 Aug 2026
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
- 2026When the Database Fails: Prompting LLM Dialogue Agents for Safe Recovery in Task-Oriented Dialogue30 Jun 2026
- 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agents4 Jun 2026
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments26 May 2026
10 more
- 2026DART: Semantic Recoverability for Structured Tool Agents22 May 2026
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents6 May 2026
- 2026Safeguarding LLM Agents from Misalignment through Provenance Analysis1 May 2026
- 2026Bounded Autonomy for Enterprise AI: Typed Action Contracts and Consumer-Side Execution16 Apr 2026
- 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project22 Mar 2026
- 2026RIVA: Leveraging LLM Agents for Reliable Configuration Drift Detection2 Mar 2026
- 2026AgentNoiseBench: Benchmarking Robustness of Tool-Using LLM Agents Under Noisy Condition11 Feb 2026
- 2026Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs22 Jan 2026
- 2026Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors22 Jan 2026
- 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents18 Jan 2026
- 2026AgentNoiseBench: Benchmarking Robustness of Tool-Using LLM Agents Under Noisy Conditioncited by 23
- 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agentscited by 14
- 2026DART: Semantic Recoverability for Structured Tool Agentscited by 10
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environmentscited by 6
- 2026Safeguarding LLM Agents from Misalignment through Provenance Analysiscited by 6
- 2026Where Does Exactly-Once Live? Model, Harness, and Tool-Contract Effects on Duplicate Side Effects in LLM Agentscited by 3
- 2026RIVA: Leveraging LLM Agents for Reliable Configuration Drift Detectioncited by 2
- 2026Retry, Switch, or Abstain? Learning Strategy-Aware Tool-Use Policies via Controlled Error Injectioncited by 2
- 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Projectcited by 1
- 2026CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agentscited by 1
- 2026When the Database Fails: Prompting LLM Dialogue Agents for Safe Recovery in Task-Oriented Dialoguecited by 0
- 2026What Stops a Small Language Model From Driving a Database Agentcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model Agents7 Oct 2026
- 2026Understanding and Mitigating Hallucination Escape in Tool-Using LLM Agents3 Oct 2026
- 2026Where Does Exactly-Once Live? Model, Harness, and Tool-Contract Effects on Duplicate Side Effects in LLM Agents24 Sep 2026
- 2026What Stops a Small Language Model From Driving a Database Agent18 Sep 2026
- 2026CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents31 Aug 2026
- 2026Retry, Switch, or Abstain? Learning Strategy-Aware Tool-Use Policies via Controlled Error Injection12 Aug 2026
- 2026When the Database Fails: Prompting LLM Dialogue Agents for Safe Recovery in Task-Oriented Dialogue30 Jun 2026
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments26 May 2026
- 2026DART: Semantic Recoverability for Structured Tool Agents22 May 2026
- 2026Safeguarding LLM Agents from Misalignment through Provenance Analysis1 May 2026
- 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project22 Mar 2026
- 2026RIVA: Leveraging LLM Agents for Reliable Configuration Drift Detection2 Mar 2026
12 newest of 14 All 14 (JSON)
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agentscited by 21
- 2026Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMscited by 9
- 2026Outcome Monitors: Recovery Affordances for Silent Tool Failurescited by 2
- 2026Bounded Autonomy for Enterprise AI: Typed Action Contracts and Consumer-Side Executioncited by 1
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gapscited by 1
- 2026When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agentscited by 0
- 2026When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agents29 Sep 2026
- 2026Outcome Monitors: Recovery Affordances for Silent Tool Failures19 Aug 2026
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents6 May 2026
- 2026Bounded Autonomy for Enterprise AI: Typed Action Contracts and Consumer-Side Execution16 Apr 2026
- 2026Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs22 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Self-Healing Agentic Orchestrators for Reliable Tool-Augmented Large Language Model Systems
- 2026ToolMisuseBench: An Offline Deterministic Benchmark for Tool Misuse and Recovery in Agentic Systems
- 2025Failure Makes the Agent Stronger: Enhancing Accuracy through Structured Reflection for Reliable Tool Interactions
- 2026Learning from Failures: Heterogeneous Graph Memory for Small Language Model Tool-Using Agents
- 2026Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability
- 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
- 2026ParaRecover: A Process-Level Benchmark for Error Localization and Recovery in Parallel Tool-Use Agents
- 2026ToolRobustBench: Stage-Wise Perturbation Evaluation and Failure Diagnosis for Tool-Calling Agents