SHIELDA: Structured Handling of Exceptions in LLM-Driven Agentic Workflows
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large Language Model (LLM) agentic systems are software systems powered by LLMs that autonomously reason, plan, and execute multi-step workflows to achieve human goals, rather than merely executing predefined steps. During execution, these workflows frequently encounter exceptions. Existing exception handling solutions often treat exceptions superficially, failing to trace execution-phase exceptions to their reasoning-phase root causes. Furthermore, their recovery logic is brittle, lacking structured escalation pathways when initial attempts fail. To tackle these challenges, we first present a comprehensive taxonomy of 36 exception types across 12 agent artifacts. Building on this, we propose SHIELDA (Structured Handling of Exceptions in LLM-Driven Agentic Workflows), a modular runtime exception handling framework for LLM agentic workflows. SHIELDA uses an exception classifier to select a predefined exception handling pattern from a handling pattern registry. These patterns are then executed via a structured handling executor, comprising local handling, flow control, and state recovery, to enable phase-aware recovery by linking exceptions to their root causes and facilitating composable strategies. We validate SHIELDA's effectiveness through a case study on the AutoPR agent, demonstrating effective, cross-phase recovery from a reasoning-induced exception.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 38 of its 53 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
38 of 53 references.
Closest ancestors · 6
Same direction, newest first
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
- 2025LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-Agents19 Mar
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug
- 2024Towards Agentic Runtime Healing2 Aug
- 2023RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Models25 Oct
Other references · 32
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 533
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 476
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 402
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
20 more
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 153
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systemscited by 126
- 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 95
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 74
- 2024AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoningcited by 69
- 2025SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agentscited by 58
- 2024Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agentscited by 56
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 54
- 2024KnowHalu: Hallucination Detection via Multi-Form Knowledge Based Factual Checkingcited by 26
- 2024Tools Fail: Detecting Silent Errors in Faulty Toolscited by 23
- 2024Triad: A Framework Leveraging a Multi-Role LLM-based Agent to Solve Knowledge Base Question Answeringcited by 18
- 2024Asynchronous LLM Function Callingcited by 18
- 2025ToolFuzz -- Automated Agent Tool Testingcited by 18
- 2024Automating the Enterprise with Foundation Modelscited by 14
- 2023Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agentscited by 13
- 2024OneKE: A Dockerized Schema-Guided LLM Agent-based Knowledge Extraction Systemcited by 8
- 2024Human-Centered LLM-Agent User Interface: A Position Papercited by 3
- 2025Identifying and Mitigating API Misuse in Large Language Modelscited by 3
Built on by
Citing papers per year: 2025: 6; 2026: 6.
12 papers.
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
- 2025PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Casescited by 21
- 2025RAFFLES: Reasoning-based Attribution of Faults for LLM Systemscited by 19
- 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 11
- 2025Agentic Services Computingcited by 6
- 2026Graph-Based Self-Healing Tool Routing for Cost-Efficient LLM Agentscited by 3
- 2026When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtimecited by 1
- 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agentscited by 1
- 2026DCFA: Dual-view Causal-inspired Attribution for Failure Reasoning in LLM-based Multi-agent Systemscited by 1
- 2025Orchestrator Multi-Agent Clinical Decision Support System for Secondary Headache Diagnosis in Primary Carecited by 0
- 2026Agent System Operations: Categorization, Challenges, and Future Directionscited by 0
- 2026DeAR: Decentralized Agentic Reasoning via Capability Grounding and Collaborative Thought Navigationcited by 0
- 2026DCFA: Dual-view Causal-inspired Attribution for Failure Reasoning in LLM-based Multi-agent Systems4 Sep 2026
- 2026DeAR: Decentralized Agentic Reasoning via Capability Grounding and Collaborative Thought Navigation18 Aug 2026
- 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents7 Aug 2026
- 2026When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime12 Jun 2026
- 2026Agent System Operations: Categorization, Challenges, and Future Directions1 Jun 2026
- 2026Graph-Based Self-Healing Tool Routing for Cost-Efficient LLM Agents2 Mar 2026
- 2025Orchestrator Multi-Agent Clinical Decision Support System for Secondary Headache Diagnosis in Primary Care3 Dec 2025
- 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systems30 Oct 2025
- 2025Agentic Services Computing29 Sep 2025
- 2025PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Cases25 Sep 2025
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directions23 Sep 2025
- 2025RAFFLES: Reasoning-based Attribution of Faults for LLM Systems8 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2024Seeker: Towards Exception Safety Code Generation with Intermediate Language Agents Framework
- 2024Towards Exception Safety Code Generation with Intermediate Representation Agents Framework
- 2026When Agentic Executions Fail: Detecting and Localizing Runtime Faults from Telemetry
- 2026Observability and Fault Injection for LLM-Based Multi-Agent Systems in Software Engineering
- 2026Maat: Independent Deterministic Contract-Based Governance for Multi-Agent LLM Workflows
- 2025TRAIL: Trace Reasoning and Agentic Issue Localization
- 2025AgentCompass: Towards Reliable Evaluation of Agentic Workflows in Production
- 2026LLM-as-Code: Agentic Programming for Agent Harness