Conditional Multi-Stage Failure Recovery for Embodied Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Embodied agents performing complex tasks are susceptible to execution failures, motivating the need for effective failure recovery mechanisms. In this work, we introduce a conditional multistage failure recovery framework that employs zero-shot chain prompting. The framework is structured into four error-handling stages, with three operating during task execution and one functioning as a post-execution reflection phase. Our approach utilises the reasoning capabilities of LLMs to analyse execution challenges within their environmental context and devise strategic solutions. We evaluate our method on the TfD benchmark of the TEACH dataset and achieve state-of-the-art performance, outperforming a baseline without error recovery by 11.5% and surpassing the strongest existing model by 19%.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 41 of its 72 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
41 of 72 references.
References · 41
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
29 more
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 194
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
- 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
- 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
- 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
- 2021FILM: Following Instructions in Language with Modular Methodscited by 119
- 2021SOLQ: Segmenting Objects by Learning Queriescited by 68
- 2022VLMbench: A Compositional Benchmark for Vision-and-Language Manipulationcited by 68
- 2023SummIt: Iterative Text Summarization via ChatGPTcited by 53
- 2023Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agentscited by 33
- 2022JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agentscited by 29
- 2022Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedbackcited by 26
- 2024A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation using GPTcited by 19
- 2022Ask4Help: Learning to Leverage an Expert for Embodied Taskscited by 18
- 2022DANLI: Deliberative Agent for Following Natural Language Instructionscited by 15
- 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Modelscited by 8
- 2023Large Language Model Prompt Chaining for Long Legal Document Classificationcited by 7
- 2024Simulating User Agents for Embodied Conversational-AIcited by 6
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time
- 2026From Reaction to Anticipation: Proactive Failure Recovery through Agentic Task Graph for Robotic Manipulation
- 2025ReflexGrad: Within-Episode Failure Recovery in LLM Agents via Progress-Gated Dual-Process Routing
- 2026CARE: Experience-Guided Atomic Corrective Execution for Vision-Language-Action Policies
- 2026RPMS: Enhancing LLM-Based Embodied Planning through Rule-Augmented Memory Synergy
- 2026Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents
- 2026Recoverability Has a Law: The ERR Measure for Tool-Augmented Agents
- 2026Self-Evolving Just-In-Time Memory for Proactive Embodied Safety