mlsanityData to 7 Oct 2026

Conditional Multi-Stage Failure Recovery for Embodied Agents

arXiv 2507.06016 ↗First posted 8 Jul 2025cs.CLcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Embodied agents performing complex tasks are susceptible to execution failures, motivating the need for effective failure recovery mechanisms. In this work, we introduce a conditional multistage failure recovery framework that employs zero-shot chain prompting. The framework is structured into four error-handling stages, with three operating during task execution and one functioning as a post-execution reflection phase. Our approach utilises the reasoning capabilities of LLMs to analyse execution challenges within their environmental context and devise strategic solutions. We evaluate our method on the TfD benchmark of the TEACH dataset and achieve state-of-the-art performance, outperforming a baseline without error recovery by 11.5% and surpassing the strongest existing model by 19%.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 41 of its 72 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

41 of 72 references.

References · 41

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  8. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  9. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  10. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  11. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  12. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
29 more
  1. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  2. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  3. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  4. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  5. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  6. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  7. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  8. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  9. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  10. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
  11. 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
  12. 2021TEACh: Task-driven Embodied Agents that Chatcited by 194
  13. 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
  14. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  15. 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
  16. 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
  17. 2021FILM: Following Instructions in Language with Modular Methodscited by 119
  18. 2021SOLQ: Segmenting Objects by Learning Queriescited by 68
  19. 2022VLMbench: A Compositional Benchmark for Vision-and-Language Manipulationcited by 68
  20. 2023SummIt: Iterative Text Summarization via ChatGPTcited by 53
  21. 2023Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agentscited by 33
  22. 2022JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agentscited by 29
  23. 2022Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedbackcited by 26
  24. 2024A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation using GPTcited by 19
  25. 2022Ask4Help: Learning to Leverage an Expert for Embodied Taskscited by 18
  26. 2022DANLI: Deliberative Agent for Following Natural Language Instructionscited by 15
  27. 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Modelscited by 8
  28. 2023Large Language Model Prompt Chaining for Long Legal Document Classificationcited by 7
  29. 2024Simulating User Agents for Embodied Conversational-AIcited by 6

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time
  2. 2026From Reaction to Anticipation: Proactive Failure Recovery through Agentic Task Graph for Robotic Manipulation
  3. 2025ReflexGrad: Within-Episode Failure Recovery in LLM Agents via Progress-Gated Dual-Process Routing
  4. 2026CARE: Experience-Guided Atomic Corrective Execution for Vision-Language-Action Policies
  5. 2026RPMS: Enhancing LLM-Based Embodied Planning through Rule-Augmented Memory Synergy
  6. 2026Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents
  7. 2026Recoverability Has a Law: The ERR Measure for Tool-Augmented Agents
  8. 2026Self-Evolving Just-In-Time Memory for Proactive Embodied Safety