Plan Verification for LLM-Based Embodied Task Completion Agents
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Large language model (LLM) based task plans and corresponding human demonstrations for embodied AI may be noisy, with unnecessary actions, redundant navigation, and logical errors that reduce policy quality. We propose an iterative verification framework in which a Judge LLM critiques action sequences and a Planner LLM applies the revisions, yielding progressively cleaner and more spatially coherent trajectories. Unlike rule-based approaches, our method relies on natural language prompting, enabling broad generalization across error types including irrelevant actions, contradictions, and missing steps. On a set of manually annotated actions from the TEACh embodied AI dataset, our framework achieves up to 90% recall and 100% precision across four state-of-the-art LLMs (GPT o4-mini, DeepSeek-R1, Gemini 2.5, LLaMA 4 Scout). The refinement loop converges quickly, with 96.5% of sequences requiring at most three iterations, while improving both temporal efficiency and spatial action organization. Crucially, the method preserves human error-recovery patterns rather than collapsing them, supporting future work on robust corrective behavior. By establishing plan verification as a reliable LLM capability for spatial planning and action refinement, we provide a scalable path to higher-quality training data for imitation learning in embodied AI.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 22 references that are in the map. First posted on arXiv 2 Sep 2025.
Builds on
18 of 22 references.
Closest ancestors · 3
Same direction, newest first
- 2024PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Tasks31 Oct
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models8 Dec
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents18 Jan
Other references · 15
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 197
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 126
- 2023Embodied Task Planning with Large Language Modelscited by 84
- 2023LLatrieval: LLM-Verified Retrieval for Verifiable Generationcited by 52
- 2025VerifyLLM: LLM-Based Pre-Execution Task Plan Verification for Robotscited by 14
3 more
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Factscited by 13
- 2026Toward Safe LLM Agents: A Survey of Specification, Verification, and Enforcementcited by 2
- 2026HomeSafe-Bench: Evaluating Vision-Language Models on Unsafe Action Detection for Embodied Agents in Household Scenarioscited by 1
- 2026GNNVerifier: Graph-based Verifier for LLM Task Planningcited by 1
- 2026Toward Safe LLM Agents: A Survey of Specification, Verification, and Enforcement22 Jun 2026
- 2026GNNVerifier: Graph-based Verifier for LLM Task Planning16 Mar 2026
- 2026HomeSafe-Bench: Evaluating Vision-Language Models on Unsafe Action Detection for Embodied Agents in Household Scenarios12 Mar 2026
- 2025Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Facts24 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2023Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Models
- 2025Constrained Natural Language Action Planning for Resilient Embodied Systems
- 2023Dynamic Planning with a LLM
- 2025Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learning
- 2024LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning
- 2026From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?
- 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making