Runaway is Ashamed, But Helpful: On the Early-Exit Behavior of Large Language Model-based Agents in Embodied Environments
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Agents powered by large language models (LLMs) have demonstrated strong planning and decision-making capabilities in complex embodied environments. However, such agents often suffer from inefficiencies in multi-turn interactions, frequently trapped in repetitive loops or issuing ineffective commands, leading to redundant computational overhead. Instead of relying solely on learning from trajectories, we take a first step toward exploring the early-exit behavior for LLM-based agents. We propose two complementary approaches: 1. an intrinsic method that injects exit instructions during generation, and 2. an extrinsic method that verifies task completion to determine when to halt an agent's trial. To evaluate early-exit mechanisms, we introduce two metrics: one measures the reduction of redundant steps as a positive effect, and the other evaluates progress degradation as a negative effect. Experiments with 4 different LLMs across 5 embodied environments show significant efficiency improvements, with only minor drops in agent performance. We also validate a practical strategy where a stronger agent assists after an early-exit agent, achieving better performance with the same total steps. We will release our code to support further research.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 36 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
26 of 36 references.
Closest ancestors · 8
Same direction, newest first
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
- 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuning3 Jan
- 2024PreAct: Prediction Enhances Agent's Planning Ability18 Feb
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents24 Jan
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
- 2023ExpeL: LLM Agents Are Experiential Learners20 Aug
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks27 May
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 570
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2020BERT Loses Patience: Fast and Robust Inference with Early Exitcited by 273
6 more
- 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 244
- 2025Dynamic Early Exit in Reasoning Modelscited by 219
- 2019Interactive Fiction Games: A Colossal Adventurecited by 168
- 2024Autonomous Evaluation and Refinement of Digital Agentscited by 137
- 2024A Survey on Large Language Model-Based Game Agentscited by 112
- 2024StateFlow: Enhancing LLM Task-Solving through State-Driven Workflowscited by 65
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2026AdaRubric: Task-Adaptive Rubrics for Reliable LLM Agent Evaluation and Reward Learningcited by 13
- 2025Routine: A Structural Planning Framework for LLM Agent System in Enterprisecited by 9
- 2025Conformal Constrained Policy Optimization for Cost-Effective LLM Agentscited by 7
- 2026The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Checkcited by 6
- 2026AgentStop: Terminating Local AI Agents Early to Save Energy in Consumer Devicescited by 6
- 2026Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascadecited by 4
- 2026EarlyEval: Cheaper Agent Evaluation via Early Outcome Predictioncited by 3
- 2026Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agentscited by 2
- 2026The Unreliable Progress Bar: Can LLM Agents Reliably Report Task Progress Throughout Execution?cited by 1
- 2026FrankenReport: Early Exiting in Long-Form Generation Using Expected Value of Computationcited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agentscited by 0
- 2026DeLoop: Repeated Actions as Self-Supervision for Long-Horizon Agentscited by 0
- 2026DeLoop: Repeated Actions as Self-Supervision for Long-Horizon Agents14 Oct 2026
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026The Unreliable Progress Bar: Can LLM Agents Reliably Report Task Progress Throughout Execution?8 Sep 2026
- 2026FrankenReport: Early Exiting in Long-Form Generation Using Expected Value of Computation6 Sep 2026
- 2026EarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction2 Sep 2026
- 2026Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agents30 Aug 2026
- 2026Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade7 Jul 2026
- 2026AgentStop: Terminating Local AI Agents Early to Save Energy in Consumer Devices1 May 2026
- 2026AdaRubric: Task-Adaptive Rubrics for Reliable LLM Agent Evaluation and Reward Learning22 Mar 2026
- 2026The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check19 Jan 2026
- 2025Conformal Constrained Policy Optimization for Cost-Effective LLM Agents14 Nov 2025
- 2025Routine: A Structural Planning Framework for LLM Agent System in Enterprise19 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2023Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
- 2024LangSuitE: Planning, Controlling and Interacting with Large Language Models in Embodied Text Environments
- 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making
- 2026TypeGo: An OS Runtime for Embodied Agents
- 2026OdysseyArena: Benchmarking Large Language Models For Long-Horizon, Active and Inductive Interactions
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward
- 2025A Practitioner's Guide to Multi-turn Agentic Reinforcement Learning
- 2026Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents