mlsanityData to 7 Oct 2026

When Replanning Becomes the Bottleneck: Budgeted Replanning for Embodied Agents

arXiv 2608.01428 ↗First posted 2 Aug 2026cs.RO cs.AI cs.LGcited by 1

On the map: LLM agents and tool use → Tool learning and function calling

Abstract (arXiv)

Embodied agents replan frequently to recover from execution drift, partial observability, and coordination hazards, but each LLM-based replanning call can consume an accumulated textual context that grows over time and across agents. Once this context becomes large, replanning latency develops heavy tails and can miss real-time deadlines even when task success remains high, a failure mode that is hard to detect from average latency or success alone. We present BRACE, a controller that formulates replanning as a budgeted control loop by deciding whether to replan, selecting a replanning mode, and allocating an explicit token budget and latency service-level objective (SLO) while accounting for optional efficiency modules. As a reusable component, we introduce E-RECAP, a cost-aware progressive token pruning method that predicts token utility and prunes replanning contexts across transformer layers while preserving critical head and tail tokens. Across Meta Habitat, RoboFactory, and AirSim, BRACE with E-RECAP reduces replanning-call token counts by 62-92% and SLO violation rates from 85.5-100.0% to 4.7-50.0% in settings where task success is already saturated. In a harder RoboFactory setting where open-loop, frozen-plan, and No BRACE all fail, BRACE + E-RECAP reaches 80.0% success with 4.6% SLO violations, demonstrating that tail-aware per-call budgeting is effective across embodied platforms.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 33 of its 57 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

33 of 57 references.

References · 33

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  6. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  7. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  8. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  9. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  10. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  11. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
  12. 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 238
21 more
  1. 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
  2. 2021TEACh: Task-driven Embodied Agents that Chatcited by 194
  3. 2025TurboQuant: Online Vector Quantization with Near-optimal Distortion Ratecited by 116
  4. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 83
  5. 2024PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Taskscited by 78
  6. 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Accelerationcited by 56
  7. 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
  8. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
  9. 2024Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recyclingcited by 48
  10. 2024COMBO: Compositional World Models for Embodied Multi-Agent Cooperationcited by 47
  11. 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 40
  12. 2025RoboFactory: Exploring Embodied Agent Collaboration with Compositional Constraintscited by 31
  13. 2024SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Modelscited by 21
  14. 2024Fast and Accurate Task Planning using Neuro-Symbolic Language Models and Multi-level Goal Decompositioncited by 14
  15. 2025Taming the Fragility of KV Cache Eviction in LLM Inferencecited by 14
  16. 2025KV Cache Transform Coding for Compact Storage in LLM Inferencecited by 11
  17. 2026ReST-KV: Robust KV Cache Eviction with Layer-wise Output Reconstruction and Spatial-Temporal Smoothingcited by 9
  18. 2025Put Teacher in Student's Shoes: Cross-Distillation for Ultra-compact Model Compression Frameworkcited by 8
  19. 2025ToDRE: Effective Visual Token Pruning via Token Diversity and Task Relevancecited by 7
  20. 2025Meta-Optimization and Program Search using Language Models for Task and Motion Planningcited by 3
  21. 2025MaP-AVR: A Meta-Action Planner for Agents Leveraging Vision Language Models and Retrieval-Augmented Generationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentic Self-Evolutionary Replanning for Embodied Navigation
  2. 2025LERa: Replanning with Visual Feedback in Instruction Following
  3. 2024RePLan: Robotic Replanning with Perception and Language Models
  4. 2023Adaptive Online Replanning with Diffusion Models
  5. 2026Rethink Before You Execute: Adaptive Execution for World Action Models
  6. 2026HaReCAP: Habitual-action Grounding for Recursive Large Language Model Agents
  7. 2026ReCreate: Reasoning and Creating Domain Agents Driven by Experience
  8. 2026The Replay Gap: Static Evaluation of Model Switching in LLM Agents Scores the Wrong World