mlsanityData to 7 Oct 2026

Agentic Self-Evolutionary Replanning for Embodied Navigation

arXiv 2603.02772 ↗First posted 3 Mar 2026cs.ROcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Motion planners tuned under nominal conditions can fail when execution conditions change. Existing differentiable adaptation methods provide efficient online updates but remain constrained by static loss functions and gradient-only parameter updates. We propose Self-Evolutionary RePlanning (SERP), a failure-aware framework that jointly adapts motion-planner parameters and loss function weights from closed-loop execution feedback. SERP provides two adaptation mechanisms. First, in-context learning with auto-differentiation (ILAD) enables rapid online adaptation by coupling local numerical refinement with history-conditioned semantic intervention. Auto-differentiation performs numerical updates, while a vision-language model (VLM) interprets recent adaptation history to jointly revise planner parameters and loss weights when local adaptation becomes ineffective. Second, the memory-augmented rollout system (MARS) extends ILAD into a deliberative and evolutionary recovery process with memory-guided candidate generation and parallel low-fidelity rollout evaluation. The resulting recovery trace is then consolidated into recovery memory to guide future adaptation. Extensive simulation and real-world experiments demonstrate improved failure recovery performance over various baselines across diverse environments.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 29 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

21 of 29 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Open-Ended Instructable Embodied Agents with Memory-Augmented Large Language Models23 Oct

Other references · 20

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  3. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  4. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  5. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
  6. 2019Differentiable Convex Optimization Layerscited by 458
  7. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  8. 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 153
  9. 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 78
  10. 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
  11. 2019Motion Planning Networks: Bridging the Gap Between Learning-based and Classical Motion Plannerscited by 62
  12. 2017Optimization-Based Collision Avoidancecited by 28
8 more
  1. 2020RAPTOR: Robust and Perception-aware Trajectory Replanning for Quadrotor Fast Flightcited by 20
  2. 2022RDA: An Accelerated Collision Free Motion Planner for Autonomous Navigation in Cluttered Environmentscited by 13
  3. 2024MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Makingcited by 9
  4. 2019Teach-Repeat-Replan: A Complete and Robust System for Aggressive Flight in Complex Environmentscited by 8
  5. 2024NeuPAN: Direct Point Robot Navigation with End-to-End Model-based Learningcited by 7
  6. 2025LERa: Replanning with Visual Feedback in Instruction Followingcited by 7
  7. 2021Towards real-world navigation with deep differentiable plannerscited by 4
  8. 2023DiffTune-MPC: Closed-Loop Learning for Model Predictive Controlcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evolvable Embodied Agent for Robotic Manipulation via Long Short-Term Reflection and Optimization
  2. 2026Self-Evolving Embodied Agents via Skill-Harness Evolution
  3. 2026ASENA: Self-evolving Agents for Embodied Navigation
  4. 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolution
  5. 2026RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents
  6. 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvement
  7. 2026When Search Becomes Memory: Accelerating Robot Design Discovery with Self-Evolving Skills
  8. 2026Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction