mlsanityData to 7 Oct 2026

EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agents

arXiv 2605.10332 ↗First posted 11 May 2026cs.AIcited by 12

On the map: LLM agents and tool use → Agent skill learning and evolution

also in 1 more
Abstract (arXiv)

Embodied agents can benefit from skills that guide object search, action execution, and state changes across diverse environments. Since embodied environments vary across layouts, object states, and other execution factors, these skills must self-evolve from trajectories generated during task execution. However, existing skill self-evolution methods are mainly developed in digital environments and often convert trajectories into coarse skill updates. Directly applying this paradigm to embodied settings is problematic, because a failed task execution may reflect not only incorrect skill content, but also an execution lapse in which the agent fails to follow valid guidance. We propose EmbodiSkill, a training-free framework for embodied skill self-evolution through skill-aware reflection and targeted revision. EmbodiSkill interprets each trajectory with respect to the current skill, uses skill-changing evidence to update the skill body, and uses execution-lapse evidence to preserve and emphasize valid guidance. Experiments on ALFWorld and EmbodiedBench show that EmbodiSkill consistently improves embodied task success. On ALFWorld, EmbodiSkill enables a frozen Qwen3.5-27B executor to reach 93.28% task success, outperforming GPT-5.2 used as a direct agent without skills by 31.58%. These results show that skill-aware self-evolution helps embodied agents accumulate reusable procedural knowledge from their own trajectories.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 15 of its 19 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

15 of 19 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Skill-Pro: Learning Reusable Skills from Experience via Non-Parametric PPO for LLM Agents2 Feb

Other references · 14

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  4. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  5. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  6. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  7. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  8. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  9. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  10. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  11. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
  12. 2025Memp: Exploring Agent Procedural Memorycited by 88
2 more
  1. 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 71
  2. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 65

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agents
  2. 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
  3. 2026RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents
  4. 2026SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessment
  5. 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents
  6. 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents
  7. 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks
  8. 2026RoboBridge: A Self-Evolving Embodied Agent Framework for Sim-to-Real Transfer