EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agents
On the map: LLM agents and tool use → Agent skill learning and evolution
also in 1 more
Abstract (arXiv)
Embodied agents can benefit from skills that guide object search, action execution, and state changes across diverse environments. Since embodied environments vary across layouts, object states, and other execution factors, these skills must self-evolve from trajectories generated during task execution. However, existing skill self-evolution methods are mainly developed in digital environments and often convert trajectories into coarse skill updates. Directly applying this paradigm to embodied settings is problematic, because a failed task execution may reflect not only incorrect skill content, but also an execution lapse in which the agent fails to follow valid guidance. We propose EmbodiSkill, a training-free framework for embodied skill self-evolution through skill-aware reflection and targeted revision. EmbodiSkill interprets each trajectory with respect to the current skill, uses skill-changing evidence to update the skill body, and uses execution-lapse evidence to preserve and emphasize valid guidance. Experiments on ALFWorld and EmbodiedBench show that EmbodiSkill consistently improves embodied task success. On ALFWorld, EmbodiSkill enables a frozen Qwen3.5-27B executor to reach 93.28% task success, outperforming GPT-5.2 used as a direct agent without skills by 31.58%. These results show that skill-aware self-evolution helps embodied agents accumulate reusable procedural knowledge from their own trajectories.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 15 of its 19 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
15 of 19 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
- 2025Memp: Exploring Agent Procedural Memorycited by 88
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Self-Evolving Embodied Agents via Skill-Harness Evolutioncited by 8
- 2026Hypothesis-Driven Skill Optimization for LLM Agentscited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 5
- 2026Self-Evolving Cognitive Framework via Causal World Modeling for Embodied Scientific Intelligencecited by 1
- 2026When Multi-Robot Systems Meet Agentic AI:Towards Embodied Collective Intelligencecited by 0
- 2026What Language Does and What the Evidence Supports: A Functional Role Taxonomy and Evidence Audit of Language Grounding in Embodied Agentscited by 0
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experiencecited by 0
- 2026ME-VLM: A Unified VLM for Embodied Cognition and Agent Coordinationcited by 0
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
- 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolutioncited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environmentscited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments8 Oct 2026
- 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolution7 Oct 2026
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2026ME-VLM: A Unified VLM for Embodied Cognition and Agent Coordination21 Sep 2026
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement10 Sep 2026
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experience17 Aug 2026
- 2026Self-Evolving Embodied Agents via Skill-Harness Evolution11 Aug 2026
- 2026What Language Does and What the Evidence Supports: A Functional Role Taxonomy and Evidence Audit of Language Grounding in Embodied Agents4 Aug 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026When Multi-Robot Systems Meet Agentic AI:Towards Embodied Collective Intelligence26 Jun 2026
- 2026Self-Evolving Cognitive Framework via Causal World Modeling for Embodied Scientific Intelligence21 Jun 2026
- 2026Hypothesis-Driven Skill Optimization for LLM Agents21 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agents
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
- 2026RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents
- 2026SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessment
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents
- 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents
- 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks
- 2026RoboBridge: A Self-Evolving Embodied Agent Framework for Sim-to-Real Transfer