mlsanityData to 14 Oct 2026

Self-Evolving Embodied Agents via Skill-Harness Evolution

arXiv 2608.11350 ↗First posted 11 Aug 2026cs.CL cs.ROcited by 12

On the map: LLM agents and tool use → Multimodal and embodied agents

also in 1 more
Abstract (arXiv)

Embodied agents are increasingly built as systems around foundation models, where performance depends not only on model weights but also on the skills, context, action interfaces, and execution harness surrounding the model. While supervised fine-tuning and reinforcement learning can adapt agents to new environments, they require additional data, rewards, and training runs; meanwhile, many train-free code-centric approaches rely on programmable robot APIs that may be unavailable in fixed-interface settings. We propose SHAPER, a self-evolving framework for train-free embodied adaptation that keeps model parameters frozen and improves the non-parametric agent system by evolving reusable skills and a context-code harness through target-environment rollouts. In SHAPER, the same frozen model can serve as both planner and optimizer, refining its external skills and context-code harness without parameter updates. We evaluate SHAPER on VLABench and ESI-Bench, covering embodied agents with different low-level action interfaces, and compare against pure execution, supervised fine-tuning, and test-time-scaling baselines such as verifier-free selection and voting. Our results suggest that skill-and-harness optimization is a practical route to self-evolving embodied agents when model training is expensive, unavailable, or undesirable.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 33 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

28 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026AgentSpec: Understanding Embodied Agent Scaffolds Through Controlled Composition12 Jun

Other references · 27

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  8. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  9. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  10. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  11. 2025π*0.6: a VLA That Learns From Experiencecited by 303
  12. 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 176
15 more
  1. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175
  2. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
  3. 2025Improving Vision-Language-Action Model with Online Reinforcement Learningcited by 116
  4. 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 76
  5. 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 61
  6. 2026Natural-Language Agent Harnessescited by 61
  7. 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 26
  8. 2025Verifier-free Test-Time Sampling for Vision-Language-Action Modelscited by 23
  9. 2025VOTE: Vision-Language-Action Optimization with Trajectory Ensemble Votingcited by 22
  10. 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approachcited by 21
  11. 2026SOP: A Scalable Online Post-Training System for Vision-Language-Action Modelscited by 21
  12. 2026Recurrent-Depth VLA: Implicit Test-Time Compute Scaling of Vision-Language-Action Models via Latent Iterative Reasoningcited by 18
  13. 2026EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agentscited by 16
  14. 2026Beyond Imitation: Reinforcement Learning-Based Sim-Real Co-Training for VLA Modelscited by 9
  15. 2026TTT-VLA: Test-Time Latent Prompt Optimization for Vision-Language-Action Modelscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents
  2. 2026EmbodiedEvo: Self-Evolving Coding Agent For Physical Intelligence
  3. 2026Zetta zeta: An Efficient Closed-Loop Embodied Harness for Self-Evolving Physical Intelligence
  4. 2025Training Cross-Morphology Embodied AI Agents: From Practical Challenges to Theoretical Foundations
  5. 2026Evolvable Embodied Agent for Robotic Manipulation via Long Short-Term Reflection and Optimization
  6. 2026SEAR: Self-Evolving Agentic Robotics
  7. 2026Embodied Skill Bench: Benchmarking How Well Agents with Embodied Skills Perform on Physical Tasks
  8. 2026HarnessPAI: An Evolving Harness for Physical AI