VASO: Formally Verifiable Self-Evolving Skills for Physical AI Agents
On the map: LLM agents and tool use → Agent skill learning and evolution
also in 1 more
Abstract (arXiv)
Reusable robot skills are becoming the basic units through which embodied agents turn open-ended instructions into long-horizon physical behavior. We argue that, while foundation models have collapsed the cost of creating these skills, the cost of trusting them has not. Existing skill-evolution loops refine skills through execution feedback, unit tests, environment reward, or LLM self-critique, but these signals provide only trace-level evidence: they show that a skill worked on sampled executions, not that skill-induced plans satisfy temporal safety contracts under untested conditions. We introduce VASO, a framework for verification-guided self-evolution of LLM-generated robot skill contracts. In VASO, each skill is represented as a semantic contract with two coupled interfaces: a formal interface that aligns robot states, observations, and control commands with logical propositions for model checking, and a planner-facing interface that guides executable behavior generation. A model checker first filters logically inconsistent skill contracts, then verifies plans induced by the skill against global and local temporal specifications. When verification fails, VASO translates the counterexample trace into a textual gradient that updates the reusable skill contract while keeping foundation-model weights frozen. On Clearpath Jackal and PX4 quadcopter tasks, VASO reaches 97.2% formal-specification compliance using fewer than 100 optimization samples, outperforming execution-feedback, prompt-optimization, and fine-tuning baselines. To our knowledge, VASO is the first framework that closes the loop between formal verification and self-evolving LLM-generated skills for physical AI agents: formal counterexamples become optimization feedback for reusable robot skill contracts, rather than merely verifying one-off plans, tuning planner prompts, or fine-tuning model weights.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 26 of its 33 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
26 of 33 references.
References · 26
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2020Learning to summarize from human feedbackcited by 2,588
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2024TextGrad: Automatic "Differentiation" via Textcited by 273
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 115
14 more
- 2024TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Taskscited by 75
- 2024Exploring LLM-based Agents for Root Cause Analysiscited by 61
- 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 61
- 2023Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environmentscited by 53
- 2024Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Toolscited by 47
- 2023Deploying and Evaluating LLMs to Program Service Mobile Robotscited by 36
- 2025LLM-AutoDiff: Auto-Differentiate Any LLM Workflowcited by 21
- 2024LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robotscited by 16
- 2025VerifyLLM: LLM-Based Pre-Execution Task Plan Verification for Robotscited by 14
- 2024Know Where You're Uncertain When Planning with Multimodal Foundation Models: A Formal Frameworkcited by 13
- 2023Fine-Tuning Language Models Using Formal Methods Feedbackcited by 12
- 2023Multimodal Pretrained Models for Verifiable Sequential Decision-Making: Planning, Grounding, and Perceptioncited by 8
- 2024Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning Code LLMscited by 6
- 2025LAD-VF: LLM-Automatic Differentiation Enables Fine-Tuning-Free Robot Planning from Formal Methods Feedbackcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills
- 2026Embodied Skill Bench: Benchmarking How Well Agents with Embodied Skills Perform on Physical Tasks
- 2026TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents
- 2026OpenSkill: Open-World Self-Evolution for LLM Agents
- 2026Methods for Formal Verification of Agent Skills: Three Layers Toward a Mechanically Checkable Capability-Containment Proof
- 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills
- 2026From Digital to Physical: Digital Agents as Autonomous Coaches for Physical Intelligence