mlsanityData to 14 Oct 2026

SkillForge: Compositional Skill Synthesis with Verification-in-the-Loop for Generating Formally Verified Dafny Programs

arXiv 2608.29841 ↗First posted 30 Aug 2026cs.CL cs.PLcited by 0

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Generating formally verified programs from natural language remains challenging: existing approaches either produce code in a single pass without recourse when verification fails, or rely on open-ended agentic reasoning that is non-deterministic and opaque. We introduce SKILLFORGE, a framework that decomposes formal code synthesis into a library of atomic, reusable skills, each targeting a specific subtask such as specification inference, body synthesis, invariant generation, error diagnosis, or targeted repair, and defined by a prompt template, tool binding, and decidable success criterion. A verification-driven harness orchestrates these skills: it submits candidates to the Dafny verifier, diagnoses failures into structured categories, deterministically routes to the appropriate repair skill, and iterates until formal correctness is proved or a budget is exhausted. On a curated benchmark of natural language to Dafny specification pairs, SKILLFORGE substantially outperforms both state-of-the-art agentic approaches (including ReAct-style agents, MCTS-based repair, and RL-guided verification) and traditional iterative baselines, while requiring fewer tokens and lower latency. Ablation studies confirm that every skill contributes measurably, and the harness converges rapidly with the majority of programs verified on the first attempt.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 23 of its 71 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

23 of 71 references.

References · 23

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
  5. 2023Planning with Large Language Models for Code Generationcited by 182
  6. 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 82
  7. 2023Clover: Closed-Loop Verifiable Code Generationcited by 67
  8. 2026Memento-Skills: Let Agents Design Agentscited by 62
  9. 2024Towards AI-Assisted Synthesis of Verified Dafny Methodscited by 58
  10. 2024Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verificationcited by 58
  11. 2024DafnyBench: A Benchmark for Formal Software Verificationcited by 57
  12. 2023Ranking LLM-Generated Loop Invariants for Program Verificationcited by 33
11 more
  1. 2025A benchmark for vericoding: formally verified program synthesiscited by 20
  2. 2023Large Language Models Based Automatic Synthesis of Software Specificationscited by 13
  3. 2025Large Language Models for Code Generation: The Practitioners Perspectivecited by 9
  4. 2023Towards General Loop Invariant Generation: A Benchmark of Programs with Memory Manipulationcited by 7
  5. 2025Dafny as Verification-Aware Intermediate Language for Code Generationcited by 6
  6. 2025Adaptive Proof Refinement with LLM-Guided Strategy Selectioncited by 5
  7. 2026Chain-Aware Encoding for Microservice Trace Anomaly Detectioncited by 4
  8. 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generationcited by 3
  9. 2025Cross-Asset Risk Management: Integrating LLMs for Real-Time Monitoring of Equity, Fixed Income, and Currency Marketscited by 2
  10. 2025Dynamic Hedging Strategies in Derivatives Markets with LLM-Driven Sentiment and News Analyticscited by 2
  11. 2025MINIF2F-DAFNY: LLM-Guided Mathematical Theorem Proving via Auto-Active Verificationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AxDafny: Agentic Verified Code Generation in Dafny
  2. 2026Skills as Verifiable Artifacts: A Trust Schema and a Biconditional Correctness Criterion for Human-in-the-Loop Agent Runtimes
  3. 2025Proof2Silicon: Prompt Repair for Verified Code and Hardware Generation via Reinforcement Learning
  4. 2026Intent-aligned Formal Specification Synthesis via Traceable Refinement
  5. 2026VeriSkill: A Self-Evolution Framework for Program Verification Skills
  6. 2026Methods for Formal Verification of Agent Skills: Three Layers Toward a Mechanically Checkable Capability-Containment Proof
  7. 2026Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agents
  8. 2026SkillOps: Managing LLM Agent Skill Libraries as Self-Maintaining Software Ecosystems