mlsanityData to 7 Oct 2026

VERA: Scaling Verifiable Environments for Agentic co-Evolution

arXiv 2610.05923 ↗First posted 5 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Agent skill learning and evolution

Abstract (arXiv)

Competent agents need precise and verifiable environments, such as sandboxes that are resumable at any stage and evolve from observable evidence. However, most long-horizon work exposes how rare these are: for example, an agent in medical research must ground a finding, classify it, and write a report over dozens of dependent steps, yet recent environments score only the outcome. To address the challenges in stable training, we present VERA, which builds such environments at scale and lets agents evolve on them. VERA builds these environments from initial trajectories: an agent writes rubrics, executable checks, a judge verifies each sandbox, and only those that pass enter the training bank. On these environments, VERA alternates between two updates: train the model with rubric rewards, or edit the harness skills. We also create a verifier which gates model checkpoints and harness edits using explicit development-set acceptance criteria. This attribution distinguishes VERA's co-evolution from single-axis baselines: its updates target not only the cause but the outcome. With an open-source corpus of 9,000+ long-horizon verifiable environments, a 9B model paired with its co-evolved agent beats the strongest baseline by 10.3 and 13.0 points in the two domains. At 27B, it surpasses the baseline on AutoCoWorkBench (71.6) and AutoMedBench (80.7), transfers to unseen workflows, and retains general capabilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. First posted on arXiv 5 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SEAL: Synergistic Co-Evolution of Agents and Learning Environments
  2. 2026Environment Evolution for Terminal Agents
  3. 2026HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention
  4. 2026Reward-Free Evolving Agents via Pairwise Validator
  5. 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
  6. 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrations
  7. 2026From Memory to Skills: Evidence-Grounded Co-Evolution Governance for Long-Horizon LLM Agents
  8. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification