SERA: Soft-Verified Efficient Repository Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Open-weight coding agents should hold a fundamental advantage over closed-source systems because they can specialize to private codebases, encoding repository-specific information directly in their weights. Yet the cost and complexity of training has kept this advantage theoretical until now. We present Soft-Verified Efficient Repository Agents (SERA), an efficient method for training coding agents that enables the rapid and cheap creation of agents specialized to private codebases. Using Soft Verified Generation (SVG), we generate thousands of trajectories from any code repository, without requiring unit tests. Beyond repository specialization, we apply SVG to a larger corpus of codebases, generating 200,000+ synthetic trajectories. Using only supervised finetuning (SFT), SERA achieves leading results among fully open-source (open data, method, code) models while matching the performance of open-weight models like Devstral-Small-2. Creating SERA models is 26x cheaper than reinforcement learning and 57x cheaper than previous synthetic data methods to reach equivalent performance. We use our dataset to provide detailed analysis of scaling laws, ablations, and confounding factors for training coding agents. Overall, we believe our work will greatly accelerate research on open coding agents and showcase the advantage of open-source models that can adapt to private codebases. We release SERA as the first model in Ai2's Open Coding Agents series, along with all our code, data, and Claude Code integration to support the research community.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 41 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
37 of 41 references.
Closest ancestors · 10
Same direction, newest first
- 2025Training Versatile Coding Agents in Synthetic Environments13 Dec
- 2025Devstral: Fine-tuning Language Models for Coding Agent Applications8 Aug
- 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMs24 Jun
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 27
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2017Deep Reinforcement Learning that Matterscited by 727
- 2018Born Again Neural Networkscited by 539
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
- 2020Implementation Matters in Deep Policy Gradients: A Case Study on PPO and TRPOcited by 184
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
- 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 89
15 more
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 87
- 2025SkyRL-Agent: Efficient RL Training for Multi-turn LLM Agentcited by 44
- 2025Agent-RLVR: Training Software Engineering Agents via Guidance and Environment Rewardscited by 41
- 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
- 2024BugsInPy: A Database of Existing Bugs in Python Programs to Enable Controlled Testing and Debugging Studiescited by 35
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 30
- 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 28
- 2025Coding Agents with Multimodal Browsing are Generalist Problem Solverscited by 24
- 2025SWE-Synth: Synthesizing Verifiable Bug-Fix Data to Enable Large Language Models in Resolving Real-World Bugscited by 22
- 2025Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Constructioncited by 17
- 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agentscited by 16
- 2025RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testingcited by 12
- 2025Shape of Thought: When Distribution Matters More than Correctness in Reasoning Taskscited by 8
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026SWE-chat: Coding Agent Interactions From Real Users in the Wildcited by 36
- 2026Tmax: A simple recipe for terminal agentscited by 24
- 2026On Randomness in Agentic Evalscited by 12
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Learning Next Action Predictors from Human-Computer Interactioncited by 7
- 2026From SWE-ZERO to SWE-HERO: Execution-free to Execution-based Fine-tuning for Software Engineering Agentscited by 5
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agentscited by 5
- 2026SWE-Prime: Fewer Trajectories, Better Performancecited by 3
- 2026M2A: Synergizing Mathematical and Agentic Reasoning in Large Language Modelscited by 0
- 2026CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agentscited by 0
- 2026CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agents22 Sep 2026
- 2026SWE-Prime: Fewer Trajectories, Better Performance27 Aug 2026
- 2026Tmax: A simple recipe for terminal agents22 Jun 2026
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agents14 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026M2A: Synergizing Mathematical and Agentic Reasoning in Large Language Models11 May 2026
- 2026SWE-chat: Coding Agent Interactions From Real Users in the Wild22 Apr 2026
- 2026From SWE-ZERO to SWE-HERO: Execution-free to Execution-based Fine-tuning for Software Engineering Agents2 Apr 2026
- 2026Learning Next Action Predictors from Human-Computer Interaction6 Mar 2026
- 2026On Randomness in Agentic Evals6 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026ISO-Bench: Can Coding Agents Optimize Real-World Inference Workloads?
- 2026SWE-Explore: Benchmarking How Coding Agents Explore Repositories
- 2026Teaching Agents to Code Reliably
- 2026RuBench: A Repository-Level Agentic Coding Benchmark with Natively Authored Russian Task Specifications
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
- 2026Schr"odinger's Code Repository: Have LLMs Learned SWE-bench or Memorized It?
- 2026CodeGrep: An RL-Trained Retrieval Agent for LLM Coding Agents
- 2026Zero2Repo: Can Coding Agents Build Repositories from Scratch?