mlsanityData to 7 Oct 2026

SERA: Soft-Verified Efficient Repository Agents

arXiv 2601.20789 ↗First posted 28 Jan 2026cs.CL cs.LG cs.SEcited by 10

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Open-weight coding agents should hold a fundamental advantage over closed-source systems because they can specialize to private codebases, encoding repository-specific information directly in their weights. Yet the cost and complexity of training has kept this advantage theoretical until now. We present Soft-Verified Efficient Repository Agents (SERA), an efficient method for training coding agents that enables the rapid and cheap creation of agents specialized to private codebases. Using Soft Verified Generation (SVG), we generate thousands of trajectories from any code repository, without requiring unit tests. Beyond repository specialization, we apply SVG to a larger corpus of codebases, generating 200,000+ synthetic trajectories. Using only supervised finetuning (SFT), SERA achieves leading results among fully open-source (open data, method, code) models while matching the performance of open-weight models like Devstral-Small-2. Creating SERA models is 26x cheaper than reinforcement learning and 57x cheaper than previous synthetic data methods to reach equivalent performance. We use our dataset to provide detailed analysis of scaling laws, ablations, and confounding factors for training coding agents. Overall, we believe our work will greatly accelerate research on open coding agents and showcase the advantage of open-source models that can adapt to private codebases. We release SERA as the first model in Ai2's Open Coding Agents series, along with all our code, data, and Claude Code integration to support the research community.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 41 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

37 of 41 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Training Versatile Coding Agents in Synthetic Environments13 Dec
  2. 2025Devstral: Fine-tuning Language Models for Coding Agent Applications8 Aug
  3. 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMs24 Jun
  4. 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
  5. 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
  6. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
  7. 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
  8. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  9. 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
  10. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May

Other references · 27

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2017Deep Reinforcement Learning that Matterscited by 727
  6. 2018Born Again Neural Networkscited by 539
  7. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
  8. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  9. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
  10. 2020Implementation Matters in Deep Policy Gradients: A Case Study on PPO and TRPOcited by 184
  11. 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
  12. 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 89
15 more
  1. 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
  2. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 87
  3. 2025SkyRL-Agent: Efficient RL Training for Multi-turn LLM Agentcited by 44
  4. 2025Agent-RLVR: Training Software Engineering Agents via Guidance and Environment Rewardscited by 41
  5. 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
  6. 2024BugsInPy: A Database of Existing Bugs in Python Programs to Enable Controlled Testing and Debugging Studiescited by 35
  7. 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
  8. 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 30
  9. 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 28
  10. 2025Coding Agents with Multimodal Browsing are Generalist Problem Solverscited by 24
  11. 2025SWE-Synth: Synthesizing Verifiable Bug-Fix Data to Enable Large Language Models in Resolving Real-World Bugscited by 22
  12. 2025Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Constructioncited by 17
  13. 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agentscited by 16
  14. 2025RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testingcited by 12
  15. 2025Shape of Thought: When Distribution Matters More than Correctness in Reasoning Taskscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ISO-Bench: Can Coding Agents Optimize Real-World Inference Workloads?
  2. 2026SWE-Explore: Benchmarking How Coding Agents Explore Repositories
  3. 2026Teaching Agents to Code Reliably
  4. 2026RuBench: A Repository-Level Agentic Coding Benchmark with Natively Authored Russian Task Specifications
  5. 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
  6. 2026Schr"odinger's Code Repository: Have LLMs Learned SWE-bench or Memorized It?
  7. 2026CodeGrep: An RL-Trained Retrieval Agent for LLM Coding Agents
  8. 2026Zero2Repo: Can Coding Agents Build Repositories from Scratch?