daVinci-Dev: Agent-native Mid-training for Software Engineering
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Recently, the frontier of Large Language Model (LLM) capabilities has shifted from single-turn code generation to agentic software engineering-a paradigm where models autonomously navigate, edit, and test complex repositories. While post-training methods have become the de facto approach for code agents, **agentic mid-training**-mid-training (MT) on large-scale data that mirrors authentic agentic workflows-remains critically underexplored due to substantial resource requirements, despite offering a more scalable path to instilling foundational agentic behaviors than relying solely on expensive reinforcement learning. A central challenge in realizing effective agentic mid-training is the distribution mismatch between static training data and the dynamic, feedback-rich environment of real development. To address this, we present a systematic study of agentic mid-training, establishing both the data synthesis principles and training methodology for effective agent development at scale. Central to our approach is **agent-native data**-supervision comprising two complementary types of trajectories: **contextually-native trajectories** that preserve the complete information flow an agent experiences, offering broad coverage and diversity; and **environmentally-native trajectories** collected from executable repositories where observations stem from actual tool invocations and test executions, providing depth and interaction authenticity. We verify the model's agentic capabilities on `SWE-Bench Verified`. We demonstrate our superiority over the previous open software engineering mid-training recipe `Kimi-Dev` under two post-training settings with an aligned base model and agentic scaffold, while using less than half mid-training tokens (73.1B). Besides relative advantage, our best performing 32B and 72B models achieve **56.1%** and **58.5%** resolution rates, respectively, which are ...
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 34 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
23 of 34 references.
Closest ancestors · 3
Same direction, newest first
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agents27 Sep
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
Other references · 20
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2025LIMO: Less is More for Reasoningcited by 488
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 319
- 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environmentscited by 120
- 2025OctoThinker: Mid-training Incentivizes Reinforcement Learning Scalingcited by 110
- 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Modelscited by 64
8 more
- 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuningcited by 51
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 30
- 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 28
- 2026AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contextscited by 26
- 2025A Survey on LLM Mid-Trainingcited by 18
- 2025InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Researchcited by 18
- 2024How Do Your Code LLMs Perform? Empowering Code Instruction Tuning with High-Quality Datacited by 8
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 21
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millionscited by 16
- 2026daVinci-Env: Open SWE Environment Synthesis at Scalecited by 13
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillationcited by 11
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
- 2026Orchard: An Open-Source Agentic Modeling Frameworkcited by 7
- 2026Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scalecited by 6
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agentscited by 5
- 2026daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficientlycited by 3
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Modelscited by 3
- 2026State2State: Environment-Derived Mid-Training for LLM Agentscited by 1
- 2026CodeSkill: Latent Skill Abstraction for Long-Horizon Code Agents27 Sep 2026
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
- 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling5 Aug 2026
- 2026State2State: Environment-Derived Mid-Training for LLM Agents5 Aug 2026
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models13 Jul 2026
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Design14 Jun 2026
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agents14 Jun 2026
- 2026Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale13 Jun 2026
- 2026Orchard: An Open-Source Agentic Modeling Framework14 May 2026
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillation8 May 2026
- 2026daVinci-Env: Open SWE Environment Synthesis at Scale13 Mar 2026
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environments3 Feb 2026
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 21
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
- 2026Orchard: An Open-Source Agentic Modeling Frameworkcited by 7
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agentscited by 5
- 2026daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficientlycited by 3
- 2026State2State: Environment-Derived Mid-Training for LLM Agentscited by 1
- 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modelingcited by 1
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 0
- 2026CodeSkill: Latent Skill Abstraction for Long-Horizon Code Agentscited by 0
- 2026CodeSkill: Latent Skill Abstraction for Long-Horizon Code Agents27 Sep 2026
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
- 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling5 Aug 2026
- 2026State2State: Environment-Derived Mid-Training for LLM Agents5 Aug 2026
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Design14 Jun 2026
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agents14 Jun 2026
- 2026Orchard: An Open-Source Agentic Modeling Framework14 May 2026
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environments3 Feb 2026
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training3 Feb 2026
- 2026daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently2 Feb 2026
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millionscited by 16
- 2026daVinci-Env: Open SWE Environment Synthesis at Scalecited by 13
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillationcited by 11
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Modelscited by 3
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models13 Jul 2026
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillation8 May 2026
- 2026daVinci-Env: Open SWE Environment Synthesis at Scale13 Mar 2026
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millions2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026MidTool: Mid-training Data Synthesis for Agentic Tool Use
- 2025KAT-Coder Technical Report
- 2025SWE-Dev: Building Software Engineering Agents with Training and Inference Scaling
- 2025Training Versatile Coding Agents in Synthetic Environments
- 2026Agentic AI in the Software Development Lifecycle: Architecture, Empirical Evidence, and the Reshaping of Software Engineering
- 2026Yet Even Less Is Even Better For Agentic, Reasoning, and Coding LLMs
- 2026Understanding by Reconstruction: Reversing the Software Development Process for LLM Pretraining
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itself