daVinci-Env: Open SWE Environment Synthesis at Scale
Not on the map. Why?
Abstract (arXiv)
Training capable software engineering (SWE) agents demands large-scale, executable, and verifiable environments that provide dynamic feedback loops for iterative code editing, test execution, and solution refinement. However, existing open-source datasets remain limited in scale and repository diversity, while industrial solutions are opaque with unreleased infrastructure, creating a prohibitive barrier for most academic research groups. We present OpenSWE, the largest fully transparent framework for SWE agent training in Python, comprising 45,320 executable Docker environments spanning over 12.8k repositories, with all Dockerfiles, evaluation scripts, and infrastructure fully open-sourced for reproducibility. OpenSWE is built through a multi-agent synthesis pipeline deployed across a 64-node distributed cluster, automating repository exploration, Dockerfile construction, evaluation script generation, and iterative test analysis. Beyond scale, we propose a quality-centric filtering pipeline that characterizes the inherent difficulty of each environment, filtering out instances that are either unsolvable or insufficiently challenging and retaining only those that maximize learning efficiency. With 891K spent on environment construction and an additional 576K on trajectory sampling and difficulty-aware curation, the entire project represents a total investment of approximately 1.47 million, yielding about 13,000 curated trajectories from roughly 9,000 quality guaranteed environments. Extensive experiments validate OpenSWE's effectiveness: OpenSWE-32B and OpenSWE-72B achieve 62.4% and 66.0% on SWE-bench Verified, establishing SOTA among Qwen2.5 series. Moreover, SWE-focused training yields substantial out-of-domain improvements, including up to 12 points on mathematical reasoning and 5 points on science benchmarks, without degrading factual recall.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
28 of 45 references.
References · 28
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
16 more
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agentscited by 127
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
- 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuningcited by 51
- 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 38
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agentscited by 35
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 30
- 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 28
- 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMscited by 24
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 21
- 2026Immersion in the GitHub Universe: Scaling Coding Agents to Masterycited by 20
- 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?cited by 20
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millionscited by 16
- 2026daVinci-Dev: Agent-native Mid-training for Software Engineeringcited by 15
- 2026daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficientlycited by 3
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 15
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillationcited by 11
- 2026Orchard: An Open-Source Agentic Modeling Frameworkcited by 7
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agentscited by 5
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoringcited by 5
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Modelscited by 3
- 2026LEGO-RL: Harness-Native Reinforcement Learning for Coding Agentscited by 3
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimizationcited by 2
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesiscited by 1
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itselfcited by 1
- 2026D3-Gym: Constructing Real-World Verifiable Environments for Data-Driven Discoverycited by 0
1 more
- 2026ROSS: Relearning from Self-Generated Rollouts through Selective Supervision28 Sep 2026
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itself18 Sep 2026
- 2026LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents18 Aug 2026
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring10 Aug 2026
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis29 Jul 2026
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models13 Jul 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimization15 Jun 2026
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agents14 Jun 2026
- 2026Orchard: An Open-Source Agentic Modeling Framework14 May 2026
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillation8 May 2026
- 2026D3-Gym: Constructing Real-World Verifiable Environments for Data-Driven Discovery30 Apr 2026
1 more
- 2026Toward Autonomous Long-Horizon Engineering for ML Research14 Apr 2026
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 15
- 2026Orchard: An Open-Source Agentic Modeling Frameworkcited by 7
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agentscited by 5
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoringcited by 5
- 2026LEGO-RL: Harness-Native Reinforcement Learning for Coding Agentscited by 3
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesiscited by 1
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itselfcited by 1
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itself18 Sep 2026
- 2026LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents18 Aug 2026
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring10 Aug 2026
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis29 Jul 2026
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agents14 Jun 2026
- 2026Orchard: An Open-Source Agentic Modeling Framework14 May 2026
- 2026Toward Autonomous Long-Horizon Engineering for ML Research14 Apr 2026
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillationcited by 11
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Modelscited by 3
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimizationcited by 2
- 2026D3-Gym: Constructing Real-World Verifiable Environments for Data-Driven Discoverycited by 0
- 2026EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models13 Jul 2026
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimization15 Jun 2026
- 2026SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillation8 May 2026
- 2026D3-Gym: Constructing Real-World Verifiable Environments for Data-Driven Discovery30 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025SWE-smith: Scaling Data for Software Engineering Agents
- 2026SWE-rebench V2: Language-Agnostic SWE Task Collection at Scale
- 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Tasks
- 2025Multi-Docker-Eval: A `Shovel of the Gold Rush' Benchmark on Automatic Environment Building for Software Engineering
- 2025SWE-Dev: Building Software Engineering Agents with Training and Inference Scaling
- 2026SWE-Next: Scalable Real-World Software Engineering Tasks for Agents
- 2025Training Versatile Coding Agents in Synthetic Environments
- 2026From SWE-ZERO to SWE-HERO: Execution-free to Execution-based Fine-tuning for Software Engineering Agents