Immersion in the GitHub Universe: Scaling Coding Agents to Mastery
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Achieving mastery in real world software engineering tasks is fundamentally bottlenecked by the scarcity of large scale, high quality training data. Scaling such data has been limited by the complexity of environment setup, unit test generation, and problem statement curation. In this paper, we propose ScaleSWE, an automated, sandboxed multi agent workflow designed to construct high quality SWE data at scale. The system coordinates three specialized agents for environment setup, test creation, and problem description synthesis to process 6 million pull requests across 5200 repositories, producing Scale SWE Data: 100k verified SWE instances, the largest such dataset to date. It substantially surpasses existing real world datasets in repository diversity and reflects realistic task complexity. We further demonstrate the dataset utility for training by distilling 71498 high quality trajectories and finetuning Qwen30BA3BInstruct to produce ScaleSWE Agent. Our agent achieves a 64 resolve rate on SWE Bench Verified a nearly three fold improvement over the base model. ScaleSWE provides a scalable, reproducible approach for data construction to advance LLM based software engineering. Scale SWE will be publicly available.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 31 of its 52 references that are in the map. First posted on arXiv 10 Feb 2026.
Builds on
31 of 52 references.
Closest ancestors · 12
Same direction, newest first
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents14 Dec
- 2025The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agents5 Nov
- 2025KAT-Coder Technical Report21 Oct
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agents27 Sep
- 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMs24 Jun
- 2025GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents29 May
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2025SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents11 Apr
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 19
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
- 2026MiMo-V2-Flash Technical Reportcited by 163
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
- 2025SWE-bench Goes Live!cited by 74
- 2025Tongyi DeepResearch Technical Reportcited by 53
- 2025Training Long-Context, Multi-Turn Software Engineering Agents with Reinforcement Learningcited by 34
7 more
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 30
- 2025ARE: Scaling Up Agent Environments and Evaluationscited by 28
- 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 28
- 2025OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolutioncited by 24
- 2025SWE-fficiency: Can Language Models Optimize Real-World Repositories on Real Workloads?cited by 15
- 2025AInsteinBench: Benchmarking Coding Agents on Scientific Repositoriescited by 6
Built on by
Citing papers per year: 2026: 20.
20 papers.
Sort:
By area:
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?cited by 20
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 15
- 2026daVinci-Env: Open SWE Environment Synthesis at Scalecited by 13
- 2026SWE-TRACE: Optimizing Long-Horizon SWE Agents Through Rubric Process Reward Models and Heuristic Test-Time Scalingcited by 12
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agentscited by 9
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Orchard: An Open-Source Agentic Modeling Frameworkcited by 7
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Taskscited by 5
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoringcited by 5
- 2026Mach-Mind-4-Flash Technical Reportcited by 4
- 2026Learning to Commit: Generating Organic Pull Requests via Online Repository Memorycited by 3
8 more
- 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 3
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesiscited by 3
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesiscited by 1
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itselfcited by 1
- 2026KV-streams for Efficient Compaction in Agentic Reinforcement Learningcited by 1
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agentscited by 0
- 2026Rufus-Air: An Open LLM Post-Training Recipecited by 0
- 2026MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvementcited by 0
- 2026MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement8 Oct 2026
- 2026KV-streams for Efficient Compaction in Agentic Reinforcement Learning28 Sep 2026
- 2026Rufus-Air: An Open LLM Post-Training Recipe24 Sep 2026
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents23 Sep 2026
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itself18 Sep 2026
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesis7 Sep 2026
- 2026Intern-S2-Preview: Scientific Agentic Foundation Model13 Aug 2026
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring10 Aug 2026
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks6 Aug 2026
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis29 Jul 2026
- 2026Mach-Mind-4-Flash Technical Report10 Jul 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
8 more
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agents19 May 2026
- 2026Orchard: An Open-Source Agentic Modeling Framework14 May 2026
- 2026SWE-TRACE: Optimizing Long-Horizon SWE Agents Through Rubric Process Reward Models and Heuristic Test-Time Scaling16 Apr 2026
- 2026Toward Autonomous Long-Horizon Engineering for ML Research14 Apr 2026
- 2026Learning to Commit: Generating Organic Pull Requests via Online Repository Memory27 Mar 2026
- 2026daVinci-Env: Open SWE Environment Synthesis at Scale13 Mar 2026
- 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?3 Mar 2026
- 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?cited by 20
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 15
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agentscited by 9
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Orchard: An Open-Source Agentic Modeling Frameworkcited by 7
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoringcited by 5
- 2026Mach-Mind-4-Flash Technical Reportcited by 4
- 2026Learning to Commit: Generating Organic Pull Requests via Online Repository Memorycited by 3
- 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 3
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesiscited by 3
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesiscited by 1
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itselfcited by 1
12 most cited of 13 All 13 (JSON)
- 2026KV-streams for Efficient Compaction in Agentic Reinforcement Learning28 Sep 2026
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itself18 Sep 2026
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesis7 Sep 2026
- 2026Intern-S2-Preview: Scientific Agentic Foundation Model13 Aug 2026
- 2026SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring10 Aug 2026
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis29 Jul 2026
- 2026Mach-Mind-4-Flash Technical Report10 Jul 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agents19 May 2026
- 2026Orchard: An Open-Source Agentic Modeling Framework14 May 2026
- 2026Toward Autonomous Long-Horizon Engineering for ML Research14 Apr 2026
- 2026Learning to Commit: Generating Organic Pull Requests via Online Repository Memory27 Mar 2026
12 newest of 13 All 13 (JSON)
- 2026Rufus-Air: An Open LLM Post-Training Recipecited by 0
- 2026Rufus-Air: An Open LLM Post-Training Recipe24 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026SWE-Replay: Efficient Test-Time Scaling for Software Engineering Agents
- 2026SWE-Next: Scalable Real-World Software Engineering Tasks for Agents
- 2026DeNovoSWE: Scaling Long-Horizon Environments for Generating Entire Repositories from Scratch
- 2025Training Versatile Coding Agents in Synthetic Environments
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millions
- 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Tasks
- 2026E2E-SWE: Benchmarking LLMs on Building Working Codebases from Scratch
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environments