mlsanityData to 14 Oct 2026

MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis

arXiv 2607.27146 ↗First posted 29 Jul 2026cs.SE cs.CL cs.LGcited by 2

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Coding agents have made substantial progress on software engineering tasks that modify existing codebases, including bug fixing and feature implementation. However, constructing a complete program from scratch remains a major challenge: even the frontier models evaluated on ProgramBench fully resolve fewer than 1% of tasks. One obstacle is the lack of scalable training environments for this from-scratch setting, spanning the whole software engineering life cycle, as existing environment-construction frameworks focus only on a single phase in software development. To address this gap, we introduce MindForge, an automated pipeline that converts open-source command-line programs into source-free environments that expose only a compiled reference executable and its documentation. Using MindForge, we construct training environments from repositories disjoint from those in ProgramBench, and curate a high-quality data recipe consisting of program synthesis trajectories using GLM-5.2 as the teacher agent. Fine-tuning Qwen3.6-27B on these trajectories increases its ProgramBench average test pass rate from 37.98% to 49.51%, achieving performance comparable to substantially larger frontier models. Moreover, the fine-tuned model consistently improves over the base model across all seven unseen software engineering benchmarks, spanning long-horizon repository generation and translation, bug fixing, feature implementation, and cross-language issue resolution, with absolute gains of 31.00 points on RepoZero-C2Rust, 14.16 on DeepSWE, 10.70/4.56 on NL2Repo-Bench (with/without tests), 5.04 on SWE-bench Verified, 5.93 on SWE-bench Pro, 5.22 on SWE-bench Multilingual, and 4.94 on FeatBench.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 32 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

26 of 32 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026DeepSWE: Measuring Frontier Coding Agents on Original, Long-Horizon Engineering Tasks8 Jul
  2. 2026RepoZero: Can LLMs Generate a Code Repository from Scratch?8 May
  3. 2026SWE-Next: Scalable Real-World Software Engineering Tasks for Agents21 Mar
  4. 2026SWE-Prot'eg'e: Learning to Selectively Collaborate With an Expert Unlocks Small Language Models as Software Engineering Agents25 Feb
  5. 2026FeatureBench: Benchmarking Agentic Coding for Complex Feature Development11 Feb
  6. 2026Immersion in the GitHub Universe: Scaling Coding Agents to Mastery10 Feb
  7. 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents14 Dec
  8. 2025Devstral: Fine-tuning Language Models for Coding Agent Applications8 Aug
  9. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
  10. 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
  11. 2024Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvement1 Nov

Other references · 15

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  2. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  3. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  4. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  5. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 93
  6. 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 90
  7. 2026ProgramBench: Can Language Models Rebuild Programs From Scratch?cited by 59
  8. 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 31
  9. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 30
  10. 2025RPG: A Repository Planning Graph for Unified and Scalable Codebase Generationcited by 19
  11. 2026daVinci-Env: Open SWE Environment Synthesis at Scalecited by 14
  12. 2026OffSeeker: Online Reinforcement Learning Is Not All You Need for Deep Research Agentscited by 12
3 more
  1. 2026OpenThoughts-Agent: Data Recipes for Agentic Modelscited by 11
  2. 2026DeNovoSWE: Scaling Long-Horizon Environments for Generating Entire Repositories from Scratchcited by 8
  3. 2026Signals: Trajectory Sampling and Triage for Agentic Interactionscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Lifecycle-Aware code generation: Leveraging Software Engineering Phases in LLMs
  2. 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agents
  3. 2025SWE-Dev: Evaluating and Training Autonomous Feature-Driven Software Development
  4. 2025Training Versatile Coding Agents in Synthetic Environments
  5. 2026E2E-SWE: Benchmarking LLMs on Building Working Codebases from Scratch
  6. 2026Understanding by Reconstruction: Reversing the Software Development Process for LLM Pretraining
  7. 2025SetupBench: Assessing Software Engineering Agents' Ability to Bootstrap Development Environments
  8. 2025SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models