DockSmith: Scaling Reliable Coding Environments via an Agentic Docker Builder
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Reliable Docker-based environment construction is a dominant bottleneck for scaling execution-grounded training and evaluation of software engineering agents. We introduce DockSmith, a specialized agentic Docker builder designed to address this challenge. DockSmith treats environment construction not only as a preprocessing step, but as a core agentic capability that exercises long-horizon tool use, dependency reasoning, and failure recovery, yielding supervision that transfers beyond Docker building itself. DockSmith is trained on large-scale, execution-grounded Docker-building trajectories produced by a SWE-Factory-style pipeline augmented with a loop-detection controller and a cross-task success memory. Training a 30B-A3B model on these trajectories achieves open-source state-of-the-art performance on Multi-Docker-Eval, with 39.72% Fail-to-Pass and 58.28% Commit Rate. Moreover, DockSmith improves out-of-distribution performance on SWE-bench Verified, SWE-bench Multilingual, and Terminal-Bench 2.0, demonstrating broader agentic benefits of environment construction.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 47 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
29 of 47 references.
Closest ancestors · 11
Same direction, newest first
- 2025Doc2Feat-Bench: Evaluating Documentation-Driven Feature Addition24 Jul
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2025Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute31 Mar
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projects13 Dec
- 2024Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvement1 Nov
- 2024Agents in Software Engineering: Survey, Landscape, and Vision13 Sep
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 18
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
- 2024Evaluating Language Models for Efficient Code Generationcited by 69
- 2024Alibaba LingmaAgent: Improving Automated Issue Resolution via Comprehensive Repository Explorationcited by 58
6 more
- 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
- 2025EnvBench: A Benchmark for Automated Environment Setupcited by 36
- 2025Automated Benchmark Generation for Repository-Level Coding Taskscited by 27
- 2025Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Constructioncited by 17
- 2025Multi-Docker-Eval: A `Shovel of the Gold Rush' Benchmark on Automatic Environment Building for Software Engineeringcited by 7
- 2023Less is More? An Empirical Study on Configuration Issues in Python PyPI Ecosystemcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026DeployBench: Benchmarking LLM Agents for Research Artifact Deploymentcited by 6
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 0
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026DeployBench: Benchmarking LLM Agents for Research Artifact Deployment3 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Dockerless: Environment-Free Program Verifier for Coding Agents
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environments
- 2026CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversion
- 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environments
- 2025Training Versatile Coding Agents in Synthetic Environments
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
- 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itself
- 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Tasks