EvoConfig: Self-Evolving Multi-Agent Systems for Efficient Autonomous Environment Configuration
On the map: LLM agents and tool use → Software engineering coding agents
also in 1 more
Abstract (arXiv)
A reliable executable environment is the foundation for ensuring that large language models solve software engineering tasks. Due to the complex and tedious construction process, large-scale configuration is relatively inefficient. However, most methods always overlook fine-grained analysis of the actions performed by the agent, making it difficult to handle complex errors and resulting in configuration failures. To address this bottleneck, we propose EvoConfig, an efficient environment configuration framework that optimizes multi-agent collaboration to build correct runtime environments. EvoConfig features an expert diagnosis module for fine-grained post-execution analysis, and a self-evolving mechanism that lets expert agents self-feedback and dynamically adjust error-fixing priorities in real time. Empirically, EvoConfig matches the previous state-of-the-art Repo2Run on Repo2Run's 420 repositories, while delivering clear gains on harder cases: on the more challenging Envbench, EvoConfig achieves a 78.1% success rate, outperforming Repo2Run by 7.1%. Beyond end-to-end success, EvoConfig also demonstrates stronger debugging competence, achieving higher accuracy in error identification and producing more effective repair recommendations than existing methods.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 48 references that are in the map. First posted on arXiv 23 Jan 2026.
Builds on
33 of 48 references.
Closest ancestors · 9
Same direction, newest first
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
- 2025Process-Level Trajectory Evaluation for Environment Configuration in Software Engineering Agents29 Oct
- 2025SetupBench: Assessing Software Engineering Agents' Ability to Bootstrap Development Environments11 Jul
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projects13 Dec
- 2024Beyond pip install: Evaluating LLM Agents for the Automated Installation of Python Projects9 Dec
- 2024Agents in Software Engineering: Survey, Landscape, and Vision13 Sep
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
Other references · 24
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 353
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2021Are we ready for a new paradigm shift? A Survey on Visual Deep MLPcited by 63
- 2022The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checkingcited by 56
- 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 54
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 42
- 2023LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzlescited by 41
- 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 31
- 2022Scalable Multi-Agent Reinforcement Learning for Warehouse Logistics with Robotic and Human Co-Workerscited by 30
12 more
- 2025Automated Benchmark Generation for Repository-Level Coding Taskscited by 29
- 2025SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositoriescited by 28
- 2025RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedbackcited by 25
- 2024CodeBenchGen: Creating Scalable Execution-based Code Generation Benchmarkscited by 23
- 2024Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmarkcited by 22
- 2025DAST: Context-Aware Compression in LLMs via Dynamic Allocation of Soft Tokenscited by 22
- 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
- 2025Refine Knowledge of Large Language Models via Adaptive Contrastive Learningcited by 15
- 2019DockerizeMe: Automatic Inference of Environment Dependencies for Python Code Snippetscited by 13
- 2024ProductAgent: Benchmarking Conversational Product Search Agent with Asking Clarification Questionscited by 10
- 2025AdmTree: Compressing Lengthy Context with Adaptive Semantic Treescited by 8
- 2025Multi-Docker-Eval: A `Shovel of the Gold Rush' Benchmark on Automatic Environment Building for Software Engineeringcited by 7
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millionscited by 19
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?cited by 4
- 2026TopoAgent: A Self-Evolving Topological Agent for Multimodal Scientific Reasoningcited by 2
- 2026Self-Evolving Coding Agentscited by 2
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Predictioncited by 1
- 2026From Atomic to Agentic: Towards Interpretable Evaluation of LLMs' Agentic Mathematical Capabilitiescited by 0
- 2026Graph-Guided Repository Environment Constructioncited by 0
- 2026Graph-Guided Repository Environment Construction27 Sep 2026
- 2026From Atomic to Agentic: Towards Interpretable Evaluation of LLMs' Agentic Mathematical Capabilities27 Aug 2026
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction21 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?31 Jul 2026
- 2026TopoAgent: A Self-Evolving Topological Agent for Multimodal Scientific Reasoning16 Jul 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI12 Jun 2026
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millions2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025EvoGit: Decentralized Code Evolution via Git-Based Multi-Agent Collaboration
- 2026EvoTool: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selection
- 2024Self-Evolving Multi-Agent Collaboration Networks for Software Development
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Fly
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
- 2025Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agents
- 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnesses
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows