mlsanityData to 14 Oct 2026

EvoConfig: Self-Evolving Multi-Agent Systems for Efficient Autonomous Environment Configuration

arXiv 2601.16489 ↗First posted 23 Jan 2026cs.SE cs.AI cs.CLcited by 8

On the map: LLM agents and tool use → Software engineering coding agents

also in 1 more
Abstract (arXiv)

A reliable executable environment is the foundation for ensuring that large language models solve software engineering tasks. Due to the complex and tedious construction process, large-scale configuration is relatively inefficient. However, most methods always overlook fine-grained analysis of the actions performed by the agent, making it difficult to handle complex errors and resulting in configuration failures. To address this bottleneck, we propose EvoConfig, an efficient environment configuration framework that optimizes multi-agent collaboration to build correct runtime environments. EvoConfig features an expert diagnosis module for fine-grained post-execution analysis, and a self-evolving mechanism that lets expert agents self-feedback and dynamically adjust error-fixing priorities in real time. Empirically, EvoConfig matches the previous state-of-the-art Repo2Run on Repo2Run's 420 repositories, while delivering clear gains on harder cases: on the more challenging Envbench, EvoConfig achieves a 78.1% success rate, outperforming Repo2Run by 7.1%. Beyond end-to-end success, EvoConfig also demonstrates stronger debugging competence, achieving higher accuracy in error identification and producing more effective repair recommendations than existing methods.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 48 references that are in the map. First posted on arXiv 23 Jan 2026.

Builds on

33 of 48 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
  2. 2025Process-Level Trajectory Evaluation for Environment Configuration in Software Engineering Agents29 Oct
  3. 2025SetupBench: Assessing Software Engineering Agents' Ability to Bootstrap Development Environments11 Jul
  4. 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
  5. 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
  6. 2024You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projects13 Dec
  7. 2024Beyond pip install: Evaluating LLM Agents for the Automated Installation of Python Projects9 Dec
  8. 2024Agents in Software Engineering: Survey, Landscape, and Vision13 Sep
  9. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul

Other references · 24

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 353
  4. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
  5. 2021Are we ready for a new paradigm shift? A Survey on Visual Deep MLPcited by 63
  6. 2022The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checkingcited by 56
  7. 2023On the (In)Effectiveness of Large Language Models for Chinese Text Correctioncited by 54
  8. 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 42
  9. 2023LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzlescited by 41
  10. 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
  11. 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 31
  12. 2022Scalable Multi-Agent Reinforcement Learning for Warehouse Logistics with Robotic and Human Co-Workerscited by 30
12 more
  1. 2025Automated Benchmark Generation for Repository-Level Coding Taskscited by 29
  2. 2025SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositoriescited by 28
  3. 2025RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedbackcited by 25
  4. 2024CodeBenchGen: Creating Scalable Execution-based Code Generation Benchmarkscited by 23
  5. 2024Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmarkcited by 22
  6. 2025DAST: Context-Aware Compression in LLMs via Dynamic Allocation of Soft Tokenscited by 22
  7. 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
  8. 2025Refine Knowledge of Large Language Models via Adaptive Contrastive Learningcited by 15
  9. 2019DockerizeMe: Automatic Inference of Environment Dependencies for Python Code Snippetscited by 13
  10. 2024ProductAgent: Benchmarking Conversational Product Search Agent with Asking Clarification Questionscited by 10
  11. 2025AdmTree: Compressing Lengthy Context with Adaptive Semantic Treescited by 8
  12. 2025Multi-Docker-Eval: A `Shovel of the Gold Rush' Benchmark on Automatic Environment Building for Software Engineeringcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025EvoGit: Decentralized Code Evolution via Git-Based Multi-Agent Collaboration
  2. 2026EvoTool: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selection
  3. 2024Self-Evolving Multi-Agent Collaboration Networks for Software Development
  4. 2025EvoFlow: Evolving Diverse Agentic Workflows On The Fly
  5. 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
  6. 2025Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agents
  7. 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnesses
  8. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows