mlsanityData to 7 Oct 2026

Evaluating Software Process Models for Multi-Agent Class-Level Code Generation

arXiv 2511.09794 ↗First posted 12 Nov 2025cs.SEcited by 2

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Modern software systems require code that is not only functional but also maintainable and well-structured. Although Large Language Models (LLMs) are increasingly used to automate software development, most studies focus on isolated, single-agent function-level generation. This work examines how process structure and role specialization shape multi-agent LLM workflows for class-level code generation. We simulate a Waterfall-style development cycle covering Requirement, Design, Implementation, and Testing using three LLMs (GPT-4o-mini, DeepSeek-Chat, and Claude-3.5-Haiku) on 100 Python tasks from the ClassEval benchmark. Our findings show that multi-agent workflows reorganize, rather than consistently enhance, model performance. Waterfall-style collaboration produces cleaner and more maintainable code but often reduces functional correctness (-37.8% for GPT-4o-mini and -39.8% for DeepSeek-Chat), with Claude-3.5-Haiku as a notable exception (+9.5%). Importantly, process constraints shift failure characteristics: structural issues such as missing code decrease, while semantic and validation errors become more frequent. Among all stages, Testing exerts the strongest influence by improving verification coverage but also introducing new reasoning failures, whereas Requirement and Design have comparatively modest effects. Overall, this study provides empirical evidence that software process structure fundamentally alters how LLMs reason, collaborate, and fail, revealing inherent trade-offs between rigid workflow discipline and flexible problem-solving in multi-agent code generation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 52 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

22 of 52 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025A Survey on Code Generation with LLM-based Agents31 Jul
  2. 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
  3. 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
  4. 2024SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model Agents23 Mar
  5. 2023ChatDev: Communicative Agents for Software Development16 Jul

Other references · 17

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2021Program Synthesis with Large Language Modelscited by 3,509
  3. 2024A Survey on Large Language Models for Code Generationcited by 646
  4. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
  5. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
  6. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
  7. 2023ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generationcited by 166
  8. 2023PanGu-Coder2: Boosting Large Language Models for Code with Ranking Feedbackcited by 69
  9. 2023A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trendscited by 66
  10. 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
  11. 2024Reasoning Runtime Behavior of a Program with LLM: How Far Are We?cited by 44
  12. 2023ClarifyGPT: Empowering LLM-based Code Generation with Intention Clarificationcited by 37
5 more
  1. 2024DeepCode AI Fix: Fixing Security Vulnerabilities with Large Language Modelscited by 7
  2. 2024CoCoST: Automatic Complex Code Generation with Online Searching and Correctness Testingcited by 7
  3. 2024Chain-of-Programming (CoP) : Empowering Large Language Models for Geospatial Code Generationcited by 3
  4. 2024Order Matters! An Empirical Study on Large Language Models' Input Order Bias in Software Fault Localizationcited by 3
  5. 2025EvoGPT: Leveraging LLM-Driven Seed Diversity to Improve Search-Based Test Suite Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AdaCoder: An Adaptive Planning and Multi-Agent Framework for Function-Level Code Generation
  2. 2025Towards Realistic Project-Level Code Generation via Multi-Agent Collaboration and Semantic Architecture Modeling
  3. 2025CodeCoR: An LLM-Based Self-Reflective Multi-Agent Framework for Code Generation
  4. 2025Enhancing LLM Code Generation: A Systematic Evaluation of Multi-Agent Collaboration and Runtime Debugging for Improved Accuracy, Reliability, and Latency
  5. 2026Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report
  6. 2026LLM-Based Agentic Systems for Software Engineering: Challenges and Opportunities
  7. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges
  8. 2026Constraint Decay: The Fragility of LLM Agents in Backend Code Generation