Beyond Functional Correctness: Design Issues in AI IDE-Generated Large-Scale Projects
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
New generation of AI coding tools, including AI-powered IDEs equipped with agentic capabilities, can generate code within the context of the project. These AI IDEs are increasingly perceived as capable of producing project-level code at scale. However, there is limited empirical evidence on the extent to which they can generate large-scale software systems and what design issues such systems may exhibit. To address this gap, we conducted a study to explore the capability of Cursor in generating large-scale projects and to evaluate the design quality of projects generated by Cursor. First, we propose a Feature-Driven Human-In-The-Loop (FD-HITL) framework that systematically guides project generation from curated project descriptions. We generated 10 projects using Cursor with the FD-HITL framework across three application domains and multiple technologies. We assessed the functional correctness of these projects through manual evaluation, obtaining an average functional correctness score of 91%. Next, we analyzed the generated projects using two static analysis tools, CodeScene and SonarQube, to detect design issues. We identified 1,305 design issues categorized into 9 categories by CodeScene and 3,193 issues in 11 categories by SonarQube. Our findings show that (1) when used with the FD-HITL framework, Cursor can generate functional large-scale projects averaging 16,965 LoC and 114 files; (2) the generated projects nevertheless contain design issues that may pose long-term maintainability and evolvability risks, requiring careful review by experienced developers; (3) the most prevalent issues include Code Duplication, high Code Complexity, Large Methods, Framework Best-Practice Violations, Exception-Handling Issues and Accessibility Issues; (4) these design issues violate design principles such as SRP, SoC, and DRY. The replication package is at https://github.com/Kashifraz/DIinAGP
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 12 of its 70 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
12 of 70 references.
Closest ancestors · 6
Same direction, newest first
- 2026ProjDevBench: Benchmarking AI Coding Agents on End-to-End Project Development2 Feb
- 2026More Code, Less Reuse: Investigating Code Quality and Reviewer Sentiment towards AI-generated Pull Requests29 Jan
- 2025Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projects6 Nov
- 2025Automatically Generating Web Applications from Requirements Via Multi-Agent Test-Driven Development29 Sep
- 2025The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering20 Jul
- 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology2 Feb
Other references · 6
- 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 101
- 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 76
- 2025Retrieval-Augmented Code Generation: A Survey with Focus on Repository-Level Approachescited by 23
- 2025Assessing the Quality and Security of AI-Generated Code: A Quantitative Analysiscited by 7
- 2025CodeAssistBench (CAB): Dataset & Benchmarking for Multi-turn Chat-Based Code Assistancecited by 5
- 2024Where Is Self-admitted Code Generated by Large Language Models on GitHub?cited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Realistic Project-Level Code Generation via Multi-Agent Collaboration and Semantic Architecture Modeling
- 2022Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
- 2026AI-Generated Smells: An Analysis of Code and Architecture in LLM and Agent-Driven Development
- 2026ICAE-Bench: Evaluating Coding Agents as Interactive Project Builders
- 2026AI builds, We Analyze: An Empirical Study of AI-Generated Build Code Quality
- 2026Context-Augmented Code Generation: How Product Context Improves AI Coding Agent Decision Compliance by 49%
- 2025Agentic Refactoring: An Empirical Study of AI Coding Agents
- 2025From Correctness to Collaboration: Toward a Human-Centered Framework for Evaluating AI Agent Behavior in Software Engineering