mlsanityData to 7 Oct 2026

app.build: A Production Framework for Scaling Agentic Prompt-to-App Generation with Environment Scaffolding

arXiv 2509.03310 ↗First posted 3 Sep 2025cs.AI cs.SEcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

We present app.build (https://github.com/neondatabase/appdotbuild-agent), an open-source framework that improves LLM-based application generation through systematic validation and structured environments. Our approach combines multi-layered validation pipelines, stack-specific orchestration, and model-agnostic architecture, implemented across three reference stacks. Through evaluation on 30 generation tasks, we demonstrate that comprehensive validation achieves 73.3% viability rate with 30% reaching perfect quality scores, while open-weights models achieve 80.8% of closed-model performance when provided structured environments. The open-source framework has been adopted by the community, with over 3,000 applications generated to date. This work demonstrates that scaling reliable AI agents requires scaling environments, not just models -- providing empirical insights and complete reference implementations for production-oriented agent systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 30 references that are in the map. First posted on arXiv 3 Sep 2025.

Builds on

18 of 30 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  2. 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
  3. 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May

Other references · 14

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2021Program Synthesis with Large Language Modelscited by 3,509
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  8. 2024A Survey on Large Language Models for Code Generationcited by 646
  9. 2024AutoCodeRover: Autonomous Program Improvementcited by 272
  10. 2025S*: Test Time Scaling for Code Generationcited by 95
  11. 2024LLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluationcited by 46
  12. 2024AST-T5: Structure-Aware Pretraining for Code Generation and Understandingcited by 32
2 more
  1. 2024Benchmarks and Metrics for Evaluations of Code Generation: A Critical Reviewcited by 19
  2. 2024Demystifying μcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SynthTools: A Framework for Scaling Synthetic Tools for Agent Development
  2. 2026ADK Arena: Evaluating Agent Development Kits via LLM-as-a-Developer
  3. 2025An Empirical Study of Testing Practices in Open Source AI Agent Frameworks and Agentic Applications
  4. 2025Continuous Benchmark Generation for Evaluating Enterprise-scale LLM Agents
  5. 2025From Prompt to Product: A Human-Centered Benchmark of Agentic App Generation Systems
  6. 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworks
  7. 2025Benchmarking and Studying the LLM-based Agent System in End-to-End Software Development
  8. 2026StartupBench: Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows